2024-09-17T05:11:58.451 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-17T05:11:58.474 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T05:11:58.565 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/avan-2024-09-17_05:02:16-fs:volumes-wip-athakkar-testing-2024-09-16-2351-distro-default-smithi/7908691 branch: wip-athakkar-testing-2024-09-16-2351 description: fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/finisher_per_module}} email: athakkar@redhat.com first_in_suite: false job_id: '7908691' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: avan-2024-09-17_05:02:16-fs:volumes-wip-athakkar-testing-2024-09-16-2351-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-athakkar-testing-2024-09-16-2351 ceph: cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: client: pid file: '' global: ms die on skipped message: false mgr: client mount timeout: 30 debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 820f760e4779dafd30d668ecea7aba6355dfd3d8 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 820f760e4779dafd30d668ecea7aba6355dfd3d8 kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-athakkar-testing-2024-09-16-2351 sha1: 820f760e4779dafd30d668ecea7aba6355dfd3d8 owner: scheduled_avan@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 448 sha1: 820f760e4779dafd30d668ecea7aba6355dfd3d8 sleep_before_teardown: 0 subset: 1/20 suite: fs:volumes suite_branch: wip-athakkar-testing-2024-09-16-2351 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_820f760e4779dafd30d668ecea7aba6355dfd3d8/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 820f760e4779dafd30d668ecea7aba6355dfd3d8 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi098.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD74atD4R/M8JPFcp16JaiXzGRKCLmtDm4K6Y7x5+uBM6OBIQW0Yziefv0WE9V+o6M6sYcABisGPNjC9187AvOA= smithi167.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEJIB6ESXO301QmYrrl2md1O3w/5okFx4e0jJS/8CgQdchYILn5nj20pXusM90/EOE2NOFY/xhA255XyWw7jyYs= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - check-counter: counters: mgr: - min: 4 name: finisher-volumes.complete_latency.avgcount - expected_val: 0 name: finisher-volumes.queue_len - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestPerModuleFinsherThread teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-17_05:02:16 tube: smithi user: avan verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-17T05:11:58.565 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_820f760e4779dafd30d668ecea7aba6355dfd3d8/qa; will attempt to use it 2024-09-17T05:11:58.566 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_820f760e4779dafd30d668ecea7aba6355dfd3d8/qa/tasks 2024-09-17T05:11:58.566 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-17T05:11:58.568 INFO:teuthology.task.internal:Checking packages... 2024-09-17T05:11:58.589 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '820f760e4779dafd30d668ecea7aba6355dfd3d8' 2024-09-17T05:11:58.589 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T05:11:58.589 INFO:teuthology.packaging:ref: None 2024-09-17T05:11:58.589 INFO:teuthology.packaging:tag: None 2024-09-17T05:11:58.589 INFO:teuthology.packaging:branch: wip-athakkar-testing-2024-09-16-2351 2024-09-17T05:11:58.590 INFO:teuthology.packaging:sha1: 820f760e4779dafd30d668ecea7aba6355dfd3d8 2024-09-17T05:11:58.590 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-athakkar-testing-2024-09-16-2351 2024-09-17T05:11:58.752 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4963.g820f760e 2024-09-17T05:11:58.754 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-17T05:11:58.761 INFO:teuthology.task.internal:no buildpackages task found 2024-09-17T05:11:58.761 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-17T05:11:58.767 INFO:teuthology.task.internal:Saving configuration 2024-09-17T05:11:58.787 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-17T05:11:58.794 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-17T05:11:58.819 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi098.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/avan-2024-09-17_05:02:16-fs:volumes-wip-athakkar-testing-2024-09-16-2351-distro-default-smithi/7908691', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 05:06:57.759453', 'locked_by': 'scheduled_avan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD74atD4R/M8JPFcp16JaiXzGRKCLmtDm4K6Y7x5+uBM6OBIQW0Yziefv0WE9V+o6M6sYcABisGPNjC9187AvOA='} 2024-09-17T05:11:58.840 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi167.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/avan-2024-09-17_05:02:16-fs:volumes-wip-athakkar-testing-2024-09-16-2351-distro-default-smithi/7908691', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 05:06:57.757484', 'locked_by': 'scheduled_avan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEJIB6ESXO301QmYrrl2md1O3w/5okFx4e0jJS/8CgQdchYILn5nj20pXusM90/EOE2NOFY/xhA255XyWw7jyYs='} 2024-09-17T05:11:58.840 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-17T05:11:58.847 INFO:teuthology.task.internal:roles: ubuntu@smithi098.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-17T05:11:58.847 INFO:teuthology.task.internal:roles: ubuntu@smithi167.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-17T05:11:58.847 INFO:teuthology.run_tasks:Running task console_log... 2024-09-17T05:11:58.912 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4595e07be0>, signals=[15]) 2024-09-17T05:11:58.913 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-17T05:11:58.919 INFO:teuthology.task.internal:Opening connections... 2024-09-17T05:11:58.919 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi098.front.sepia.ceph.com 2024-09-17T05:11:58.920 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:11:59.004 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi167.front.sepia.ceph.com 2024-09-17T05:11:59.005 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:11:59.085 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-17T05:11:59.092 DEBUG:teuthology.orchestra.run.smithi098:> uname -m 2024-09-17T05:11:59.111 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64 2024-09-17T05:11:59.111 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2024-09-17T05:11:59.169 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="CentOS Stream" 2024-09-17T05:11:59.169 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="9" 2024-09-17T05:11:59.169 INFO:teuthology.orchestra.run.smithi098.stdout:ID="centos" 2024-09-17T05:11:59.169 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="rhel fedora" 2024-09-17T05:11:59.169 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="9" 2024-09-17T05:11:59.169 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el9" 2024-09-17T05:11:59.169 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-17T05:11:59.170 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31" 2024-09-17T05:11:59.170 INFO:teuthology.orchestra.run.smithi098.stdout:LOGO="fedora-logo-icon" 2024-09-17T05:11:59.170 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-17T05:11:59.170 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://centos.org/" 2024-09-17T05:11:59.170 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-17T05:11:59.170 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-17T05:11:59.170 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-17T05:11:59.171 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2024-09-17T05:11:59.194 DEBUG:teuthology.orchestra.run.smithi167:> uname -m 2024-09-17T05:11:59.212 INFO:teuthology.orchestra.run.smithi167.stdout:x86_64 2024-09-17T05:11:59.212 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release 2024-09-17T05:11:59.269 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="CentOS Stream" 2024-09-17T05:11:59.270 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="9" 2024-09-17T05:11:59.270 INFO:teuthology.orchestra.run.smithi167.stdout:ID="centos" 2024-09-17T05:11:59.270 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="rhel fedora" 2024-09-17T05:11:59.270 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="9" 2024-09-17T05:11:59.270 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el9" 2024-09-17T05:11:59.270 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-17T05:11:59.270 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31" 2024-09-17T05:11:59.270 INFO:teuthology.orchestra.run.smithi167.stdout:LOGO="fedora-logo-icon" 2024-09-17T05:11:59.270 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-17T05:11:59.270 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://centos.org/" 2024-09-17T05:11:59.270 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-17T05:11:59.270 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-17T05:11:59.270 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-17T05:11:59.271 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2024-09-17T05:11:59.294 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-17T05:11:59.304 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-17T05:11:59.310 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-17T05:11:59.311 DEBUG:teuthology.orchestra.run.smithi098:> test '!' -e /home/ubuntu/cephtest 2024-09-17T05:11:59.313 DEBUG:teuthology.orchestra.run.smithi167:> test '!' -e /home/ubuntu/cephtest 2024-09-17T05:11:59.329 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-17T05:11:59.335 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-17T05:11:59.335 DEBUG:teuthology.orchestra.run.smithi098:> test -z $(ls -A /var/lib/ceph) 2024-09-17T05:11:59.371 DEBUG:teuthology.orchestra.run.smithi167:> test -z $(ls -A /var/lib/ceph) 2024-09-17T05:11:59.482 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-17T05:11:59.538 INFO:teuthology.run_tasks:Running task kernel... 2024-09-17T05:11:59.553 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-17T05:11:59.553 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-09-17T05:11:59.553 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-09-17T05:11:59.553 DEBUG:teuthology.orchestra.run.smithi098:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T05:11:59.554 DEBUG:teuthology.orchestra.run.smithi167:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T05:11:59.570 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:11:59.571 DEBUG:teuthology.orchestra.run.smithi098:> uname -r 2024-09-17T05:11:59.572 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:11:59.572 DEBUG:teuthology.orchestra.run.smithi167:> uname -r 2024-09-17T05:11:59.629 INFO:teuthology.orchestra.run.smithi167.stdout:5.14.0-503.el9.x86_64 2024-09-17T05:11:59.629 INFO:teuthology.task.kernel:Running kernel on smithi167: 5.14.0-503.el9.x86_64 2024-09-17T05:11:59.629 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum install -y kernel 2024-09-17T05:11:59.630 INFO:teuthology.orchestra.run.smithi098.stdout:5.14.0-503.el9.x86_64 2024-09-17T05:11:59.631 INFO:teuthology.task.kernel:Running kernel on smithi098: 5.14.0-503.el9.x86_64 2024-09-17T05:11:59.631 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum install -y kernel 2024-09-17T05:12:01.956 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.3 MB 00:00 2024-09-17T05:12:04.645 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - BaseOS 2.6 MB/s | 8.3 MB 00:03 2024-09-17T05:12:06.319 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - AppStream 33 MB/s | 20 MB 00:00 2024-09-17T05:12:07.515 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - AppStream 4.5 MB/s | 20 MB 00:04 2024-09-17T05:12:11.724 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.5 MB 00:00 2024-09-17T05:12:11.736 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - CRB 4.1 MB/s | 6.5 MB 00:01 2024-09-17T05:12:13.274 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - Extras packages 54 kB/s | 19 kB 00:00 2024-09-17T05:12:13.362 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - Extras packages 50 kB/s | 19 kB 00:00 2024-09-17T05:12:14.404 INFO:teuthology.orchestra.run.smithi098.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-17T05:12:14.416 INFO:teuthology.orchestra.run.smithi167.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-17T05:12:19.780 INFO:teuthology.orchestra.run.smithi167.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-17T05:12:19.893 INFO:teuthology.orchestra.run.smithi098.stdout:lab-extras 24 kB/s | 1.7 kB 00:00 2024-09-17T05:12:21.678 INFO:teuthology.orchestra.run.smithi167.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-17T05:12:21.678 INFO:teuthology.orchestra.run.smithi167.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-17T05:12:21.760 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-17T05:12:21.768 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-17T05:12:21.768 INFO:teuthology.orchestra.run.smithi167.stdout: Package Architecture Version Repository Size 2024-09-17T05:12:21.768 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-17T05:12:21.768 INFO:teuthology.orchestra.run.smithi167.stdout:Installing: 2024-09-17T05:12:21.768 INFO:teuthology.orchestra.run.smithi167.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-17T05:12:21.768 INFO:teuthology.orchestra.run.smithi167.stdout:Installing dependencies: 2024-09-17T05:12:21.768 INFO:teuthology.orchestra.run.smithi167.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-17T05:12:21.768 INFO:teuthology.orchestra.run.smithi167.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-17T05:12:21.769 INFO:teuthology.orchestra.run.smithi167.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-17T05:12:21.769 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T05:12:21.769 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction Summary 2024-09-17T05:12:21.769 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-17T05:12:21.769 INFO:teuthology.orchestra.run.smithi167.stdout:Install 4 Packages 2024-09-17T05:12:21.769 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T05:12:21.769 INFO:teuthology.orchestra.run.smithi167.stdout:Total download size: 79 M 2024-09-17T05:12:21.770 INFO:teuthology.orchestra.run.smithi167.stdout:Installed size: 126 M 2024-09-17T05:12:21.770 INFO:teuthology.orchestra.run.smithi167.stdout:Downloading Packages: 2024-09-17T05:12:21.783 INFO:teuthology.orchestra.run.smithi098.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-17T05:12:21.783 INFO:teuthology.orchestra.run.smithi098.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-17T05:12:21.865 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-17T05:12:21.875 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-17T05:12:21.875 INFO:teuthology.orchestra.run.smithi098.stdout: Package Architecture Version Repository Size 2024-09-17T05:12:21.875 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-17T05:12:21.876 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-17T05:12:21.876 INFO:teuthology.orchestra.run.smithi098.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-17T05:12:21.876 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2024-09-17T05:12:21.876 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-17T05:12:21.876 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-17T05:12:21.876 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-17T05:12:21.876 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:12:21.876 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-17T05:12:21.876 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-17T05:12:21.876 INFO:teuthology.orchestra.run.smithi098.stdout:Install 4 Packages 2024-09-17T05:12:21.876 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:12:21.877 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 79 M 2024-09-17T05:12:21.877 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 126 M 2024-09-17T05:12:21.877 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-17T05:12:22.006 INFO:teuthology.orchestra.run.smithi167.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 303 kB/s | 36 kB 00:00 2024-09-17T05:12:22.461 INFO:teuthology.orchestra.run.smithi098.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 64 kB/s | 36 kB 00:00 2024-09-17T05:12:23.337 INFO:teuthology.orchestra.run.smithi098.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-17T05:12:24.045 INFO:teuthology.orchestra.run.smithi098.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 16 MB/s | 35 MB 00:02 2024-09-17T05:12:24.912 INFO:teuthology.orchestra.run.smithi098.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 12 MB/s | 29 MB 00:02 2024-09-17T05:12:24.912 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-17T05:12:24.913 INFO:teuthology.orchestra.run.smithi098.stdout:Total 26 MB/s | 79 MB 00:03 2024-09-17T05:12:25.591 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-17T05:12:25.949 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-17T05:12:25.949 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-17T05:12:26.907 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-17T05:12:26.908 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-17T05:12:28.789 INFO:teuthology.orchestra.run.smithi167.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 2.3 MB/s | 16 MB 00:06 2024-09-17T05:12:29.354 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-17T05:12:30.057 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-17T05:12:30.139 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T05:12:32.876 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T05:12:33.009 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T05:12:35.072 INFO:teuthology.orchestra.run.smithi167.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 2.2 MB/s | 29 MB 00:13 2024-09-17T05:12:37.847 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T05:12:37.902 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T05:12:38.123 INFO:teuthology.orchestra.run.smithi167.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 2.1 MB/s | 35 MB 00:16 2024-09-17T05:12:38.123 INFO:teuthology.orchestra.run.smithi167.stdout:-------------------------------------------------------------------------------- 2024-09-17T05:12:38.123 INFO:teuthology.orchestra.run.smithi167.stdout:Total 4.8 MB/s | 79 MB 00:16 2024-09-17T05:12:38.815 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction check 2024-09-17T05:12:39.189 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction check succeeded. 2024-09-17T05:12:39.189 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction test 2024-09-17T05:12:40.134 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction test succeeded. 2024-09-17T05:12:40.134 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction 2024-09-17T05:12:42.572 INFO:teuthology.orchestra.run.smithi167.stdout: Preparing : 1/1 2024-09-17T05:12:42.741 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T05:12:43.501 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-17T05:12:43.590 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T05:12:46.362 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T05:12:46.484 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T05:12:51.335 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T05:12:51.543 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T05:12:56.402 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T05:13:20.482 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T05:13:20.522 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-17T05:13:20.879 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T05:13:20.879 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-17T05:13:20.879 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T05:13:20.879 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T05:13:21.699 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T05:13:21.699 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:13:21.699 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-17T05:13:21.700 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-17T05:13:21.700 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-17T05:13:21.700 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-17T05:13:21.700 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-17T05:13:21.700 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:13:21.700 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-17T05:13:22.045 DEBUG:teuthology.orchestra.run.smithi098:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T05:13:22.129 INFO:teuthology.orchestra.run.smithi098.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T05:13:22.129 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T05:13:22.129 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-17T05:13:22.129 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T05:13:22.130 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T05:13:22.130 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-17T05:13:22.130 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi098.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T05:13:22.130 DEBUG:teuthology.orchestra.run.smithi098:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T05:13:22.188 INFO:teuthology.orchestra.run.smithi098.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T05:13:22.189 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T05:13:22.189 DEBUG:teuthology.orchestra.run.smithi098:> sudo rpm -qi grub2-tools 2024-09-17T05:13:22.220 INFO:teuthology.orchestra.run.smithi098.stdout:Name : grub2-tools 2024-09-17T05:13:22.221 INFO:teuthology.orchestra.run.smithi098.stdout:Epoch : 1 2024-09-17T05:13:22.221 INFO:teuthology.orchestra.run.smithi098.stdout:Version : 2.06 2024-09-17T05:13:22.221 INFO:teuthology.orchestra.run.smithi098.stdout:Release : 82.el9 2024-09-17T05:13:22.221 INFO:teuthology.orchestra.run.smithi098.stdout:Architecture: x86_64 2024-09-17T05:13:22.221 INFO:teuthology.orchestra.run.smithi098.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-17T05:13:22.221 INFO:teuthology.orchestra.run.smithi098.stdout:Group : Unspecified 2024-09-17T05:13:22.221 INFO:teuthology.orchestra.run.smithi098.stdout:Size : 8274670 2024-09-17T05:13:22.221 INFO:teuthology.orchestra.run.smithi098.stdout:License : GPLv3+ 2024-09-17T05:13:22.221 INFO:teuthology.orchestra.run.smithi098.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-17T05:13:22.221 INFO:teuthology.orchestra.run.smithi098.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-17T05:13:22.221 INFO:teuthology.orchestra.run.smithi098.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-17T05:13:22.222 INFO:teuthology.orchestra.run.smithi098.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-17T05:13:22.222 INFO:teuthology.orchestra.run.smithi098.stdout:Packager : builder@centos.org 2024-09-17T05:13:22.222 INFO:teuthology.orchestra.run.smithi098.stdout:Vendor : CentOS 2024-09-17T05:13:22.222 INFO:teuthology.orchestra.run.smithi098.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-17T05:13:22.222 INFO:teuthology.orchestra.run.smithi098.stdout:Summary : Support tools for GRUB. 2024-09-17T05:13:22.222 INFO:teuthology.orchestra.run.smithi098.stdout:Description : 2024-09-17T05:13:22.222 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:13:22.222 INFO:teuthology.orchestra.run.smithi098.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-17T05:13:22.222 INFO:teuthology.orchestra.run.smithi098.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-17T05:13:22.222 INFO:teuthology.orchestra.run.smithi098.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-17T05:13:22.222 INFO:teuthology.orchestra.run.smithi098.stdout:hardware devices. 2024-09-17T05:13:22.222 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:13:22.222 INFO:teuthology.orchestra.run.smithi098.stdout:This subpackage provides tools for support of all platforms. 2024-09-17T05:13:22.224 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-17T05:13:22.224 INFO:teuthology.task.kernel:Updating grub on smithi098 to boot 5.14.0-508.el9.x86_64 2024-09-17T05:13:22.224 DEBUG:teuthology.orchestra.run.smithi098:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-17T05:13:22.826 INFO:teuthology.orchestra.run.smithi098.stderr:Generating grub configuration file ... 2024-09-17T05:13:24.125 INFO:teuthology.orchestra.run.smithi098.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-17T05:13:24.161 INFO:teuthology.orchestra.run.smithi098.stderr:done 2024-09-17T05:13:24.163 DEBUG:teuthology.orchestra.run.smithi098:> mktemp 2024-09-17T05:13:24.178 INFO:teuthology.orchestra.run.smithi098.stdout:/tmp/tmp.uhjbrZ71kS 2024-09-17T05:13:24.179 DEBUG:teuthology.orchestra.run.smithi098:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.uhjbrZ71kS 2024-09-17T05:13:24.252 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 0666 /tmp/tmp.uhjbrZ71kS 2024-09-17T05:13:24.399 DEBUG:teuthology.orchestra.remote:smithi098:/tmp/tmp.uhjbrZ71kS is 6KB 2024-09-17T05:13:24.448 DEBUG:teuthology.orchestra.run.smithi098:> rm -fr /tmp/tmp.uhjbrZ71kS 2024-09-17T05:13:24.462 DEBUG:teuthology.orchestra.run.smithi098:> sudo /bin/ls /boot/loader/entries || true 2024-09-17T05:13:24.525 INFO:teuthology.orchestra.run.smithi098.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-17T05:13:24.525 INFO:teuthology.orchestra.run.smithi098.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-17T05:13:24.525 INFO:teuthology.orchestra.run.smithi098.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-17T05:13:24.526 INFO:teuthology.orchestra.run.smithi098.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-17T05:13:24.527 DEBUG:teuthology.orchestra.run.smithi098:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-17T05:13:24.664 DEBUG:teuthology.orchestra.run.smithi098:> sudo shutdown -r now 2024-09-17T05:13:34.309 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T05:13:34.348 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-17T05:13:34.678 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T05:13:34.678 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-17T05:13:34.678 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T05:13:34.678 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T05:13:35.533 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T05:13:35.533 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T05:13:35.533 INFO:teuthology.orchestra.run.smithi167.stdout:Installed: 2024-09-17T05:13:35.533 INFO:teuthology.orchestra.run.smithi167.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-17T05:13:35.534 INFO:teuthology.orchestra.run.smithi167.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-17T05:13:35.534 INFO:teuthology.orchestra.run.smithi167.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-17T05:13:35.534 INFO:teuthology.orchestra.run.smithi167.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-17T05:13:35.534 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T05:13:35.534 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-17T05:13:35.925 DEBUG:teuthology.orchestra.run.smithi167:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T05:13:36.017 INFO:teuthology.orchestra.run.smithi167.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T05:13:36.018 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T05:13:36.018 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-17T05:13:36.018 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T05:13:36.018 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T05:13:36.018 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2024-09-17T05:13:36.018 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi167.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T05:13:36.018 DEBUG:teuthology.orchestra.run.smithi167:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T05:13:36.077 INFO:teuthology.orchestra.run.smithi167.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T05:13:36.078 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T05:13:36.078 DEBUG:teuthology.orchestra.run.smithi167:> sudo rpm -qi grub2-tools 2024-09-17T05:13:36.115 INFO:teuthology.orchestra.run.smithi167.stdout:Name : grub2-tools 2024-09-17T05:13:36.115 INFO:teuthology.orchestra.run.smithi167.stdout:Epoch : 1 2024-09-17T05:13:36.115 INFO:teuthology.orchestra.run.smithi167.stdout:Version : 2.06 2024-09-17T05:13:36.115 INFO:teuthology.orchestra.run.smithi167.stdout:Release : 82.el9 2024-09-17T05:13:36.115 INFO:teuthology.orchestra.run.smithi167.stdout:Architecture: x86_64 2024-09-17T05:13:36.115 INFO:teuthology.orchestra.run.smithi167.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-17T05:13:36.115 INFO:teuthology.orchestra.run.smithi167.stdout:Group : Unspecified 2024-09-17T05:13:36.116 INFO:teuthology.orchestra.run.smithi167.stdout:Size : 8274670 2024-09-17T05:13:36.116 INFO:teuthology.orchestra.run.smithi167.stdout:License : GPLv3+ 2024-09-17T05:13:36.116 INFO:teuthology.orchestra.run.smithi167.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-17T05:13:36.116 INFO:teuthology.orchestra.run.smithi167.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-17T05:13:36.116 INFO:teuthology.orchestra.run.smithi167.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-17T05:13:36.116 INFO:teuthology.orchestra.run.smithi167.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-17T05:13:36.116 INFO:teuthology.orchestra.run.smithi167.stdout:Packager : builder@centos.org 2024-09-17T05:13:36.116 INFO:teuthology.orchestra.run.smithi167.stdout:Vendor : CentOS 2024-09-17T05:13:36.116 INFO:teuthology.orchestra.run.smithi167.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-17T05:13:36.116 INFO:teuthology.orchestra.run.smithi167.stdout:Summary : Support tools for GRUB. 2024-09-17T05:13:36.116 INFO:teuthology.orchestra.run.smithi167.stdout:Description : 2024-09-17T05:13:36.116 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T05:13:36.116 INFO:teuthology.orchestra.run.smithi167.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-17T05:13:36.117 INFO:teuthology.orchestra.run.smithi167.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-17T05:13:36.117 INFO:teuthology.orchestra.run.smithi167.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-17T05:13:36.117 INFO:teuthology.orchestra.run.smithi167.stdout:hardware devices. 2024-09-17T05:13:36.117 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T05:13:36.117 INFO:teuthology.orchestra.run.smithi167.stdout:This subpackage provides tools for support of all platforms. 2024-09-17T05:13:36.118 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-17T05:13:36.118 INFO:teuthology.task.kernel:Updating grub on smithi167 to boot 5.14.0-508.el9.x86_64 2024-09-17T05:13:36.118 DEBUG:teuthology.orchestra.run.smithi167:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-17T05:13:36.784 INFO:teuthology.orchestra.run.smithi167.stderr:Generating grub configuration file ... 2024-09-17T05:13:38.086 INFO:teuthology.orchestra.run.smithi167.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-17T05:13:38.117 INFO:teuthology.orchestra.run.smithi167.stderr:done 2024-09-17T05:13:38.119 DEBUG:teuthology.orchestra.run.smithi167:> mktemp 2024-09-17T05:13:38.136 INFO:teuthology.orchestra.run.smithi167.stdout:/tmp/tmp.zrtA61SWt6 2024-09-17T05:13:38.136 DEBUG:teuthology.orchestra.run.smithi167:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.zrtA61SWt6 2024-09-17T05:13:38.203 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 0666 /tmp/tmp.zrtA61SWt6 2024-09-17T05:13:38.351 DEBUG:teuthology.orchestra.remote:smithi167:/tmp/tmp.zrtA61SWt6 is 6KB 2024-09-17T05:13:38.400 DEBUG:teuthology.orchestra.run.smithi167:> rm -fr /tmp/tmp.zrtA61SWt6 2024-09-17T05:13:38.415 DEBUG:teuthology.orchestra.run.smithi167:> sudo /bin/ls /boot/loader/entries || true 2024-09-17T05:13:38.483 INFO:teuthology.orchestra.run.smithi167.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-17T05:13:38.483 INFO:teuthology.orchestra.run.smithi167.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-17T05:13:38.483 INFO:teuthology.orchestra.run.smithi167.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-17T05:13:38.483 INFO:teuthology.orchestra.run.smithi167.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-17T05:13:38.485 DEBUG:teuthology.orchestra.run.smithi167:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-17T05:13:38.645 DEBUG:teuthology.orchestra.run.smithi167:> sudo shutdown -r now 2024-09-17T05:13:54.681 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-17T05:13:54.681 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-17T05:13:54.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:14:08.658 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-09-17T05:14:08.658 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-09-17T05:14:08.659 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:14:13.181 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-09-17T05:14:22.189 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-17T05:14:22.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:14:25.245 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-09-17T05:14:27.005 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.167 2024-09-17T05:14:36.013 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-09-17T05:14:36.013 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:14:37.247 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-17T05:14:37.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:14:39.073 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.167 2024-09-17T05:14:51.085 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-09-17T05:14:51.089 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:15:09.067 DEBUG:teuthology.orchestra.run.smithi098:> true 2024-09-17T05:15:09.375 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-17T05:15:09.375 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-508.el9.x86_64"... 2024-09-17T05:15:09.375 DEBUG:teuthology.orchestra.run.smithi098:> uname -r 2024-09-17T05:15:09.389 INFO:teuthology.orchestra.run.smithi098.stdout:5.14.0-508.el9.x86_64 2024-09-17T05:15:09.390 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-17T05:15:09.390 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T05:15:09.390 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-17T05:15:09.501 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.167 2024-09-17T05:15:10.391 DEBUG:teuthology.parallel:result is None 2024-09-17T05:15:24.501 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-09-17T05:15:24.503 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:15:24.947 DEBUG:teuthology.orchestra.run.smithi167:> true 2024-09-17T05:15:25.311 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-09-17T05:15:25.311 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.14.0-508.el9.x86_64"... 2024-09-17T05:15:25.311 DEBUG:teuthology.orchestra.run.smithi167:> uname -r 2024-09-17T05:15:25.327 INFO:teuthology.orchestra.run.smithi167.stdout:5.14.0-508.el9.x86_64 2024-09-17T05:15:25.328 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-17T05:15:25.328 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T05:15:25.328 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-17T05:15:26.330 DEBUG:teuthology.parallel:result is None 2024-09-17T05:15:26.330 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-17T05:15:26.341 INFO:teuthology.task.internal:Creating test directory... 2024-09-17T05:15:26.342 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T05:15:26.345 DEBUG:teuthology.orchestra.run.smithi167:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T05:15:26.362 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-17T05:15:26.371 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-17T05:15:26.380 INFO:teuthology.task.internal:Creating archive directory... 2024-09-17T05:15:26.380 DEBUG:teuthology.orchestra.run.smithi098:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T05:15:26.405 DEBUG:teuthology.orchestra.run.smithi167:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T05:15:26.443 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-17T05:15:26.450 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-17T05:15:26.450 DEBUG:teuthology.orchestra.run.smithi098:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T05:15:26.479 DEBUG:teuthology.orchestra.run.smithi167:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T05:15:26.560 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T05:15:26.566 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T05:15:26.586 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T05:15:26.617 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T05:15:26.619 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-17T05:15:26.626 INFO:teuthology.task.internal:Configuring sudo... 2024-09-17T05:15:26.626 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T05:15:26.629 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T05:15:26.656 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-17T05:15:26.738 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-17T05:15:26.738 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T05:15:26.741 DEBUG:teuthology.orchestra.run.smithi167:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T05:15:26.758 DEBUG:teuthology.orchestra.run.smithi098:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T05:15:26.846 DEBUG:teuthology.orchestra.run.smithi098:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T05:15:26.893 DEBUG:teuthology.orchestra.run.smithi098:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T05:15:26.982 DEBUG:teuthology.orchestra.run.smithi098:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T05:15:27.021 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T05:15:27.022 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T05:15:27.087 DEBUG:teuthology.orchestra.run.smithi167:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T05:15:27.176 DEBUG:teuthology.orchestra.run.smithi167:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T05:15:27.263 DEBUG:teuthology.orchestra.run.smithi167:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T05:15:27.331 DEBUG:teuthology.orchestra.run.smithi167:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T05:15:27.404 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-17T05:15:27.404 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T05:15:27.475 DEBUG:teuthology.orchestra.run.smithi098:> sudo service rsyslog restart 2024-09-17T05:15:27.478 DEBUG:teuthology.orchestra.run.smithi167:> sudo service rsyslog restart 2024-09-17T05:15:27.524 INFO:teuthology.orchestra.run.smithi098.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T05:15:27.617 INFO:teuthology.orchestra.run.smithi167.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T05:15:28.036 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-17T05:15:28.044 INFO:teuthology.task.internal:Starting timer... 2024-09-17T05:15:28.044 INFO:teuthology.run_tasks:Running task pcp... 2024-09-17T05:15:28.057 INFO:teuthology.run_tasks:Running task selinux... 2024-09-17T05:15:28.067 DEBUG:teuthology.orchestra.run.smithi098:> sudo service auditd rotate 2024-09-17T05:15:28.134 INFO:teuthology.orchestra.run.smithi098.stdout:Rotating logs: 2024-09-17T05:15:28.135 DEBUG:teuthology.orchestra.run.smithi167:> sudo service auditd rotate 2024-09-17T05:15:28.187 INFO:teuthology.orchestra.run.smithi167.stdout:Rotating logs: 2024-09-17T05:15:28.190 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-17T05:15:28.190 DEBUG:teuthology.orchestra.run.smithi098:> /usr/sbin/getenforce 2024-09-17T05:15:28.212 INFO:teuthology.orchestra.run.smithi098.stdout:Permissive 2024-09-17T05:15:28.212 DEBUG:teuthology.orchestra.run.smithi167:> /usr/sbin/getenforce 2024-09-17T05:15:28.231 INFO:teuthology.orchestra.run.smithi167.stdout:Permissive 2024-09-17T05:15:28.231 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi098.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi167.front.sepia.ceph.com': 'permissive'} 2024-09-17T05:15:28.231 DEBUG:teuthology.orchestra.run.smithi098:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T05:15:28.280 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:15:28.280 DEBUG:teuthology.orchestra.run.smithi167:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T05:15:28.306 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:15:28.306 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-17T05:15:28.306 DEBUG:teuthology.orchestra.run.smithi098:> sudo /usr/sbin/setenforce permissive 2024-09-17T05:15:28.355 DEBUG:teuthology.orchestra.run.smithi167:> sudo /usr/sbin/setenforce permissive 2024-09-17T05:15:28.393 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-17T05:15:28.406 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-17T05:15:28.410 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-17T05:15:28.681 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-17T05:15:28.693 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-17T05:15:28.694 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi098.front.sepia.ceph.com,smithi167.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-17T05:19:10.922 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi098.front.sepia.ceph.com'), Remote(name='ubuntu@smithi167.front.sepia.ceph.com')] 2024-09-17T05:19:10.924 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-17T05:19:10.925 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:19:11.003 DEBUG:teuthology.orchestra.run.smithi098:> true 2024-09-17T05:19:11.079 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-17T05:19:11.080 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-09-17T05:19:11.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:19:11.156 DEBUG:teuthology.orchestra.run.smithi167:> true 2024-09-17T05:19:11.239 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-09-17T05:19:11.240 INFO:teuthology.run_tasks:Running task clock... 2024-09-17T05:19:11.250 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-17T05:19:11.250 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T05:19:11.251 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T05:19:11.254 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T05:19:11.254 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T05:19:11.279 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-17T05:19:11.293 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-17T05:19:11.308 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-17T05:19:11.317 INFO:teuthology.orchestra.run.smithi098.stderr:sudo: ntpd: command not found 2024-09-17T05:19:11.323 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-17T05:19:11.328 INFO:teuthology.orchestra.run.smithi098.stdout:506 Cannot talk to daemon 2024-09-17T05:19:11.342 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-17T05:19:11.348 INFO:teuthology.orchestra.run.smithi167.stderr:sudo: ntpd: command not found 2024-09-17T05:19:11.357 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-17T05:19:11.359 INFO:teuthology.orchestra.run.smithi167.stdout:506 Cannot talk to daemon 2024-09-17T05:19:11.373 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-17T05:19:11.387 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-17T05:19:11.414 INFO:teuthology.orchestra.run.smithi098.stderr:bash: line 1: ntpq: command not found 2024-09-17T05:19:11.418 INFO:teuthology.orchestra.run.smithi098.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T05:19:11.418 INFO:teuthology.orchestra.run.smithi098.stdout:=============================================================================== 2024-09-17T05:19:11.418 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T05:19:11.418 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T05:19:11.418 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T05:19:11.418 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T05:19:11.440 INFO:teuthology.orchestra.run.smithi167.stderr:bash: line 1: ntpq: command not found 2024-09-17T05:19:11.444 INFO:teuthology.orchestra.run.smithi167.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T05:19:11.444 INFO:teuthology.orchestra.run.smithi167.stdout:=============================================================================== 2024-09-17T05:19:11.444 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T05:19:11.444 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T05:19:11.444 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T05:19:11.444 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T05:19:11.444 INFO:teuthology.run_tasks:Running task install... 2024-09-17T05:19:11.452 DEBUG:teuthology.task.install:project ceph 2024-09-17T05:19:11.452 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '820f760e4779dafd30d668ecea7aba6355dfd3d8'}} 2024-09-17T05:19:11.453 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '820f760e4779dafd30d668ecea7aba6355dfd3d8'} 2024-09-17T05:19:11.453 INFO:teuthology.task.install:Using flavor: default 2024-09-17T05:19:11.458 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-17T05:19:11.458 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-17T05:19:11.459 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '820f760e4779dafd30d668ecea7aba6355dfd3d8', 'tag': None, 'wait_for_package': False} 2024-09-17T05:19:11.459 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=820f760e4779dafd30d668ecea7aba6355dfd3d8 2024-09-17T05:19:11.461 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '820f760e4779dafd30d668ecea7aba6355dfd3d8', 'tag': None, 'wait_for_package': False} 2024-09-17T05:19:11.461 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=820f760e4779dafd30d668ecea7aba6355dfd3d8 2024-09-17T05:19:11.607 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/centos/9/flavors/default/ 2024-09-17T05:19:11.608 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4963.g820f760e 2024-09-17T05:19:11.615 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/centos/9/flavors/default/ 2024-09-17T05:19:11.616 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4963.g820f760e 2024-09-17T05:19:11.720 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-17T05:19:11.720 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-17T05:19:11.720 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-17T05:19:11.729 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-17T05:19:11.729 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T05:19:11.729 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-17T05:19:11.749 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-17T05:19:11.750 DEBUG:teuthology.orchestra.run.smithi167:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/820f760e4779dafd30d668ecea7aba6355dfd3d8/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-17T05:19:11.755 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-17T05:19:11.755 DEBUG:teuthology.orchestra.run.smithi098:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/820f760e4779dafd30d668ecea7aba6355dfd3d8/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-17T05:19:11.817 DEBUG:teuthology.orchestra.run.smithi167:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-17T05:19:11.821 DEBUG:teuthology.orchestra.run.smithi098:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-17T05:19:11.893 DEBUG:teuthology.orchestra.run.smithi167:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-17T05:19:11.896 DEBUG:teuthology.orchestra.run.smithi098:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-17T05:19:11.957 INFO:teuthology.orchestra.run.smithi167.stdout:check_obsoletes = 1 2024-09-17T05:19:11.959 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum clean all 2024-09-17T05:19:11.961 INFO:teuthology.orchestra.run.smithi098.stdout:check_obsoletes = 1 2024-09-17T05:19:11.962 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum clean all 2024-09-17T05:19:12.200 INFO:teuthology.orchestra.run.smithi167.stdout:45 files removed 2024-09-17T05:19:12.210 INFO:teuthology.orchestra.run.smithi098.stdout:45 files removed 2024-09-17T05:19:12.227 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-17T05:19:12.237 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-17T05:19:12.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph packages for x86_64 321 kB/s | 84 kB 00:00 2024-09-17T05:19:12.794 INFO:teuthology.orchestra.run.smithi098.stdout:ceph packages for x86_64 311 kB/s | 84 kB 00:00 2024-09-17T05:19:13.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph noarch packages 101 kB/s | 24 kB 00:00 2024-09-17T05:19:13.087 INFO:teuthology.orchestra.run.smithi098.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-09-17T05:19:13.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-17T05:19:13.373 INFO:teuthology.orchestra.run.smithi098.stdout:ceph source packages 7.7 kB/s | 1.9 kB 00:00 2024-09-17T05:19:15.154 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - BaseOS 4.7 MB/s | 8.3 MB 00:01 2024-09-17T05:19:15.297 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - BaseOS 4.3 MB/s | 8.3 MB 00:01 2024-09-17T05:19:16.930 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - AppStream 36 MB/s | 20 MB 00:00 2024-09-17T05:19:16.955 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - AppStream 28 MB/s | 20 MB 00:00 2024-09-17T05:19:22.472 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - CRB 3.7 MB/s | 6.5 MB 00:01 2024-09-17T05:19:22.565 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - CRB 4.3 MB/s | 6.5 MB 00:01 2024-09-17T05:19:24.323 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - Extras packages 40 kB/s | 19 kB 00:00 2024-09-17T05:19:25.015 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - Extras packages 15 kB/s | 19 kB 00:01 2024-09-17T05:19:25.403 INFO:teuthology.orchestra.run.smithi167.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-17T05:19:26.080 INFO:teuthology.orchestra.run.smithi098.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-17T05:19:30.859 INFO:teuthology.orchestra.run.smithi167.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-17T05:19:31.509 INFO:teuthology.orchestra.run.smithi098.stdout:lab-extras 41 kB/s | 1.7 kB 00:00 2024-09-17T05:19:33.089 INFO:teuthology.orchestra.run.smithi167.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-17T05:19:33.090 INFO:teuthology.orchestra.run.smithi167.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-17T05:19:33.104 INFO:teuthology.orchestra.run.smithi167.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-17T05:19:33.105 INFO:teuthology.orchestra.run.smithi167.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-17T05:19:33.106 INFO:teuthology.orchestra.run.smithi167.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-17T05:19:33.107 INFO:teuthology.orchestra.run.smithi167.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-17T05:19:33.109 INFO:teuthology.orchestra.run.smithi167.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-17T05:19:33.112 INFO:teuthology.orchestra.run.smithi167.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-17T05:19:33.113 INFO:teuthology.orchestra.run.smithi167.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-17T05:19:33.177 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-17T05:19:33.201 INFO:teuthology.orchestra.run.smithi167.stdout:======================================================================================= 2024-09-17T05:19:33.201 INFO:teuthology.orchestra.run.smithi167.stdout: Package Arch Version Repository Size 2024-09-17T05:19:33.201 INFO:teuthology.orchestra.run.smithi167.stdout:======================================================================================= 2024-09-17T05:19:33.201 INFO:teuthology.orchestra.run.smithi167.stdout:Installing: 2024-09-17T05:19:33.201 INFO:teuthology.orchestra.run.smithi167.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-17T05:19:33.201 INFO:teuthology.orchestra.run.smithi167.stdout: ceph x86_64 2:19.3.0-4963.g820f760e.el9 ceph 6.6 k 2024-09-17T05:19:33.201 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-base x86_64 2:19.3.0-4963.g820f760e.el9 ceph 5.5 M 2024-09-17T05:19:33.201 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-fuse x86_64 2:19.3.0-4963.g820f760e.el9 ceph 899 k 2024-09-17T05:19:33.201 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4963.g820f760e.el9 ceph 145 k 2024-09-17T05:19:33.201 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr x86_64 2:19.3.0-4963.g820f760e.el9 ceph 1.5 M 2024-09-17T05:19:33.202 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4963.g820f760e.el9 ceph-noarch 154 k 2024-09-17T05:19:33.202 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4963.g820f760e.el9 ceph-noarch 14 M 2024-09-17T05:19:33.202 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4963.g820f760e.el9 ceph-noarch 7.4 M 2024-09-17T05:19:33.202 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-rook noarch 2:19.3.0-4963.g820f760e.el9 ceph-noarch 49 k 2024-09-17T05:19:33.202 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-radosgw x86_64 2:19.3.0-4963.g820f760e.el9 ceph 11 M 2024-09-17T05:19:33.202 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-test x86_64 2:19.3.0-4963.g820f760e.el9 ceph 46 M 2024-09-17T05:19:33.202 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-volume noarch 2:19.3.0-4963.g820f760e.el9 ceph-noarch 285 k 2024-09-17T05:19:33.202 INFO:teuthology.orchestra.run.smithi167.stdout: cephadm noarch 2:19.3.0-4963.g820f760e.el9 ceph-noarch 784 k 2024-09-17T05:19:33.202 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-mirror x86_64 2:19.3.0-4963.g820f760e.el9 ceph 225 k 2024-09-17T05:19:33.202 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-shell x86_64 2:19.3.0-4963.g820f760e.el9 ceph 27 k 2024-09-17T05:19:33.202 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-top noarch 2:19.3.0-4963.g820f760e.el9 ceph-noarch 18 k 2024-09-17T05:19:33.202 INFO:teuthology.orchestra.run.smithi167.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-17T05:19:33.203 INFO:teuthology.orchestra.run.smithi167.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-17T05:19:33.203 INFO:teuthology.orchestra.run.smithi167.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-17T05:19:33.203 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs-devel x86_64 2:19.3.0-4963.g820f760e.el9 ceph 32 k 2024-09-17T05:19:33.203 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs2 x86_64 2:19.3.0-4963.g820f760e.el9 ceph 755 k 2024-09-17T05:19:33.203 INFO:teuthology.orchestra.run.smithi167.stdout: librados-devel x86_64 2:19.3.0-4963.g820f760e.el9 ceph 126 k 2024-09-17T05:19:33.203 INFO:teuthology.orchestra.run.smithi167.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-17T05:19:33.203 INFO:teuthology.orchestra.run.smithi167.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-17T05:19:33.203 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-17T05:19:33.203 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-17T05:19:33.203 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-17T05:19:33.203 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-17T05:19:33.203 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cephfs x86_64 2:19.3.0-4963.g820f760e.el9 ceph 161 k 2024-09-17T05:19:33.204 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rados x86_64 2:19.3.0-4963.g820f760e.el9 ceph 320 k 2024-09-17T05:19:33.204 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rbd x86_64 2:19.3.0-4963.g820f760e.el9 ceph 305 k 2024-09-17T05:19:33.204 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rgw x86_64 2:19.3.0-4963.g820f760e.el9 ceph 99 k 2024-09-17T05:19:33.204 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-fuse x86_64 2:19.3.0-4963.g820f760e.el9 ceph 85 k 2024-09-17T05:19:33.204 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-mirror x86_64 2:19.3.0-4963.g820f760e.el9 ceph 3.2 M 2024-09-17T05:19:33.204 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-nbd x86_64 2:19.3.0-4963.g820f760e.el9 ceph 170 k 2024-09-17T05:19:33.204 INFO:teuthology.orchestra.run.smithi167.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-17T05:19:33.204 INFO:teuthology.orchestra.run.smithi167.stdout:Upgrading: 2024-09-17T05:19:33.204 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-17T05:19:33.204 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-17T05:19:33.204 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-17T05:19:33.204 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-17T05:19:33.205 INFO:teuthology.orchestra.run.smithi167.stdout: librados2 x86_64 2:19.3.0-4963.g820f760e.el9 ceph 3.5 M 2024-09-17T05:19:33.205 INFO:teuthology.orchestra.run.smithi167.stdout: librbd1 x86_64 2:19.3.0-4963.g820f760e.el9 ceph 3.3 M 2024-09-17T05:19:33.205 INFO:teuthology.orchestra.run.smithi167.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-17T05:19:33.205 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-17T05:19:33.205 INFO:teuthology.orchestra.run.smithi167.stdout:Installing dependencies: 2024-09-17T05:19:33.205 INFO:teuthology.orchestra.run.smithi167.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-17T05:19:33.205 INFO:teuthology.orchestra.run.smithi167.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-17T05:19:33.205 INFO:teuthology.orchestra.run.smithi167.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-17T05:19:33.205 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-common x86_64 2:19.3.0-4963.g820f760e.el9 ceph 22 M 2024-09-17T05:19:33.205 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4963.g820f760e.el9 ceph-noarch 34 k 2024-09-17T05:19:33.205 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mds x86_64 2:19.3.0-4963.g820f760e.el9 ceph 2.4 M 2024-09-17T05:19:33.206 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4963.g820f760e.el9 ceph-noarch 291 k 2024-09-17T05:19:33.206 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mon x86_64 2:19.3.0-4963.g820f760e.el9 ceph 4.8 M 2024-09-17T05:19:33.206 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-osd x86_64 2:19.3.0-4963.g820f760e.el9 ceph 17 M 2024-09-17T05:19:33.206 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4963.g820f760e.el9 ceph-noarch 16 k 2024-09-17T05:19:33.206 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-selinux x86_64 2:19.3.0-4963.g820f760e.el9 ceph 25 k 2024-09-17T05:19:33.206 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-17T05:19:33.206 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-17T05:19:33.206 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-17T05:19:33.206 INFO:teuthology.orchestra.run.smithi167.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-17T05:19:33.206 INFO:teuthology.orchestra.run.smithi167.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-17T05:19:33.206 INFO:teuthology.orchestra.run.smithi167.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-17T05:19:33.207 INFO:teuthology.orchestra.run.smithi167.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-17T05:19:33.207 INFO:teuthology.orchestra.run.smithi167.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-17T05:19:33.207 INFO:teuthology.orchestra.run.smithi167.stdout: libcephsqlite x86_64 2:19.3.0-4963.g820f760e.el9 ceph 161 k 2024-09-17T05:19:33.207 INFO:teuthology.orchestra.run.smithi167.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-17T05:19:33.207 INFO:teuthology.orchestra.run.smithi167.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-17T05:19:33.207 INFO:teuthology.orchestra.run.smithi167.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-17T05:19:33.207 INFO:teuthology.orchestra.run.smithi167.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-17T05:19:33.207 INFO:teuthology.orchestra.run.smithi167.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-17T05:19:33.207 INFO:teuthology.orchestra.run.smithi167.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-17T05:19:33.207 INFO:teuthology.orchestra.run.smithi167.stdout: libradosstriper1 x86_64 2:19.3.0-4963.g820f760e.el9 ceph 508 k 2024-09-17T05:19:33.207 INFO:teuthology.orchestra.run.smithi167.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-17T05:19:33.207 INFO:teuthology.orchestra.run.smithi167.stdout: librgw2 x86_64 2:19.3.0-4963.g820f760e.el9 ceph 5.5 M 2024-09-17T05:19:33.208 INFO:teuthology.orchestra.run.smithi167.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-17T05:19:33.208 INFO:teuthology.orchestra.run.smithi167.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-17T05:19:33.208 INFO:teuthology.orchestra.run.smithi167.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-17T05:19:33.208 INFO:teuthology.orchestra.run.smithi167.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-17T05:19:33.208 INFO:teuthology.orchestra.run.smithi167.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-17T05:19:33.208 INFO:teuthology.orchestra.run.smithi167.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-17T05:19:33.208 INFO:teuthology.orchestra.run.smithi167.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-17T05:19:33.208 INFO:teuthology.orchestra.run.smithi167.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-17T05:19:33.208 INFO:teuthology.orchestra.run.smithi167.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-17T05:19:33.208 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-17T05:19:33.208 INFO:teuthology.orchestra.run.smithi167.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-17T05:19:33.208 INFO:teuthology.orchestra.run.smithi167.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-17T05:19:33.209 INFO:teuthology.orchestra.run.smithi167.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-17T05:19:33.209 INFO:teuthology.orchestra.run.smithi167.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-17T05:19:33.209 INFO:teuthology.orchestra.run.smithi167.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-17T05:19:33.209 INFO:teuthology.orchestra.run.smithi167.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-17T05:19:33.209 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-17T05:19:33.209 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-argparse x86_64 2:19.3.0-4963.g820f760e.el9 ceph 45 k 2024-09-17T05:19:33.209 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-common x86_64 2:19.3.0-4963.g820f760e.el9 ceph 148 k 2024-09-17T05:19:33.209 INFO:teuthology.orchestra.run.smithi167.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-17T05:19:33.209 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-17T05:19:33.209 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-17T05:19:33.209 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-17T05:19:33.209 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-17T05:19:33.210 INFO:teuthology.orchestra.run.smithi167.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-17T05:19:33.210 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-17T05:19:33.210 INFO:teuthology.orchestra.run.smithi167.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-17T05:19:33.210 INFO:teuthology.orchestra.run.smithi167.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-17T05:19:33.210 INFO:teuthology.orchestra.run.smithi167.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-17T05:19:33.210 INFO:teuthology.orchestra.run.smithi167.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-17T05:19:33.210 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-17T05:19:33.210 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-17T05:19:33.210 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-17T05:19:33.210 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-17T05:19:33.210 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-17T05:19:33.210 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-17T05:19:33.210 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-17T05:19:33.211 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-17T05:19:33.211 INFO:teuthology.orchestra.run.smithi167.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-17T05:19:33.211 INFO:teuthology.orchestra.run.smithi167.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-17T05:19:33.211 INFO:teuthology.orchestra.run.smithi167.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-17T05:19:33.211 INFO:teuthology.orchestra.run.smithi167.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-17T05:19:33.211 INFO:teuthology.orchestra.run.smithi167.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-17T05:19:33.211 INFO:teuthology.orchestra.run.smithi167.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-17T05:19:33.211 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-17T05:19:33.211 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-17T05:19:33.211 INFO:teuthology.orchestra.run.smithi167.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-17T05:19:33.211 INFO:teuthology.orchestra.run.smithi167.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-17T05:19:33.211 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-17T05:19:33.212 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-17T05:19:33.212 INFO:teuthology.orchestra.run.smithi167.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-17T05:19:33.212 INFO:teuthology.orchestra.run.smithi167.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-17T05:19:33.212 INFO:teuthology.orchestra.run.smithi167.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-17T05:19:33.212 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-17T05:19:33.212 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-17T05:19:33.212 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-17T05:19:33.212 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-17T05:19:33.212 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-17T05:19:33.212 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-17T05:19:33.212 INFO:teuthology.orchestra.run.smithi167.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-17T05:19:33.212 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-17T05:19:33.213 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-17T05:19:33.213 INFO:teuthology.orchestra.run.smithi167.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-17T05:19:33.213 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-17T05:19:33.213 INFO:teuthology.orchestra.run.smithi167.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-17T05:19:33.213 INFO:teuthology.orchestra.run.smithi167.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-17T05:19:33.213 INFO:teuthology.orchestra.run.smithi167.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-17T05:19:33.213 INFO:teuthology.orchestra.run.smithi167.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-17T05:19:33.213 INFO:teuthology.orchestra.run.smithi167.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-17T05:19:33.213 INFO:teuthology.orchestra.run.smithi167.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-17T05:19:33.213 INFO:teuthology.orchestra.run.smithi167.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-17T05:19:33.213 INFO:teuthology.orchestra.run.smithi167.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-17T05:19:33.213 INFO:teuthology.orchestra.run.smithi167.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-17T05:19:33.214 INFO:teuthology.orchestra.run.smithi167.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-17T05:19:33.214 INFO:teuthology.orchestra.run.smithi167.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-17T05:19:33.214 INFO:teuthology.orchestra.run.smithi167.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-17T05:19:33.214 INFO:teuthology.orchestra.run.smithi167.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-17T05:19:33.214 INFO:teuthology.orchestra.run.smithi167.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-17T05:19:33.214 INFO:teuthology.orchestra.run.smithi167.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-17T05:19:33.214 INFO:teuthology.orchestra.run.smithi167.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-17T05:19:33.214 INFO:teuthology.orchestra.run.smithi167.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-17T05:19:33.214 INFO:teuthology.orchestra.run.smithi167.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-17T05:19:33.214 INFO:teuthology.orchestra.run.smithi167.stdout:Installing weak dependencies: 2024-09-17T05:19:33.214 INFO:teuthology.orchestra.run.smithi167.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-17T05:19:33.214 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T05:19:33.214 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction Summary 2024-09-17T05:19:33.215 INFO:teuthology.orchestra.run.smithi167.stdout:======================================================================================= 2024-09-17T05:19:33.215 INFO:teuthology.orchestra.run.smithi167.stdout:Install 149 Packages 2024-09-17T05:19:33.215 INFO:teuthology.orchestra.run.smithi167.stdout:Upgrade 8 Packages 2024-09-17T05:19:33.215 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T05:19:33.215 INFO:teuthology.orchestra.run.smithi167.stdout:Total download size: 235 M 2024-09-17T05:19:33.215 INFO:teuthology.orchestra.run.smithi167.stdout:Downloading Packages: 2024-09-17T05:19:33.705 INFO:teuthology.orchestra.run.smithi098.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-17T05:19:33.705 INFO:teuthology.orchestra.run.smithi098.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-17T05:19:33.719 INFO:teuthology.orchestra.run.smithi098.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-17T05:19:33.720 INFO:teuthology.orchestra.run.smithi098.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-17T05:19:33.721 INFO:teuthology.orchestra.run.smithi098.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-17T05:19:33.722 INFO:teuthology.orchestra.run.smithi098.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-17T05:19:33.724 INFO:teuthology.orchestra.run.smithi098.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-17T05:19:33.727 INFO:teuthology.orchestra.run.smithi098.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-17T05:19:33.728 INFO:teuthology.orchestra.run.smithi098.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-17T05:19:33.793 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-17T05:19:33.813 INFO:teuthology.orchestra.run.smithi098.stdout:======================================================================================= 2024-09-17T05:19:33.813 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2024-09-17T05:19:33.813 INFO:teuthology.orchestra.run.smithi098.stdout:======================================================================================= 2024-09-17T05:19:33.813 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-17T05:19:33.813 INFO:teuthology.orchestra.run.smithi098.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-17T05:19:33.814 INFO:teuthology.orchestra.run.smithi098.stdout: ceph x86_64 2:19.3.0-4963.g820f760e.el9 ceph 6.6 k 2024-09-17T05:19:33.814 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-base x86_64 2:19.3.0-4963.g820f760e.el9 ceph 5.5 M 2024-09-17T05:19:33.814 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-fuse x86_64 2:19.3.0-4963.g820f760e.el9 ceph 899 k 2024-09-17T05:19:33.814 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4963.g820f760e.el9 ceph 145 k 2024-09-17T05:19:33.814 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr x86_64 2:19.3.0-4963.g820f760e.el9 ceph 1.5 M 2024-09-17T05:19:33.814 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4963.g820f760e.el9 ceph-noarch 154 k 2024-09-17T05:19:33.814 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4963.g820f760e.el9 ceph-noarch 14 M 2024-09-17T05:19:33.814 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4963.g820f760e.el9 ceph-noarch 7.4 M 2024-09-17T05:19:33.814 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-rook noarch 2:19.3.0-4963.g820f760e.el9 ceph-noarch 49 k 2024-09-17T05:19:33.814 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-radosgw x86_64 2:19.3.0-4963.g820f760e.el9 ceph 11 M 2024-09-17T05:19:33.814 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-test x86_64 2:19.3.0-4963.g820f760e.el9 ceph 46 M 2024-09-17T05:19:33.815 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-volume noarch 2:19.3.0-4963.g820f760e.el9 ceph-noarch 285 k 2024-09-17T05:19:33.815 INFO:teuthology.orchestra.run.smithi098.stdout: cephadm noarch 2:19.3.0-4963.g820f760e.el9 ceph-noarch 784 k 2024-09-17T05:19:33.815 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-mirror x86_64 2:19.3.0-4963.g820f760e.el9 ceph 225 k 2024-09-17T05:19:33.815 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-shell x86_64 2:19.3.0-4963.g820f760e.el9 ceph 27 k 2024-09-17T05:19:33.815 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-top noarch 2:19.3.0-4963.g820f760e.el9 ceph-noarch 18 k 2024-09-17T05:19:33.815 INFO:teuthology.orchestra.run.smithi098.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-17T05:19:33.815 INFO:teuthology.orchestra.run.smithi098.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-17T05:19:33.815 INFO:teuthology.orchestra.run.smithi098.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-17T05:19:33.815 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs-devel x86_64 2:19.3.0-4963.g820f760e.el9 ceph 32 k 2024-09-17T05:19:33.815 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs2 x86_64 2:19.3.0-4963.g820f760e.el9 ceph 755 k 2024-09-17T05:19:33.815 INFO:teuthology.orchestra.run.smithi098.stdout: librados-devel x86_64 2:19.3.0-4963.g820f760e.el9 ceph 126 k 2024-09-17T05:19:33.815 INFO:teuthology.orchestra.run.smithi098.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-17T05:19:33.816 INFO:teuthology.orchestra.run.smithi098.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-17T05:19:33.816 INFO:teuthology.orchestra.run.smithi098.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-17T05:19:33.816 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-17T05:19:33.816 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-17T05:19:33.816 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-17T05:19:33.816 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cephfs x86_64 2:19.3.0-4963.g820f760e.el9 ceph 161 k 2024-09-17T05:19:33.816 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rados x86_64 2:19.3.0-4963.g820f760e.el9 ceph 320 k 2024-09-17T05:19:33.816 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rbd x86_64 2:19.3.0-4963.g820f760e.el9 ceph 305 k 2024-09-17T05:19:33.816 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rgw x86_64 2:19.3.0-4963.g820f760e.el9 ceph 99 k 2024-09-17T05:19:33.816 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-fuse x86_64 2:19.3.0-4963.g820f760e.el9 ceph 85 k 2024-09-17T05:19:33.816 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-mirror x86_64 2:19.3.0-4963.g820f760e.el9 ceph 3.2 M 2024-09-17T05:19:33.816 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-nbd x86_64 2:19.3.0-4963.g820f760e.el9 ceph 170 k 2024-09-17T05:19:33.817 INFO:teuthology.orchestra.run.smithi098.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-17T05:19:33.817 INFO:teuthology.orchestra.run.smithi098.stdout:Upgrading: 2024-09-17T05:19:33.817 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-17T05:19:33.817 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-17T05:19:33.817 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-17T05:19:33.817 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-17T05:19:33.817 INFO:teuthology.orchestra.run.smithi098.stdout: librados2 x86_64 2:19.3.0-4963.g820f760e.el9 ceph 3.5 M 2024-09-17T05:19:33.817 INFO:teuthology.orchestra.run.smithi098.stdout: librbd1 x86_64 2:19.3.0-4963.g820f760e.el9 ceph 3.3 M 2024-09-17T05:19:33.817 INFO:teuthology.orchestra.run.smithi098.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-17T05:19:33.817 INFO:teuthology.orchestra.run.smithi098.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-17T05:19:33.817 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2024-09-17T05:19:33.817 INFO:teuthology.orchestra.run.smithi098.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-17T05:19:33.817 INFO:teuthology.orchestra.run.smithi098.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-17T05:19:33.818 INFO:teuthology.orchestra.run.smithi098.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-17T05:19:33.818 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-common x86_64 2:19.3.0-4963.g820f760e.el9 ceph 22 M 2024-09-17T05:19:33.818 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4963.g820f760e.el9 ceph-noarch 34 k 2024-09-17T05:19:33.818 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mds x86_64 2:19.3.0-4963.g820f760e.el9 ceph 2.4 M 2024-09-17T05:19:33.818 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4963.g820f760e.el9 ceph-noarch 291 k 2024-09-17T05:19:33.818 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mon x86_64 2:19.3.0-4963.g820f760e.el9 ceph 4.8 M 2024-09-17T05:19:33.818 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-osd x86_64 2:19.3.0-4963.g820f760e.el9 ceph 17 M 2024-09-17T05:19:33.818 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4963.g820f760e.el9 ceph-noarch 16 k 2024-09-17T05:19:33.818 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-selinux x86_64 2:19.3.0-4963.g820f760e.el9 ceph 25 k 2024-09-17T05:19:33.818 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-17T05:19:33.818 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-17T05:19:33.818 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-17T05:19:33.819 INFO:teuthology.orchestra.run.smithi098.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-17T05:19:33.819 INFO:teuthology.orchestra.run.smithi098.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-17T05:19:33.819 INFO:teuthology.orchestra.run.smithi098.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-17T05:19:33.819 INFO:teuthology.orchestra.run.smithi098.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-17T05:19:33.819 INFO:teuthology.orchestra.run.smithi098.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-17T05:19:33.819 INFO:teuthology.orchestra.run.smithi098.stdout: libcephsqlite x86_64 2:19.3.0-4963.g820f760e.el9 ceph 161 k 2024-09-17T05:19:33.819 INFO:teuthology.orchestra.run.smithi098.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-17T05:19:33.819 INFO:teuthology.orchestra.run.smithi098.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-17T05:19:33.819 INFO:teuthology.orchestra.run.smithi098.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-17T05:19:33.819 INFO:teuthology.orchestra.run.smithi098.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-17T05:19:33.819 INFO:teuthology.orchestra.run.smithi098.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-17T05:19:33.819 INFO:teuthology.orchestra.run.smithi098.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-17T05:19:33.819 INFO:teuthology.orchestra.run.smithi098.stdout: libradosstriper1 x86_64 2:19.3.0-4963.g820f760e.el9 ceph 508 k 2024-09-17T05:19:33.820 INFO:teuthology.orchestra.run.smithi098.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-17T05:19:33.820 INFO:teuthology.orchestra.run.smithi098.stdout: librgw2 x86_64 2:19.3.0-4963.g820f760e.el9 ceph 5.5 M 2024-09-17T05:19:33.820 INFO:teuthology.orchestra.run.smithi098.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-17T05:19:33.820 INFO:teuthology.orchestra.run.smithi098.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-17T05:19:33.820 INFO:teuthology.orchestra.run.smithi098.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-17T05:19:33.820 INFO:teuthology.orchestra.run.smithi098.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-17T05:19:33.820 INFO:teuthology.orchestra.run.smithi098.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-17T05:19:33.820 INFO:teuthology.orchestra.run.smithi098.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-17T05:19:33.820 INFO:teuthology.orchestra.run.smithi098.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-17T05:19:33.820 INFO:teuthology.orchestra.run.smithi098.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-17T05:19:33.820 INFO:teuthology.orchestra.run.smithi098.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-17T05:19:33.820 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-17T05:19:33.820 INFO:teuthology.orchestra.run.smithi098.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-17T05:19:33.821 INFO:teuthology.orchestra.run.smithi098.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-17T05:19:33.821 INFO:teuthology.orchestra.run.smithi098.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-17T05:19:33.821 INFO:teuthology.orchestra.run.smithi098.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-17T05:19:33.821 INFO:teuthology.orchestra.run.smithi098.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-17T05:19:33.821 INFO:teuthology.orchestra.run.smithi098.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-17T05:19:33.821 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-17T05:19:33.821 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-argparse x86_64 2:19.3.0-4963.g820f760e.el9 ceph 45 k 2024-09-17T05:19:33.821 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-common x86_64 2:19.3.0-4963.g820f760e.el9 ceph 148 k 2024-09-17T05:19:33.821 INFO:teuthology.orchestra.run.smithi098.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-17T05:19:33.821 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-17T05:19:33.821 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-17T05:19:33.821 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-17T05:19:33.821 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-17T05:19:33.822 INFO:teuthology.orchestra.run.smithi098.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-17T05:19:33.822 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-17T05:19:33.822 INFO:teuthology.orchestra.run.smithi098.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-17T05:19:33.822 INFO:teuthology.orchestra.run.smithi098.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-17T05:19:33.822 INFO:teuthology.orchestra.run.smithi098.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-17T05:19:33.822 INFO:teuthology.orchestra.run.smithi098.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-17T05:19:33.822 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-17T05:19:33.822 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-17T05:19:33.822 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-17T05:19:33.822 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-17T05:19:33.822 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-17T05:19:33.822 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-17T05:19:33.823 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-17T05:19:33.823 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-17T05:19:33.823 INFO:teuthology.orchestra.run.smithi098.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-17T05:19:33.823 INFO:teuthology.orchestra.run.smithi098.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-17T05:19:33.823 INFO:teuthology.orchestra.run.smithi098.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-17T05:19:33.823 INFO:teuthology.orchestra.run.smithi098.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-17T05:19:33.823 INFO:teuthology.orchestra.run.smithi098.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-17T05:19:33.823 INFO:teuthology.orchestra.run.smithi098.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-17T05:19:33.823 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-17T05:19:33.823 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-17T05:19:33.823 INFO:teuthology.orchestra.run.smithi098.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-17T05:19:33.823 INFO:teuthology.orchestra.run.smithi098.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-17T05:19:33.823 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-17T05:19:33.824 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-17T05:19:33.824 INFO:teuthology.orchestra.run.smithi098.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-17T05:19:33.824 INFO:teuthology.orchestra.run.smithi098.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-17T05:19:33.824 INFO:teuthology.orchestra.run.smithi098.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-17T05:19:33.824 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-17T05:19:33.824 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-17T05:19:33.824 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-17T05:19:33.824 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-17T05:19:33.824 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-17T05:19:33.824 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-17T05:19:33.824 INFO:teuthology.orchestra.run.smithi098.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-17T05:19:33.824 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-17T05:19:33.825 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-17T05:19:33.825 INFO:teuthology.orchestra.run.smithi098.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-17T05:19:33.825 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-17T05:19:33.825 INFO:teuthology.orchestra.run.smithi098.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-17T05:19:33.825 INFO:teuthology.orchestra.run.smithi098.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-17T05:19:33.825 INFO:teuthology.orchestra.run.smithi098.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-17T05:19:33.825 INFO:teuthology.orchestra.run.smithi098.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-17T05:19:33.825 INFO:teuthology.orchestra.run.smithi098.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-17T05:19:33.825 INFO:teuthology.orchestra.run.smithi098.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-17T05:19:33.825 INFO:teuthology.orchestra.run.smithi098.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-17T05:19:33.825 INFO:teuthology.orchestra.run.smithi098.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-17T05:19:33.825 INFO:teuthology.orchestra.run.smithi098.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-17T05:19:33.825 INFO:teuthology.orchestra.run.smithi098.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-17T05:19:33.826 INFO:teuthology.orchestra.run.smithi098.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-17T05:19:33.826 INFO:teuthology.orchestra.run.smithi098.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-17T05:19:33.826 INFO:teuthology.orchestra.run.smithi098.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-17T05:19:33.826 INFO:teuthology.orchestra.run.smithi098.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-17T05:19:33.826 INFO:teuthology.orchestra.run.smithi098.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-17T05:19:33.826 INFO:teuthology.orchestra.run.smithi098.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-17T05:19:33.826 INFO:teuthology.orchestra.run.smithi098.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-17T05:19:33.826 INFO:teuthology.orchestra.run.smithi098.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-17T05:19:33.826 INFO:teuthology.orchestra.run.smithi098.stdout:Installing weak dependencies: 2024-09-17T05:19:33.826 INFO:teuthology.orchestra.run.smithi098.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-17T05:19:33.826 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:19:33.826 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-17T05:19:33.826 INFO:teuthology.orchestra.run.smithi098.stdout:======================================================================================= 2024-09-17T05:19:33.827 INFO:teuthology.orchestra.run.smithi098.stdout:Install 149 Packages 2024-09-17T05:19:33.827 INFO:teuthology.orchestra.run.smithi098.stdout:Upgrade 8 Packages 2024-09-17T05:19:33.827 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:19:33.827 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 235 M 2024-09-17T05:19:33.827 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-17T05:19:33.844 INFO:teuthology.orchestra.run.smithi167.stdout:(1/157): ceph-19.3.0-4963.g820f760e.el9.x86_64. 48 kB/s | 6.6 kB 00:00 2024-09-17T05:19:34.104 INFO:teuthology.orchestra.run.smithi167.stdout:(2/157): ceph-fuse-19.3.0-4963.g820f760e.el9.x8 3.4 MB/s | 899 kB 00:00 2024-09-17T05:19:34.186 INFO:teuthology.orchestra.run.smithi167.stdout:(3/157): ceph-base-19.3.0-4963.g820f760e.el9.x8 12 MB/s | 5.5 MB 00:00 2024-09-17T05:19:34.211 INFO:teuthology.orchestra.run.smithi167.stdout:(4/157): ceph-immutable-object-cache-19.3.0-496 1.3 MB/s | 145 kB 00:00 2024-09-17T05:19:34.337 INFO:teuthology.orchestra.run.smithi167.stdout:(5/157): ceph-mds-19.3.0-4963.g820f760e.el9.x86 16 MB/s | 2.4 MB 00:00 2024-09-17T05:19:34.471 INFO:teuthology.orchestra.run.smithi167.stdout:(6/157): ceph-mgr-19.3.0-4963.g820f760e.el9.x86 5.9 MB/s | 1.5 MB 00:00 2024-09-17T05:19:34.604 INFO:teuthology.orchestra.run.smithi167.stdout:(7/157): ceph-mon-19.3.0-4963.g820f760e.el9.x86 18 MB/s | 4.8 MB 00:00 2024-09-17T05:19:34.627 INFO:teuthology.orchestra.run.smithi098.stdout:(1/157): ceph-19.3.0-4963.g820f760e.el9.x86_64. 30 kB/s | 6.6 kB 00:00 2024-09-17T05:19:34.838 INFO:teuthology.orchestra.run.smithi167.stdout:(8/157): ceph-common-19.3.0-4963.g820f760e.el9. 19 MB/s | 22 MB 00:01 2024-09-17T05:19:34.897 INFO:teuthology.orchestra.run.smithi167.stdout:(9/157): ceph-selinux-19.3.0-4963.g820f760e.el9 432 kB/s | 25 kB 00:00 2024-09-17T05:19:35.160 INFO:teuthology.orchestra.run.smithi098.stdout:(2/157): ceph-fuse-19.3.0-4963.g820f760e.el9.x8 1.6 MB/s | 899 kB 00:00 2024-09-17T05:19:35.227 INFO:teuthology.orchestra.run.smithi098.stdout:(3/157): ceph-immutable-object-cache-19.3.0-496 2.1 MB/s | 145 kB 00:00 2024-09-17T05:19:35.230 INFO:teuthology.orchestra.run.smithi167.stdout:(10/157): ceph-radosgw-19.3.0-4963.g820f760e.el 17 MB/s | 11 MB 00:00 2024-09-17T05:19:35.289 INFO:teuthology.orchestra.run.smithi167.stdout:(11/157): cephfs-mirror-19.3.0-4963.g820f760e.e 3.8 MB/s | 225 kB 00:00 2024-09-17T05:19:35.339 INFO:teuthology.orchestra.run.smithi167.stdout:(12/157): cephfs-shell-19.3.0-4963.g820f760e.el 542 kB/s | 27 kB 00:00 2024-09-17T05:19:35.398 INFO:teuthology.orchestra.run.smithi167.stdout:(13/157): libcephfs-devel-19.3.0-4963.g820f760e 546 kB/s | 32 kB 00:00 2024-09-17T05:19:35.548 INFO:teuthology.orchestra.run.smithi167.stdout:(14/157): libcephfs2-19.3.0-4963.g820f760e.el9. 4.9 MB/s | 755 kB 00:00 2024-09-17T05:19:35.623 INFO:teuthology.orchestra.run.smithi167.stdout:(15/157): libcephsqlite-19.3.0-4963.g820f760e.e 2.1 MB/s | 161 kB 00:00 2024-09-17T05:19:35.699 INFO:teuthology.orchestra.run.smithi167.stdout:(16/157): librados-devel-19.3.0-4963.g820f760e. 1.6 MB/s | 126 kB 00:00 2024-09-17T05:19:35.824 INFO:teuthology.orchestra.run.smithi167.stdout:(17/157): libradosstriper1-19.3.0-4963.g820f760 4.0 MB/s | 508 kB 00:00 2024-09-17T05:19:36.016 INFO:teuthology.orchestra.run.smithi167.stdout:(18/157): ceph-osd-19.3.0-4963.g820f760e.el9.x8 11 MB/s | 17 MB 00:01 2024-09-17T05:19:36.058 INFO:teuthology.orchestra.run.smithi167.stdout:(19/157): python3-ceph-argparse-19.3.0-4963.g82 1.1 MB/s | 45 kB 00:00 2024-09-17T05:19:36.125 INFO:teuthology.orchestra.run.smithi167.stdout:(20/157): python3-ceph-common-19.3.0-4963.g820f 2.2 MB/s | 148 kB 00:00 2024-09-17T05:19:36.161 INFO:teuthology.orchestra.run.smithi098.stdout:(4/157): ceph-mds-19.3.0-4963.g820f760e.el9.x86 2.5 MB/s | 2.4 MB 00:00 2024-09-17T05:19:36.192 INFO:teuthology.orchestra.run.smithi167.stdout:(21/157): python3-cephfs-19.3.0-4963.g820f760e. 2.4 MB/s | 161 kB 00:00 2024-09-17T05:19:36.236 INFO:teuthology.orchestra.run.smithi098.stdout:(5/157): ceph-base-19.3.0-4963.g820f760e.el9.x8 3.0 MB/s | 5.5 MB 00:01 2024-09-17T05:19:36.259 INFO:teuthology.orchestra.run.smithi167.stdout:(22/157): python3-rados-19.3.0-4963.g820f760e.e 4.7 MB/s | 320 kB 00:00 2024-09-17T05:19:36.334 INFO:teuthology.orchestra.run.smithi167.stdout:(23/157): python3-rbd-19.3.0-4963.g820f760e.el9 4.0 MB/s | 305 kB 00:00 2024-09-17T05:19:36.401 INFO:teuthology.orchestra.run.smithi167.stdout:(24/157): python3-rgw-19.3.0-4963.g820f760e.el9 1.5 MB/s | 99 kB 00:00 2024-09-17T05:19:36.485 INFO:teuthology.orchestra.run.smithi167.stdout:(25/157): librgw2-19.3.0-4963.g820f760e.el9.x86 8.3 MB/s | 5.5 MB 00:00 2024-09-17T05:19:36.510 INFO:teuthology.orchestra.run.smithi167.stdout:(26/157): rbd-fuse-19.3.0-4963.g820f760e.el9.x8 784 kB/s | 85 kB 00:00 2024-09-17T05:19:36.561 INFO:teuthology.orchestra.run.smithi167.stdout:(27/157): rbd-nbd-19.3.0-4963.g820f760e.el9.x86 3.3 MB/s | 170 kB 00:00 2024-09-17T05:19:36.712 INFO:teuthology.orchestra.run.smithi098.stdout:(6/157): ceph-mgr-19.3.0-4963.g820f760e.el9.x86 2.8 MB/s | 1.5 MB 00:00 2024-09-17T05:19:36.994 INFO:teuthology.orchestra.run.smithi167.stdout:(28/157): ceph-test-19.3.0-4963.g820f760e.el9.x 22 MB/s | 46 MB 00:02 2024-09-17T05:19:37.019 INFO:teuthology.orchestra.run.smithi167.stdout:(29/157): ceph-grafana-dashboards-19.3.0-4963.g 75 kB/s | 34 kB 00:00 2024-09-17T05:19:37.045 INFO:teuthology.orchestra.run.smithi167.stdout:(30/157): ceph-mgr-cephadm-19.3.0-4963.g820f760 3.0 MB/s | 154 kB 00:00 2024-09-17T05:19:37.112 INFO:teuthology.orchestra.run.smithi167.stdout:(31/157): rbd-mirror-19.3.0-4963.g820f760e.el9. 5.1 MB/s | 3.2 MB 00:00 2024-09-17T05:19:37.212 INFO:teuthology.orchestra.run.smithi098.stdout:(7/157): ceph-mon-19.3.0-4963.g820f760e.el9.x86 4.9 MB/s | 4.8 MB 00:00 2024-09-17T05:19:37.212 INFO:teuthology.orchestra.run.smithi167.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4963.g82 2.9 MB/s | 291 kB 00:00 2024-09-17T05:19:37.287 INFO:teuthology.orchestra.run.smithi167.stdout:(33/157): ceph-mgr-rook-19.3.0-4963.g820f760e.e 659 kB/s | 49 kB 00:00 2024-09-17T05:19:37.354 INFO:teuthology.orchestra.run.smithi167.stdout:(34/157): ceph-prometheus-alerts-19.3.0-4963.g8 247 kB/s | 16 kB 00:00 2024-09-17T05:19:37.455 INFO:teuthology.orchestra.run.smithi167.stdout:(35/157): ceph-mgr-diskprediction-local-19.3.0- 18 MB/s | 7.4 MB 00:00 2024-09-17T05:19:37.488 INFO:teuthology.orchestra.run.smithi167.stdout:(36/157): ceph-volume-19.3.0-4963.g820f760e.el9 2.1 MB/s | 285 kB 00:00 2024-09-17T05:19:37.522 INFO:teuthology.orchestra.run.smithi167.stdout:(37/157): cephadm-19.3.0-4963.g820f760e.el9.noa 12 MB/s | 784 kB 00:00 2024-09-17T05:19:37.556 INFO:teuthology.orchestra.run.smithi167.stdout:(38/157): cephfs-top-19.3.0-4963.g820f760e.el9. 272 kB/s | 18 kB 00:00 2024-09-17T05:19:37.664 INFO:teuthology.orchestra.run.smithi167.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 563 kB/s | 80 kB 00:00 2024-09-17T05:19:37.748 INFO:teuthology.orchestra.run.smithi167.stdout:(40/157): libquadmath-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-09-17T05:19:37.773 INFO:teuthology.orchestra.run.smithi167.stdout:(41/157): libgfortran-11.5.0-2.el9.x86_64.rpm 3.6 MB/s | 801 kB 00:00 2024-09-17T05:19:37.807 INFO:teuthology.orchestra.run.smithi167.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.2 MB/s | 253 kB 00:00 2024-09-17T05:19:37.960 INFO:teuthology.orchestra.run.smithi167.stdout:(43/157): ceph-mgr-dashboard-19.3.0-4963.g820f7 15 MB/s | 14 MB 00:00 2024-09-17T05:19:37.991 INFO:teuthology.orchestra.run.smithi167.stdout:(44/157): python3-cryptography-36.0.1-4.el9.x86 5.6 MB/s | 1.2 MB 00:00 2024-09-17T05:19:38.016 INFO:teuthology.orchestra.run.smithi167.stdout:(45/157): python3-ply-3.11-14.el9.noarch.rpm 509 kB/s | 106 kB 00:00 2024-09-17T05:19:38.042 INFO:teuthology.orchestra.run.smithi167.stdout:(46/157): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2024-09-17T05:19:38.067 INFO:teuthology.orchestra.run.smithi167.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-17T05:19:38.109 INFO:teuthology.orchestra.run.smithi167.stdout:(48/157): automake-1.16.2-8.el9.noarch.rpm 10 MB/s | 689 kB 00:00 2024-09-17T05:19:38.134 INFO:teuthology.orchestra.run.smithi167.stdout:(49/157): python3-requests-2.25.1-8.el9.noarch. 875 kB/s | 125 kB 00:00 2024-09-17T05:19:38.160 INFO:teuthology.orchestra.run.smithi167.stdout:(50/157): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 107 kB 00:00 2024-09-17T05:19:38.185 INFO:teuthology.orchestra.run.smithi167.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 433 kB/s | 22 kB 00:00 2024-09-17T05:19:38.210 INFO:teuthology.orchestra.run.smithi167.stdout:(52/157): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-09-17T05:19:38.227 INFO:teuthology.orchestra.run.smithi167.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 779 kB/s | 33 kB 00:00 2024-09-17T05:19:38.286 INFO:teuthology.orchestra.run.smithi167.stdout:(54/157): bison-3.7.4-5.el9.x86_64.rpm 4.2 MB/s | 943 kB 00:00 2024-09-17T05:19:38.303 INFO:teuthology.orchestra.run.smithi167.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 242 kB/s | 18 kB 00:00 2024-09-17T05:19:38.320 INFO:teuthology.orchestra.run.smithi167.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 333 kB/s | 11 kB 00:00 2024-09-17T05:19:38.379 INFO:teuthology.orchestra.run.smithi167.stdout:(57/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 18 MB/s | 3.0 MB 00:00 2024-09-17T05:19:38.404 INFO:teuthology.orchestra.run.smithi167.stdout:(58/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.7 MB/s | 171 kB 00:00 2024-09-17T05:19:38.429 INFO:teuthology.orchestra.run.smithi167.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 903 kB/s | 45 kB 00:00 2024-09-17T05:19:38.455 INFO:teuthology.orchestra.run.smithi167.stdout:(60/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 160 kB 00:00 2024-09-17T05:19:38.488 INFO:teuthology.orchestra.run.smithi167.stdout:(61/157): libtool-2.4.6-46.el9.x86_64.rpm 9.7 MB/s | 581 kB 00:00 2024-09-17T05:19:38.522 INFO:teuthology.orchestra.run.smithi167.stdout:(62/157): librdkafka-1.6.1-102.el9.x86_64.rpm 5.5 MB/s | 662 kB 00:00 2024-09-17T05:19:38.547 INFO:teuthology.orchestra.run.smithi167.stdout:(63/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 266 kB/s | 24 kB 00:00 2024-09-17T05:19:38.572 INFO:teuthology.orchestra.run.smithi167.stdout:(64/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 565 kB/s | 47 kB 00:00 2024-09-17T05:19:38.606 INFO:teuthology.orchestra.run.smithi167.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 188 kB 00:00 2024-09-17T05:19:38.631 INFO:teuthology.orchestra.run.smithi167.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 659 kB/s | 38 kB 00:00 2024-09-17T05:19:38.665 INFO:teuthology.orchestra.run.smithi167.stdout:(67/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.0 MB/s | 292 kB 00:00 2024-09-17T05:19:38.679 INFO:teuthology.orchestra.run.smithi098.stdout:(8/157): ceph-common-19.3.0-4963.g820f760e.el9. 5.1 MB/s | 22 MB 00:04 2024-09-17T05:19:38.729 INFO:teuthology.orchestra.run.smithi098.stdout:(9/157): ceph-selinux-19.3.0-4963.g820f760e.el9 507 kB/s | 25 kB 00:00 2024-09-17T05:19:38.757 INFO:teuthology.orchestra.run.smithi167.stdout:(68/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 35 MB/s | 4.4 MB 00:00 2024-09-17T05:19:38.832 INFO:teuthology.orchestra.run.smithi167.stdout:(69/157): openblas-openmp-0.3.26-2.el9.x86_64.r 22 MB/s | 4.9 MB 00:00 2024-09-17T05:19:38.863 INFO:teuthology.orchestra.run.smithi098.stdout:(10/157): ceph-radosgw-19.3.0-4963.g820f760e.el 6.6 MB/s | 11 MB 00:01 2024-09-17T05:19:38.874 INFO:teuthology.orchestra.run.smithi167.stdout:(70/157): postgresql-13.16-1.el9.x86_64.rpm 7.6 MB/s | 1.6 MB 00:00 2024-09-17T05:19:38.916 INFO:teuthology.orchestra.run.smithi167.stdout:(71/157): postgresql-contrib-13.16-1.el9.x86_64 5.6 MB/s | 910 kB 00:00 2024-09-17T05:19:38.929 INFO:teuthology.orchestra.run.smithi098.stdout:(11/157): cephfs-mirror-19.3.0-4963.g820f760e.e 3.3 MB/s | 225 kB 00:00 2024-09-17T05:19:38.941 INFO:teuthology.orchestra.run.smithi167.stdout:(72/157): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-17T05:19:38.980 INFO:teuthology.orchestra.run.smithi098.stdout:(12/157): cephfs-shell-19.3.0-4963.g820f760e.el 540 kB/s | 27 kB 00:00 2024-09-17T05:19:38.983 INFO:teuthology.orchestra.run.smithi167.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 15 MB/s | 1.0 MB 00:00 2024-09-17T05:19:39.009 INFO:teuthology.orchestra.run.smithi167.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-17T05:19:39.030 INFO:teuthology.orchestra.run.smithi098.stdout:(13/157): libcephfs-devel-19.3.0-4963.g820f760e 638 kB/s | 32 kB 00:00 2024-09-17T05:19:39.043 INFO:teuthology.orchestra.run.smithi167.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.8 MB/s | 61 kB 00:00 2024-09-17T05:19:39.118 INFO:teuthology.orchestra.run.smithi167.stdout:(76/157): postgresql-server-13.16-1.el9.x86_64. 24 MB/s | 5.8 MB 00:00 2024-09-17T05:19:39.143 INFO:teuthology.orchestra.run.smithi167.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-17T05:19:39.147 INFO:teuthology.orchestra.run.smithi098.stdout:(14/157): libcephfs2-19.3.0-4963.g820f760e.el9. 6.3 MB/s | 755 kB 00:00 2024-09-17T05:19:39.168 INFO:teuthology.orchestra.run.smithi167.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-09-17T05:19:39.185 INFO:teuthology.orchestra.run.smithi167.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 614 kB/s | 26 kB 00:00 2024-09-17T05:19:39.197 INFO:teuthology.orchestra.run.smithi098.stdout:(15/157): libcephsqlite-19.3.0-4963.g820f760e.e 3.2 MB/s | 161 kB 00:00 2024-09-17T05:19:39.210 INFO:teuthology.orchestra.run.smithi167.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 457 kB/s | 19 kB 00:00 2024-09-17T05:19:39.236 INFO:teuthology.orchestra.run.smithi167.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-09-17T05:19:39.248 INFO:teuthology.orchestra.run.smithi098.stdout:(16/157): librados-devel-19.3.0-4963.g820f760e. 2.5 MB/s | 126 kB 00:00 2024-09-17T05:19:39.253 INFO:teuthology.orchestra.run.smithi167.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 828 kB/s | 35 kB 00:00 2024-09-17T05:19:39.328 INFO:teuthology.orchestra.run.smithi167.stdout:(83/157): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-09-17T05:19:39.348 INFO:teuthology.orchestra.run.smithi098.stdout:(17/157): libradosstriper1-19.3.0-4963.g820f760 5.0 MB/s | 508 kB 00:00 2024-09-17T05:19:39.353 INFO:teuthology.orchestra.run.smithi167.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.4 MB/s | 250 kB 00:00 2024-09-17T05:19:39.379 INFO:teuthology.orchestra.run.smithi167.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-17T05:19:39.412 INFO:teuthology.orchestra.run.smithi167.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-17T05:19:39.429 INFO:teuthology.orchestra.run.smithi167.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 842 kB/s | 42 kB 00:00 2024-09-17T05:19:39.463 INFO:teuthology.orchestra.run.smithi167.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-09-17T05:19:39.488 INFO:teuthology.orchestra.run.smithi167.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 159 kB 00:00 2024-09-17T05:19:39.522 INFO:teuthology.orchestra.run.smithi167.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 4.6 MB/s | 279 kB 00:00 2024-09-17T05:19:39.547 INFO:teuthology.orchestra.run.smithi167.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 872 kB/s | 51 kB 00:00 2024-09-17T05:19:39.572 INFO:teuthology.orchestra.run.smithi167.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-17T05:19:39.656 INFO:teuthology.orchestra.run.smithi167.stdout:(93/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-17T05:19:39.682 INFO:teuthology.orchestra.run.smithi167.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 383 kB/s | 42 kB 00:00 2024-09-17T05:19:39.707 INFO:teuthology.orchestra.run.smithi167.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 883 kB/s | 44 kB 00:00 2024-09-17T05:19:39.732 INFO:teuthology.orchestra.run.smithi167.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-17T05:19:39.758 INFO:teuthology.orchestra.run.smithi167.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 711 kB/s | 36 kB 00:00 2024-09-17T05:19:39.782 INFO:teuthology.orchestra.run.smithi098.stdout:(18/157): ceph-osd-19.3.0-4963.g820f760e.el9.x8 5.6 MB/s | 17 MB 00:03 2024-09-17T05:19:39.783 INFO:teuthology.orchestra.run.smithi167.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 943 kB/s | 47 kB 00:00 2024-09-17T05:19:39.808 INFO:teuthology.orchestra.run.smithi167.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-17T05:19:39.832 INFO:teuthology.orchestra.run.smithi098.stdout:(19/157): python3-ceph-argparse-19.3.0-4963.g82 910 kB/s | 45 kB 00:00 2024-09-17T05:19:39.833 INFO:teuthology.orchestra.run.smithi167.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-17T05:19:39.859 INFO:teuthology.orchestra.run.smithi167.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-17T05:19:39.883 INFO:teuthology.orchestra.run.smithi098.stdout:(20/157): python3-ceph-common-19.3.0-4963.g820f 2.9 MB/s | 148 kB 00:00 2024-09-17T05:19:39.884 INFO:teuthology.orchestra.run.smithi167.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-17T05:19:39.910 INFO:teuthology.orchestra.run.smithi167.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 891 kB/s | 45 kB 00:00 2024-09-17T05:19:39.932 INFO:teuthology.orchestra.run.smithi098.stdout:(21/157): python3-cephfs-19.3.0-4963.g820f760e. 3.2 MB/s | 161 kB 00:00 2024-09-17T05:19:40.008 INFO:teuthology.orchestra.run.smithi098.stdout:(22/157): python3-rados-19.3.0-4963.g820f760e.e 4.2 MB/s | 320 kB 00:00 2024-09-17T05:19:40.083 INFO:teuthology.orchestra.run.smithi098.stdout:(23/157): python3-rbd-19.3.0-4963.g820f760e.el9 4.0 MB/s | 305 kB 00:00 2024-09-17T05:19:40.135 INFO:teuthology.orchestra.run.smithi167.stdout:(104/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 28 MB/s | 16 MB 00:00 2024-09-17T05:19:40.175 INFO:teuthology.orchestra.run.smithi098.stdout:(24/157): librgw2-19.3.0-4963.g820f760e.el9.x86 6.7 MB/s | 5.5 MB 00:00 2024-09-17T05:19:40.185 INFO:teuthology.orchestra.run.smithi167.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-17T05:19:40.200 INFO:teuthology.orchestra.run.smithi098.stdout:(25/157): python3-rgw-19.3.0-4963.g820f760e.el9 850 kB/s | 99 kB 00:00 2024-09-17T05:19:40.225 INFO:teuthology.orchestra.run.smithi098.stdout:(26/157): rbd-fuse-19.3.0-4963.g820f760e.el9.x8 1.7 MB/s | 85 kB 00:00 2024-09-17T05:19:40.235 INFO:teuthology.orchestra.run.smithi167.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 6.0 MB/s | 308 kB 00:00 2024-09-17T05:19:40.261 INFO:teuthology.orchestra.run.smithi167.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 780 kB/s | 19 kB 00:00 2024-09-17T05:19:40.276 INFO:teuthology.orchestra.run.smithi098.stdout:(27/157): rbd-nbd-19.3.0-4963.g820f760e.el9.x86 3.3 MB/s | 170 kB 00:00 2024-09-17T05:19:40.318 INFO:teuthology.orchestra.run.smithi098.stdout:(28/157): ceph-grafana-dashboards-19.3.0-4963.g 826 kB/s | 34 kB 00:00 2024-09-17T05:19:40.345 INFO:teuthology.orchestra.run.smithi167.stdout:(108/157): lua-devel-5.4.4-4.el9.x86_64.rpm 48 kB/s | 22 kB 00:00 2024-09-17T05:19:40.368 INFO:teuthology.orchestra.run.smithi098.stdout:(29/157): ceph-mgr-cephadm-19.3.0-4963.g820f760 3.0 MB/s | 154 kB 00:00 2024-09-17T05:19:40.428 INFO:teuthology.orchestra.run.smithi167.stdout:(109/157): libarrow-9.0.0-11.el9.x86_64.rpm 26 MB/s | 4.4 MB 00:00 2024-09-17T05:19:40.445 INFO:teuthology.orchestra.run.smithi167.stdout:(110/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 259 kB/s | 26 kB 00:00 2024-09-17T05:19:40.462 INFO:teuthology.orchestra.run.smithi167.stdout:(111/157): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-09-17T05:19:40.487 INFO:teuthology.orchestra.run.smithi167.stdout:(112/157): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-09-17T05:19:40.512 INFO:teuthology.orchestra.run.smithi167.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-09-17T05:19:40.563 INFO:teuthology.orchestra.run.smithi167.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-09-17T05:19:40.580 INFO:teuthology.orchestra.run.smithi167.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.5 MB/s | 43 kB 00:00 2024-09-17T05:19:40.613 INFO:teuthology.orchestra.run.smithi167.stdout:(116/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.5 MB/s | 839 kB 00:00 2024-09-17T05:19:40.630 INFO:teuthology.orchestra.run.smithi167.stdout:(117/157): python3-cachetools-4.2.4-1.el9.noarc 642 kB/s | 32 kB 00:00 2024-09-17T05:19:40.647 INFO:teuthology.orchestra.run.smithi167.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 418 kB/s | 14 kB 00:00 2024-09-17T05:19:40.668 INFO:teuthology.orchestra.run.smithi098.stdout:(30/157): rbd-mirror-19.3.0-4963.g820f760e.el9. 6.8 MB/s | 3.2 MB 00:00 2024-09-17T05:19:40.673 INFO:teuthology.orchestra.run.smithi167.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 4.0 MB/s | 172 kB 00:00 2024-09-17T05:19:40.698 INFO:teuthology.orchestra.run.smithi167.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-17T05:19:40.723 INFO:teuthology.orchestra.run.smithi167.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-17T05:19:40.749 INFO:teuthology.orchestra.run.smithi167.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-17T05:19:40.791 INFO:teuthology.orchestra.run.smithi167.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 3.4 MB/s | 144 kB 00:00 2024-09-17T05:19:40.808 INFO:teuthology.orchestra.run.smithi167.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 647 kB/s | 11 kB 00:00 2024-09-17T05:19:40.825 INFO:teuthology.orchestra.run.smithi167.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 1.0 MB/s | 18 kB 00:00 2024-09-17T05:19:40.842 INFO:teuthology.orchestra.run.smithi167.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 1.4 MB/s | 23 kB 00:00 2024-09-17T05:19:40.867 INFO:teuthology.orchestra.run.smithi167.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 784 kB/s | 19 kB 00:00 2024-09-17T05:19:40.917 INFO:teuthology.orchestra.run.smithi167.stdout:(128/157): python3-grpcio-1.46.7-10.el9.x86_64. 11 MB/s | 2.0 MB 00:00 2024-09-17T05:19:40.943 INFO:teuthology.orchestra.run.smithi167.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 261 kB/s | 20 kB 00:00 2024-09-17T05:19:40.965 INFO:teuthology.orchestra.run.smithi167.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 2.1 MB/s | 46 kB 00:00 2024-09-17T05:19:40.998 INFO:teuthology.orchestra.run.smithi167.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-17T05:19:41.040 INFO:teuthology.orchestra.run.smithi167.stdout:(132/157): python3-kubernetes-26.1.0-2.el9.noar 11 MB/s | 1.0 MB 00:00 2024-09-17T05:19:41.057 INFO:teuthology.orchestra.run.smithi167.stdout:(133/157): python3-natsort-7.1.1-5.el9.noarch.r 982 kB/s | 58 kB 00:00 2024-09-17T05:19:41.091 INFO:teuthology.orchestra.run.smithi167.stdout:(134/157): protobuf-compiler-3.14.0-13.el9.x86_ 731 kB/s | 863 kB 00:01 2024-09-17T05:19:41.108 INFO:teuthology.orchestra.run.smithi167.stdout:(135/157): python3-portend-3.1.0-2.el9.noarch.r 328 kB/s | 16 kB 00:00 2024-09-17T05:19:41.133 INFO:teuthology.orchestra.run.smithi167.stdout:(136/157): python3-pyperclip-1.8.2-2.el9.noarch 1.6 MB/s | 28 kB 00:00 2024-09-17T05:19:41.159 INFO:teuthology.orchestra.run.smithi167.stdout:(137/157): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2024-09-17T05:19:41.176 INFO:teuthology.orchestra.run.smithi167.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 762 kB/s | 31 kB 00:00 2024-09-17T05:19:41.209 INFO:teuthology.orchestra.run.smithi167.stdout:(139/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 762 kB/s | 90 kB 00:00 2024-09-17T05:19:41.226 INFO:teuthology.orchestra.run.smithi167.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-17T05:19:41.252 INFO:teuthology.orchestra.run.smithi167.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 853 kB/s | 36 kB 00:00 2024-09-17T05:19:41.285 INFO:teuthology.orchestra.run.smithi167.stdout:(142/157): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-09-17T05:19:41.311 INFO:teuthology.orchestra.run.smithi167.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 887 kB/s | 74 kB 00:00 2024-09-17T05:19:41.336 INFO:teuthology.orchestra.run.smithi167.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-09-17T05:19:41.361 INFO:teuthology.orchestra.run.smithi167.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-17T05:19:41.386 INFO:teuthology.orchestra.run.smithi167.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-17T05:19:41.412 INFO:teuthology.orchestra.run.smithi167.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-17T05:19:41.437 INFO:teuthology.orchestra.run.smithi167.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-17T05:19:41.488 INFO:teuthology.orchestra.run.smithi167.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-17T05:19:41.527 INFO:teuthology.orchestra.run.smithi098.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 8.6 MB/s | 7.4 MB 00:00 2024-09-17T05:19:41.602 INFO:teuthology.orchestra.run.smithi098.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4963.g82 3.8 MB/s | 291 kB 00:00 2024-09-17T05:19:41.652 INFO:teuthology.orchestra.run.smithi098.stdout:(33/157): ceph-mgr-rook-19.3.0-4963.g820f760e.e 987 kB/s | 49 kB 00:00 2024-09-17T05:19:41.669 INFO:teuthology.orchestra.run.smithi167.stdout:(150/157): NetworkManager-1.51.0-1.el9.x86_64.r 13 MB/s | 2.3 MB 00:00 2024-09-17T05:19:41.694 INFO:teuthology.orchestra.run.smithi098.stdout:(34/157): ceph-prometheus-alerts-19.3.0-4963.g8 394 kB/s | 16 kB 00:00 2024-09-17T05:19:41.747 INFO:teuthology.orchestra.run.smithi167.stdout:(151/157): librados2-19.3.0-4963.g820f760e.el9. 10 MB/s | 3.5 MB 00:00 2024-09-17T05:19:41.770 INFO:teuthology.orchestra.run.smithi098.stdout:(35/157): ceph-volume-19.3.0-4963.g820f760e.el9 3.7 MB/s | 285 kB 00:00 2024-09-17T05:19:41.789 INFO:teuthology.orchestra.run.smithi167.stdout:(152/157): NetworkManager-libnm-1.51.0-1.el9.x8 15 MB/s | 1.8 MB 00:00 2024-09-17T05:19:41.814 INFO:teuthology.orchestra.run.smithi167.stdout:(153/157): NetworkManager-team-1.51.0-1.el9.x86 613 kB/s | 41 kB 00:00 2024-09-17T05:19:41.872 INFO:teuthology.orchestra.run.smithi167.stdout:(154/157): librbd1-19.3.0-4963.g820f760e.el9.x8 7.5 MB/s | 3.3 MB 00:00 2024-09-17T05:19:41.898 INFO:teuthology.orchestra.run.smithi167.stdout:(155/157): NetworkManager-tui-1.51.0-1.el9.x86_ 2.2 MB/s | 249 kB 00:00 2024-09-17T05:19:41.962 INFO:teuthology.orchestra.run.smithi098.stdout:(36/157): ceph-mgr-dashboard-19.3.0-4963.g820f7 8.9 MB/s | 14 MB 00:01 2024-09-17T05:19:41.973 INFO:teuthology.orchestra.run.smithi167.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 8.5 MB/s | 1.4 MB 00:00 2024-09-17T05:19:42.004 INFO:teuthology.orchestra.run.smithi098.stdout:(37/157): cephadm-19.3.0-4963.g820f760e.el9.noa 3.3 MB/s | 784 kB 00:00 2024-09-17T05:19:42.021 INFO:teuthology.orchestra.run.smithi098.stdout:(38/157): cephfs-top-19.3.0-4963.g820f760e.el9. 313 kB/s | 18 kB 00:00 2024-09-17T05:19:42.106 INFO:teuthology.orchestra.run.smithi167.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 10 MB/s | 2.4 MB 00:00 2024-09-17T05:19:42.113 INFO:teuthology.orchestra.run.smithi167.stdout:-------------------------------------------------------------------------------- 2024-09-17T05:19:42.113 INFO:teuthology.orchestra.run.smithi167.stdout:Total 26 MB/s | 235 MB 00:08 2024-09-17T05:19:42.163 INFO:teuthology.orchestra.run.smithi098.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 504 kB/s | 80 kB 00:00 2024-09-17T05:19:42.247 INFO:teuthology.orchestra.run.smithi098.stdout:(40/157): libquadmath-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-09-17T05:19:42.347 INFO:teuthology.orchestra.run.smithi098.stdout:(41/157): libgfortran-11.5.0-2.el9.x86_64.rpm 2.4 MB/s | 801 kB 00:00 2024-09-17T05:19:42.372 INFO:teuthology.orchestra.run.smithi098.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.0 MB/s | 253 kB 00:00 2024-09-17T05:19:42.430 INFO:teuthology.orchestra.run.smithi098.stdout:(43/157): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-17T05:19:42.465 INFO:teuthology.orchestra.run.smithi098.stdout:(44/157): python3-cryptography-36.0.1-4.el9.x86 10 MB/s | 1.2 MB 00:00 2024-09-17T05:19:42.490 INFO:teuthology.orchestra.run.smithi098.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-17T05:19:42.515 INFO:teuthology.orchestra.run.smithi098.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-17T05:19:42.549 INFO:teuthology.orchestra.run.smithi098.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-17T05:19:42.741 INFO:teuthology.orchestra.run.smithi098.stdout:(48/157): automake-1.16.2-8.el9.noarch.rpm 3.0 MB/s | 689 kB 00:00 2024-09-17T05:19:42.774 INFO:teuthology.orchestra.run.smithi098.stdout:(49/157): bison-3.7.4-5.el9.x86_64.rpm 4.1 MB/s | 943 kB 00:00 2024-09-17T05:19:42.799 INFO:teuthology.orchestra.run.smithi098.stdout:(50/157): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-09-17T05:19:42.824 INFO:teuthology.orchestra.run.smithi098.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 432 kB/s | 22 kB 00:00 2024-09-17T05:19:42.850 INFO:teuthology.orchestra.run.smithi098.stdout:(52/157): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-09-17T05:19:42.875 INFO:teuthology.orchestra.run.smithi098.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 650 kB/s | 33 kB 00:00 2024-09-17T05:19:42.917 INFO:teuthology.orchestra.run.smithi098.stdout:(54/157): flexiblas-openblas-openmp-3.0.4-8.el9 440 kB/s | 18 kB 00:00 2024-09-17T05:19:42.959 INFO:teuthology.orchestra.run.smithi098.stdout:(55/157): libaio-devel-0.3.111-13.el9.x86_64.rp 268 kB/s | 11 kB 00:00 2024-09-17T05:19:43.010 INFO:teuthology.orchestra.run.smithi098.stdout:(56/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 19 MB/s | 3.0 MB 00:00 2024-09-17T05:19:43.035 INFO:teuthology.orchestra.run.smithi098.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 2.2 MB/s | 171 kB 00:00 2024-09-17T05:19:43.060 INFO:teuthology.orchestra.run.smithi098.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-17T05:19:43.077 INFO:teuthology.orchestra.run.smithi098.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-17T05:19:43.111 INFO:teuthology.orchestra.run.smithi098.stdout:(60/157): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 662 kB 00:00 2024-09-17T05:19:43.153 INFO:teuthology.orchestra.run.smithi098.stdout:(61/157): libtool-2.4.6-46.el9.x86_64.rpm 7.5 MB/s | 581 kB 00:00 2024-09-17T05:19:43.169 INFO:teuthology.orchestra.run.smithi098.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 419 kB/s | 24 kB 00:00 2024-09-17T05:19:43.195 INFO:teuthology.orchestra.run.smithi098.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-17T05:19:43.220 INFO:teuthology.orchestra.run.smithi098.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.6 MB/s | 292 kB 00:00 2024-09-17T05:19:43.246 INFO:teuthology.orchestra.run.smithi098.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-09-17T05:19:43.271 INFO:teuthology.orchestra.run.smithi098.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 768 kB/s | 38 kB 00:00 2024-09-17T05:19:43.366 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction check 2024-09-17T05:19:43.388 INFO:teuthology.orchestra.run.smithi098.stdout:(67/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 38 MB/s | 4.4 MB 00:00 2024-09-17T05:19:43.525 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction check succeeded. 2024-09-17T05:19:43.525 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction test 2024-09-17T05:19:43.797 INFO:teuthology.orchestra.run.smithi098.stdout:(68/157): ceph-test-19.3.0-4963.g820f760e.el9.x 9.0 MB/s | 46 MB 00:05 2024-09-17T05:19:43.864 INFO:teuthology.orchestra.run.smithi098.stdout:(69/157): openblas-openmp-0.3.26-2.el9.x86_64.r 8.0 MB/s | 4.9 MB 00:00 2024-09-17T05:19:43.905 INFO:teuthology.orchestra.run.smithi098.stdout:(70/157): postgresql-13.16-1.el9.x86_64.rpm 3.1 MB/s | 1.6 MB 00:00 2024-09-17T05:19:43.931 INFO:teuthology.orchestra.run.smithi098.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-17T05:19:43.998 INFO:teuthology.orchestra.run.smithi098.stdout:(72/157): protobuf-3.14.0-13.el9.x86_64.rpm 15 MB/s | 1.0 MB 00:00 2024-09-17T05:19:44.073 INFO:teuthology.orchestra.run.smithi098.stdout:(73/157): postgresql-server-13.16-1.el9.x86_64. 35 MB/s | 5.8 MB 00:00 2024-09-17T05:19:44.098 INFO:teuthology.orchestra.run.smithi098.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 874 kB/s | 87 kB 00:00 2024-09-17T05:19:44.149 INFO:teuthology.orchestra.run.smithi098.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-09-17T05:19:44.232 INFO:teuthology.orchestra.run.smithi098.stdout:(76/157): python3-babel-2.9.1-2.el9.noarch.rpm 38 MB/s | 6.0 MB 00:00 2024-09-17T05:19:44.266 INFO:teuthology.orchestra.run.smithi098.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.0 MB/s | 245 kB 00:00 2024-09-17T05:19:44.291 INFO:teuthology.orchestra.run.smithi098.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-09-17T05:19:44.317 INFO:teuthology.orchestra.run.smithi098.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 509 kB/s | 26 kB 00:00 2024-09-17T05:19:44.342 INFO:teuthology.orchestra.run.smithi098.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-09-17T05:19:44.375 INFO:teuthology.orchestra.run.smithi098.stdout:(81/157): postgresql-contrib-13.16-1.el9.x86_64 1.5 MB/s | 910 kB 00:00 2024-09-17T05:19:44.401 INFO:teuthology.orchestra.run.smithi098.stdout:(82/157): python3-mako-1.1.4-6.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-09-17T05:19:44.426 INFO:teuthology.orchestra.run.smithi098.stdout:(83/157): python3-markupsafe-1.1.1-12.el9.x86_6 415 kB/s | 35 kB 00:00 2024-09-17T05:19:44.476 INFO:teuthology.orchestra.run.smithi098.stdout:(84/157): python3-oauthlib-3.1.1-5.el9.noarch.r 4.4 MB/s | 222 kB 00:00 2024-09-17T05:19:44.551 INFO:teuthology.orchestra.run.smithi098.stdout:(85/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 34 MB/s | 5.1 MB 00:00 2024-09-17T05:19:44.577 INFO:teuthology.orchestra.run.smithi098.stdout:(86/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.4 MB/s | 250 kB 00:00 2024-09-17T05:19:44.603 INFO:teuthology.orchestra.run.smithi098.stdout:(87/157): python3-packaging-20.9-5.el9.noarch.r 614 kB/s | 77 kB 00:00 2024-09-17T05:19:44.627 INFO:teuthology.orchestra.run.smithi098.stdout:(88/157): python3-prettytable-0.7.2-27.el9.noar 560 kB/s | 42 kB 00:00 2024-09-17T05:19:44.653 INFO:teuthology.orchestra.run.smithi098.stdout:(89/157): python3-protobuf-3.14.0-13.el9.noarch 3.5 MB/s | 269 kB 00:00 2024-09-17T05:19:44.678 INFO:teuthology.orchestra.run.smithi098.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-17T05:19:44.705 INFO:teuthology.orchestra.run.smithi098.stdout:(91/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.6 MB/s | 159 kB 00:00 2024-09-17T05:19:44.728 INFO:teuthology.orchestra.run.smithi098.stdout:(92/157): python3-pytz-2021.1-5.el9.noarch.rpm 677 kB/s | 51 kB 00:00 2024-09-17T05:19:44.762 INFO:teuthology.orchestra.run.smithi098.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 639 kB/s | 54 kB 00:00 2024-09-17T05:19:44.787 INFO:teuthology.orchestra.run.smithi098.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 710 kB/s | 42 kB 00:00 2024-09-17T05:19:44.813 INFO:teuthology.orchestra.run.smithi098.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 878 kB/s | 44 kB 00:00 2024-09-17T05:19:44.855 INFO:teuthology.orchestra.run.smithi098.stdout:(96/157): qatlib-service-24.02.0-1.el9.x86_64.r 869 kB/s | 36 kB 00:00 2024-09-17T05:19:44.888 INFO:teuthology.orchestra.run.smithi098.stdout:(97/157): qatlib-24.02.0-1.el9.x86_64.rpm 2.1 MB/s | 221 kB 00:00 2024-09-17T05:19:44.913 INFO:teuthology.orchestra.run.smithi098.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 809 kB/s | 47 kB 00:00 2024-09-17T05:19:44.956 INFO:teuthology.orchestra.run.smithi098.stdout:(99/157): uuid-1.6.2-55.el9.x86_64.rpm 1.4 MB/s | 58 kB 00:00 2024-09-17T05:19:44.997 INFO:teuthology.orchestra.run.smithi098.stdout:(100/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 2.3 MB/s | 96 kB 00:00 2024-09-17T05:19:45.023 INFO:teuthology.orchestra.run.smithi098.stdout:(101/157): socat-1.7.4.1-6.el9.x86_64.rpm 2.2 MB/s | 304 kB 00:00 2024-09-17T05:19:45.048 INFO:teuthology.orchestra.run.smithi098.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-17T05:19:45.215 INFO:teuthology.orchestra.run.smithi098.stdout:(103/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 33 MB/s | 16 MB 00:00 2024-09-17T05:19:45.240 INFO:teuthology.orchestra.run.smithi098.stdout:(104/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 206 kB/s | 45 kB 00:00 2024-09-17T05:19:45.274 INFO:teuthology.orchestra.run.smithi098.stdout:(105/157): lua-devel-5.4.4-4.el9.x86_64.rpm 99 kB/s | 22 kB 00:00 2024-09-17T05:19:45.316 INFO:teuthology.orchestra.run.smithi098.stdout:(106/157): abseil-cpp-20211102.0-3.el9.x86_64.r 7.1 MB/s | 548 kB 00:00 2024-09-17T05:19:45.341 INFO:teuthology.orchestra.run.smithi098.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 848 kB/s | 19 kB 00:00 2024-09-17T05:19:45.383 INFO:teuthology.orchestra.run.smithi098.stdout:(108/157): gperftools-libs-2.9.1-3.el9.x86_64.r 2.8 MB/s | 308 kB 00:00 2024-09-17T05:19:45.408 INFO:teuthology.orchestra.run.smithi098.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-17T05:19:45.450 INFO:teuthology.orchestra.run.smithi098.stdout:(110/157): protobuf-compiler-3.14.0-13.el9.x86_ 3.6 MB/s | 863 kB 00:00 2024-09-17T05:19:45.475 INFO:teuthology.orchestra.run.smithi098.stdout:(111/157): liboath-2.6.7-2.el9.x86_64.rpm 727 kB/s | 49 kB 00:00 2024-09-17T05:19:45.509 INFO:teuthology.orchestra.run.smithi098.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 5.8 MB/s | 151 kB 00:00 2024-09-17T05:19:45.542 INFO:teuthology.orchestra.run.smithi098.stdout:(113/157): libunwind-1.6.2-1.el9.x86_64.rpm 732 kB/s | 67 kB 00:00 2024-09-17T05:19:45.585 INFO:teuthology.orchestra.run.smithi098.stdout:(114/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-09-17T05:19:45.610 INFO:teuthology.orchestra.run.smithi098.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-17T05:19:45.635 INFO:teuthology.orchestra.run.smithi098.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-17T05:19:45.660 INFO:teuthology.orchestra.run.smithi098.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 563 kB/s | 14 kB 00:00 2024-09-17T05:19:45.685 INFO:teuthology.orchestra.run.smithi098.stdout:(118/157): python3-asyncssh-2.13.2-5.el9.noarch 3.8 MB/s | 548 kB 00:00 2024-09-17T05:19:45.711 INFO:teuthology.orchestra.run.smithi098.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-17T05:19:45.744 INFO:teuthology.orchestra.run.smithi098.stdout:(120/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 8.9 MB/s | 303 kB 00:00 2024-09-17T05:19:45.770 INFO:teuthology.orchestra.run.smithi098.stdout:(121/157): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-09-17T05:19:45.795 INFO:teuthology.orchestra.run.smithi098.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-17T05:19:45.798 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction test succeeded. 2024-09-17T05:19:45.799 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction 2024-09-17T05:19:45.829 INFO:teuthology.orchestra.run.smithi098.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-17T05:19:45.846 INFO:teuthology.orchestra.run.smithi098.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 639 kB/s | 11 kB 00:00 2024-09-17T05:19:45.905 INFO:teuthology.orchestra.run.smithi098.stdout:(125/157): libarrow-9.0.0-11.el9.x86_64.rpm 7.8 MB/s | 4.4 MB 00:00 2024-09-17T05:19:45.921 INFO:teuthology.orchestra.run.smithi098.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 235 kB/s | 18 kB 00:00 2024-09-17T05:19:45.938 INFO:teuthology.orchestra.run.smithi098.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 695 kB/s | 23 kB 00:00 2024-09-17T05:19:45.955 INFO:teuthology.orchestra.run.smithi098.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 578 kB/s | 19 kB 00:00 2024-09-17T05:19:45.972 INFO:teuthology.orchestra.run.smithi098.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 586 kB/s | 20 kB 00:00 2024-09-17T05:19:45.998 INFO:teuthology.orchestra.run.smithi098.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-17T05:19:46.031 INFO:teuthology.orchestra.run.smithi098.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-17T05:19:46.048 INFO:teuthology.orchestra.run.smithi098.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 3.4 MB/s | 58 kB 00:00 2024-09-17T05:19:46.082 INFO:teuthology.orchestra.run.smithi098.stdout:(133/157): python3-kubernetes-26.1.0-2.el9.noar 8.1 MB/s | 1.0 MB 00:00 2024-09-17T05:19:46.099 INFO:teuthology.orchestra.run.smithi098.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 1.0 MB/s | 16 kB 00:00 2024-09-17T05:19:46.132 INFO:teuthology.orchestra.run.smithi098.stdout:(135/157): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-17T05:19:46.157 INFO:teuthology.orchestra.run.smithi098.stdout:(136/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-09-17T05:19:46.176 INFO:teuthology.orchestra.run.smithi098.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 674 kB/s | 28 kB 00:00 2024-09-17T05:19:46.192 INFO:teuthology.orchestra.run.smithi098.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 913 kB/s | 31 kB 00:00 2024-09-17T05:19:46.233 INFO:teuthology.orchestra.run.smithi098.stdout:(139/157): python3-grpcio-1.46.7-10.el9.x86_64. 4.4 MB/s | 2.0 MB 00:00 2024-09-17T05:19:46.250 INFO:teuthology.orchestra.run.smithi098.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-09-17T05:19:46.268 INFO:teuthology.orchestra.run.smithi098.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 1.0 MB/s | 36 kB 00:00 2024-09-17T05:19:46.293 INFO:teuthology.orchestra.run.smithi098.stdout:(142/157): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2024-09-17T05:19:46.318 INFO:teuthology.orchestra.run.smithi098.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 1.1 MB/s | 74 kB 00:00 2024-09-17T05:19:46.343 INFO:teuthology.orchestra.run.smithi098.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-17T05:19:46.369 INFO:teuthology.orchestra.run.smithi098.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-17T05:19:46.394 INFO:teuthology.orchestra.run.smithi098.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-09-17T05:19:46.419 INFO:teuthology.orchestra.run.smithi098.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-17T05:19:46.444 INFO:teuthology.orchestra.run.smithi098.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-17T05:19:46.495 INFO:teuthology.orchestra.run.smithi098.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-17T05:19:46.787 INFO:teuthology.orchestra.run.smithi098.stdout:(150/157): librbd1-19.3.0-4963.g820f760e.el9.x8 9.5 MB/s | 3.3 MB 00:00 2024-09-17T05:19:46.870 INFO:teuthology.orchestra.run.smithi098.stdout:(151/157): librados2-19.3.0-4963.g820f760e.el9. 7.7 MB/s | 3.5 MB 00:00 2024-09-17T05:19:47.021 INFO:teuthology.orchestra.run.smithi098.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 272 kB/s | 41 kB 00:00 2024-09-17T05:19:47.097 INFO:teuthology.orchestra.run.smithi098.stdout:(153/157): NetworkManager-libnm-1.51.0-1.el9.x8 5.8 MB/s | 1.8 MB 00:00 2024-09-17T05:19:47.195 INFO:teuthology.orchestra.run.smithi098.stdout:(154/157): openssl-3.2.2-6.el9.x86_64.rpm 14 MB/s | 1.4 MB 00:00 2024-09-17T05:19:47.247 INFO:teuthology.orchestra.run.smithi098.stdout:(155/157): NetworkManager-1.51.0-1.el9.x86_64.r 3.1 MB/s | 2.3 MB 00:00 2024-09-17T05:19:47.272 INFO:teuthology.orchestra.run.smithi098.stdout:(156/157): NetworkManager-tui-1.51.0-1.el9.x86_ 993 kB/s | 249 kB 00:00 2024-09-17T05:19:47.380 INFO:teuthology.orchestra.run.smithi098.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 13 MB/s | 2.4 MB 00:00 2024-09-17T05:19:47.386 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-17T05:19:47.386 INFO:teuthology.orchestra.run.smithi098.stdout:Total 17 MB/s | 235 MB 00:13 2024-09-17T05:19:48.604 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-17T05:19:48.760 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-17T05:19:48.760 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-17T05:19:51.001 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-17T05:19:51.001 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-17T05:19:52.299 INFO:teuthology.orchestra.run.smithi167.stdout: Preparing : 1/1 2024-09-17T05:19:52.411 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-17T05:19:52.450 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-17T05:19:52.504 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-17T05:19:52.537 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-17T05:19:52.571 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-17T05:19:52.628 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-17T05:19:53.021 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-17T05:19:53.080 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : librados2-2:19.3.0-4963.g820f760e.el9.x86_64 8/165 2024-09-17T05:19:53.203 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librados2-2:19.3.0-4963.g820f760e.el9.x86_64 8/165 2024-09-17T05:19:53.239 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libcephfs2-2:19.3.0-4963.g820f760e.el9.x86_64 9/165 2024-09-17T05:19:53.331 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libcephfs2-2:19.3.0-4963.g820f760e.el9.x86_64 9/165 2024-09-17T05:19:53.377 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rados-2:19.3.0-4963.g820f760e.el9.x86_64 10/165 2024-09-17T05:19:53.416 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-17T05:19:53.589 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-17T05:19:53.650 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-17T05:19:53.678 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libcephsqlite-2:19.3.0-4963.g820f760e.el9.x86_64 14/165 2024-09-17T05:19:53.783 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4963.g820f760e.el9.x86_64 14/165 2024-09-17T05:19:53.821 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libradosstriper1-2:19.3.0-4963.g820f760e.el9.x86 15/165 2024-09-17T05:19:53.884 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4963.g820f760e.el9.x86 15/165 2024-09-17T05:19:53.914 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-17T05:19:53.934 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-17T05:19:54.083 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-17T05:19:54.251 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-17T05:19:54.371 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-17T05:19:54.485 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T05:19:54.556 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T05:19:54.781 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T05:19:54.895 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-17T05:19:54.928 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-17T05:19:54.962 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-17T05:19:55.035 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-17T05:19:55.089 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-17T05:19:55.129 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-17T05:19:55.172 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-17T05:19:55.208 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-17T05:19:55.249 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-17T05:19:55.318 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-17T05:19:55.380 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-17T05:19:55.420 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-17T05:19:55.463 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-17T05:19:55.545 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-17T05:19:55.591 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-ceph-common-2:19.3.0-4963.g820f760e.el9. 34/165 2024-09-17T05:19:55.634 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-ceph-argparse-2:19.3.0-4963.g820f760e.el 35/165 2024-09-17T05:19:55.663 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cephfs-2:19.3.0-4963.g820f760e.el9.x86_6 36/165 2024-09-17T05:19:55.732 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-17T05:19:55.778 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-17T05:19:55.861 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-17T05:19:56.005 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-17T05:19:56.063 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-17T05:19:56.593 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-17T05:19:56.686 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-17T05:19:56.714 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-17T05:19:56.757 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-17T05:19:56.795 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librados-devel-2:19.3.0-4963.g820f760e.el9.x86_6 46/165 2024-09-17T05:19:56.846 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-17T05:19:56.992 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-17T05:19:57.056 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-17T05:19:57.149 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-17T05:19:57.222 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-17T05:19:57.303 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-17T05:19:57.334 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-17T05:19:57.370 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-17T05:19:57.417 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-17T05:19:57.453 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-17T05:19:57.496 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-17T05:19:57.538 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-17T05:19:57.589 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-17T05:19:57.677 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-17T05:19:57.685 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-17T05:19:57.731 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-17T05:19:57.812 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-17T05:19:57.851 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-17T05:19:57.877 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-17T05:19:57.895 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-17T05:19:57.931 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-17T05:19:57.936 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-17T05:19:58.042 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-17T05:19:58.094 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-17T05:19:58.144 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-17T05:19:58.176 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-17T05:19:58.201 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-17T05:19:58.265 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-17T05:19:58.301 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-17T05:19:58.373 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : librados2-2:19.3.0-4963.g820f760e.el9.x86_64 8/165 2024-09-17T05:19:58.429 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-17T05:19:58.476 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-17T05:19:58.486 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librados2-2:19.3.0-4963.g820f760e.el9.x86_64 8/165 2024-09-17T05:19:58.513 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-17T05:19:58.516 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcephfs2-2:19.3.0-4963.g820f760e.el9.x86_64 9/165 2024-09-17T05:19:58.546 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-17T05:19:58.586 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-17T05:19:58.592 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libcephfs2-2:19.3.0-4963.g820f760e.el9.x86_64 9/165 2024-09-17T05:19:58.621 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rados-2:19.3.0-4963.g820f760e.el9.x86_64 10/165 2024-09-17T05:19:58.651 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-17T05:19:58.651 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-17T05:19:58.689 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-17T05:19:58.725 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-17T05:19:58.759 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-17T05:19:58.800 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-17T05:19:58.823 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-17T05:19:58.835 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-17T05:19:58.876 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-17T05:19:58.905 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcephsqlite-2:19.3.0-4963.g820f760e.el9.x86_64 14/165 2024-09-17T05:19:58.922 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-17T05:19:58.965 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-17T05:19:58.996 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-17T05:19:59.008 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4963.g820f760e.el9.x86_64 14/165 2024-09-17T05:19:59.030 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libradosstriper1-2:19.3.0-4963.g820f760e.el9.x86 15/165 2024-09-17T05:19:59.093 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4963.g820f760e.el9.x86 15/165 2024-09-17T05:19:59.106 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-17T05:19:59.115 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-17T05:19:59.139 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-17T05:19:59.162 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-17T05:19:59.330 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-17T05:19:59.496 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-17T05:19:59.605 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-17T05:19:59.711 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T05:19:59.790 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T05:19:59.995 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-17T05:20:00.019 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T05:20:00.051 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-17T05:20:00.093 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-17T05:20:00.126 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-17T05:20:00.153 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-17T05:20:00.188 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-17T05:20:00.191 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-17T05:20:00.240 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-17T05:20:00.261 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-17T05:20:00.284 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-17T05:20:00.305 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-17T05:20:00.338 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-17T05:20:00.372 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-17T05:20:00.381 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-17T05:20:00.414 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-17T05:20:00.421 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-17T05:20:00.450 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-17T05:20:00.519 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-17T05:20:00.580 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-17T05:20:00.607 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-17T05:20:00.612 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-17T05:20:00.644 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-17T05:20:00.655 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-17T05:20:00.731 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-17T05:20:00.736 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-17T05:20:00.774 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-ceph-common-2:19.3.0-4963.g820f760e.el9. 34/165 2024-09-17T05:20:00.818 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-ceph-argparse-2:19.3.0-4963.g820f760e.el 35/165 2024-09-17T05:20:00.846 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cephfs-2:19.3.0-4963.g820f760e.el9.x86_6 36/165 2024-09-17T05:20:00.914 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-17T05:20:00.960 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-17T05:20:01.042 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-17T05:20:01.183 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-17T05:20:01.237 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-17T05:20:01.390 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-17T05:20:01.510 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-17T05:20:01.757 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-17T05:20:01.841 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-17T05:20:01.871 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-17T05:20:01.914 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-17T05:20:01.952 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librados-devel-2:19.3.0-4963.g820f760e.el9.x86_6 46/165 2024-09-17T05:20:01.994 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-17T05:20:02.163 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-17T05:20:02.230 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-17T05:20:02.329 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-17T05:20:02.393 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-17T05:20:02.467 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-17T05:20:02.498 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-17T05:20:02.535 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-17T05:20:02.581 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-17T05:20:02.618 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-17T05:20:02.660 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-17T05:20:02.702 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-17T05:20:02.813 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-17T05:20:02.836 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-17T05:20:02.880 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-17T05:20:02.916 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-17T05:20:02.920 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-17T05:20:02.944 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-17T05:20:02.977 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-17T05:20:03.022 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-17T05:20:03.221 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-17T05:20:03.309 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-17T05:20:03.398 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-17T05:20:03.428 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-17T05:20:03.453 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-17T05:20:03.557 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-17T05:20:03.557 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : librbd1-2:19.3.0-4963.g820f760e.el9.x86_64 102/165 2024-09-17T05:20:03.656 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librbd1-2:19.3.0-4963.g820f760e.el9.x86_64 102/165 2024-09-17T05:20:03.684 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-17T05:20:03.687 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rbd-2:19.3.0-4963.g820f760e.el9.x86_64 103/165 2024-09-17T05:20:03.724 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-17T05:20:03.727 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-17T05:20:03.756 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-17T05:20:03.789 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-17T05:20:03.837 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-17T05:20:03.868 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-17T05:20:03.899 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-17T05:20:03.933 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-17T05:20:03.966 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-17T05:20:04.007 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-17T05:20:04.046 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-17T05:20:04.132 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-17T05:20:04.176 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-17T05:20:04.208 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-17T05:20:04.215 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-17T05:20:04.260 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librgw2-2:19.3.0-4963.g820f760e.el9.x86_64 106/165 2024-09-17T05:20:04.311 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-17T05:20:04.331 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librgw2-2:19.3.0-4963.g820f760e.el9.x86_64 106/165 2024-09-17T05:20:04.359 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-17T05:20:04.362 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rgw-2:19.3.0-4963.g820f760e.el9.x86_64 107/165 2024-09-17T05:20:05.072 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-17T05:20:05.131 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-17T05:20:05.165 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-17T05:20:05.264 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-17T05:20:05.312 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-17T05:20:05.356 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-17T05:20:05.445 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-17T05:20:05.493 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-17T05:20:05.681 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-17T05:20:05.715 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-17T05:20:05.793 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-17T05:20:06.446 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-17T05:20:06.569 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-17T05:20:06.638 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-common-2:19.3.0-4963.g820f760e.el9.x86_64 108/165 2024-09-17T05:20:06.675 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-common-2:19.3.0-4963.g820f760e.el9.x86_64 108/165 2024-09-17T05:20:07.246 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-common-2:19.3.0-4963.g820f760e.el9.x86_64 108/165 2024-09-17T05:20:07.287 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-base-2:19.3.0-4963.g820f760e.el9.x86_64 109/165 2024-09-17T05:20:07.388 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-base-2:19.3.0-4963.g820f760e.el9.x86_64 109/165 2024-09-17T05:20:07.388 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-17T05:20:07.388 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-17T05:20:07.388 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T05:20:07.422 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-selinux-2:19.3.0-4963.g820f760e.el9.x86_64 110/165 2024-09-17T05:20:07.801 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-17T05:20:07.892 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-17T05:20:07.920 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-17T05:20:07.953 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-17T05:20:08.276 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-17T05:20:08.316 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : librbd1-2:19.3.0-4963.g820f760e.el9.x86_64 102/165 2024-09-17T05:20:08.398 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librbd1-2:19.3.0-4963.g820f760e.el9.x86_64 102/165 2024-09-17T05:20:08.430 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rbd-2:19.3.0-4963.g820f760e.el9.x86_64 103/165 2024-09-17T05:20:08.474 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-17T05:20:08.958 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-17T05:20:08.986 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librgw2-2:19.3.0-4963.g820f760e.el9.x86_64 106/165 2024-09-17T05:20:09.049 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librgw2-2:19.3.0-4963.g820f760e.el9.x86_64 106/165 2024-09-17T05:20:09.080 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rgw-2:19.3.0-4963.g820f760e.el9.x86_64 107/165 2024-09-17T05:20:11.419 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-common-2:19.3.0-4963.g820f760e.el9.x86_64 108/165 2024-09-17T05:20:11.460 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-common-2:19.3.0-4963.g820f760e.el9.x86_64 108/165 2024-09-17T05:20:12.019 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-common-2:19.3.0-4963.g820f760e.el9.x86_64 108/165 2024-09-17T05:20:12.055 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-base-2:19.3.0-4963.g820f760e.el9.x86_64 109/165 2024-09-17T05:20:12.148 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-base-2:19.3.0-4963.g820f760e.el9.x86_64 109/165 2024-09-17T05:20:12.148 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-17T05:20:12.148 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-17T05:20:12.148 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:20:12.189 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-selinux-2:19.3.0-4963.g820f760e.el9.x86_64 110/165 2024-09-17T05:20:19.283 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4963.g820f760e.el9.x86_64 110/165 2024-09-17T05:20:19.283 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /sys 2024-09-17T05:20:19.283 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /proc 2024-09-17T05:20:19.283 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /mnt 2024-09-17T05:20:19.283 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /var/tmp 2024-09-17T05:20:19.284 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /home 2024-09-17T05:20:19.284 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /root 2024-09-17T05:20:19.284 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /tmp 2024-09-17T05:20:19.284 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T05:20:19.455 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-volume-2:19.3.0-4963.g820f760e.el9.noarch 111/165 2024-09-17T05:20:19.472 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-volume-2:19.3.0-4963.g820f760e.el9.noarch 111/165 2024-09-17T05:20:19.472 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T05:20:19.472 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-17T05:20:19.472 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T05:20:20.983 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-osd-2:19.3.0-4963.g820f760e.el9.x86_64 112/165 2024-09-17T05:20:21.012 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-osd-2:19.3.0-4963.g820f760e.el9.x86_64 112/165 2024-09-17T05:20:21.012 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T05:20:21.012 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-17T05:20:21.013 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T05:20:21.013 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T05:20:21.013 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T05:20:21.242 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mds-2:19.3.0-4963.g820f760e.el9.x86_64 113/165 2024-09-17T05:20:21.266 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mds-2:19.3.0-4963.g820f760e.el9.x86_64 113/165 2024-09-17T05:20:21.266 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T05:20:21.266 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-17T05:20:21.266 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T05:20:21.266 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T05:20:21.266 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T05:20:21.718 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mon-2:19.3.0-4963.g820f760e.el9.x86_64 114/165 2024-09-17T05:20:21.742 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mon-2:19.3.0-4963.g820f760e.el9.x86_64 114/165 2024-09-17T05:20:21.742 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T05:20:21.742 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-17T05:20:21.742 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T05:20:21.742 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T05:20:21.742 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T05:20:21.848 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-17T05:20:21.905 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-17T05:20:21.961 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-17T05:20:22.158 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-17T05:20:22.203 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-17T05:20:22.281 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-17T05:20:22.371 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-17T05:20:22.518 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-17T05:20:22.562 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-17T05:20:22.593 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-17T05:20:22.621 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-17T05:20:23.073 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: cephadm-2:19.3.0-4963.g820f760e.el9.noarch 126/165 2024-09-17T05:20:23.103 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : cephadm-2:19.3.0-4963.g820f760e.el9.noarch 126/165 2024-09-17T05:20:23.127 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4963.g820f760e.e 127/165 2024-09-17T05:20:23.186 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4963.g820f760e. 128/165 2024-09-17T05:20:23.210 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4963.g820f760e.el9.noa 129/165 2024-09-17T05:20:23.883 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4963.g820f760e.el9.x86_64 110/165 2024-09-17T05:20:23.884 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /sys 2024-09-17T05:20:23.884 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /proc 2024-09-17T05:20:23.884 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /mnt 2024-09-17T05:20:23.884 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /var/tmp 2024-09-17T05:20:23.884 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /home 2024-09-17T05:20:23.884 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /root 2024-09-17T05:20:23.884 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /tmp 2024-09-17T05:20:23.884 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:20:24.070 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-volume-2:19.3.0-4963.g820f760e.el9.noarch 111/165 2024-09-17T05:20:24.086 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-volume-2:19.3.0-4963.g820f760e.el9.noarch 111/165 2024-09-17T05:20:24.086 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T05:20:24.086 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-17T05:20:24.086 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:20:25.590 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-osd-2:19.3.0-4963.g820f760e.el9.x86_64 112/165 2024-09-17T05:20:25.616 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-osd-2:19.3.0-4963.g820f760e.el9.x86_64 112/165 2024-09-17T05:20:25.616 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T05:20:25.617 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-17T05:20:25.617 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T05:20:25.617 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T05:20:25.617 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:20:25.840 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mds-2:19.3.0-4963.g820f760e.el9.x86_64 113/165 2024-09-17T05:20:25.864 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mds-2:19.3.0-4963.g820f760e.el9.x86_64 113/165 2024-09-17T05:20:25.864 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T05:20:25.864 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-17T05:20:25.864 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T05:20:25.864 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T05:20:25.864 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:20:26.307 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mon-2:19.3.0-4963.g820f760e.el9.x86_64 114/165 2024-09-17T05:20:26.331 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mon-2:19.3.0-4963.g820f760e.el9.x86_64 114/165 2024-09-17T05:20:26.331 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T05:20:26.331 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-17T05:20:26.331 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T05:20:26.331 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T05:20:26.331 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:20:26.386 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4963.g820f760e.el9.noa 129/165 2024-09-17T05:20:26.438 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-17T05:20:26.450 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4963.g820f760e.el9.n 130/165 2024-09-17T05:20:26.495 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-17T05:20:26.550 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-17T05:20:26.736 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-17T05:20:26.783 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-17T05:20:26.861 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-17T05:20:26.950 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-17T05:20:27.089 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-17T05:20:27.135 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-17T05:20:27.166 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-17T05:20:27.194 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-17T05:20:27.413 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4963.g820f760e.el9.n 130/165 2024-09-17T05:20:27.442 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4963.g820 131/165 2024-09-17T05:20:27.558 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4963.g820 131/165 2024-09-17T05:20:27.621 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: cephadm-2:19.3.0-4963.g820f760e.el9.noarch 126/165 2024-09-17T05:20:27.651 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : cephadm-2:19.3.0-4963.g820f760e.el9.noarch 126/165 2024-09-17T05:20:27.683 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4963.g820f760e.e 127/165 2024-09-17T05:20:27.731 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4963.g820f760e.el 132/165 2024-09-17T05:20:27.749 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4963.g820f760e. 128/165 2024-09-17T05:20:27.760 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-2:19.3.0-4963.g820f760e.el9.x86_64 133/165 2024-09-17T05:20:27.782 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4963.g820f760e.el9.noa 129/165 2024-09-17T05:20:27.784 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4963.g820f760e.el9.x86_64 133/165 2024-09-17T05:20:27.784 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T05:20:27.784 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-17T05:20:27.785 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T05:20:27.785 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T05:20:27.785 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T05:20:27.836 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-rook-2:19.3.0-4963.g820f760e.el9.noarch 134/165 2024-09-17T05:20:27.848 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4963.g820f760e.el9.noarch 134/165 2024-09-17T05:20:27.938 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-2:19.3.0-4963.g820f760e.el9.x86_64 135/165 2024-09-17T05:20:27.990 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-fuse-2:19.3.0-4963.g820f760e.el9.x86_64 136/165 2024-09-17T05:20:28.946 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-17T05:20:28.972 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-radosgw-2:19.3.0-4963.g820f760e.el9.x86_64 138/165 2024-09-17T05:20:28.996 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4963.g820f760e.el9.x86_64 138/165 2024-09-17T05:20:28.997 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T05:20:28.997 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-17T05:20:28.997 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T05:20:28.997 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T05:20:28.997 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T05:20:29.039 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4963.g820f7 139/165 2024-09-17T05:20:29.063 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4963.g820f7 139/165 2024-09-17T05:20:29.063 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T05:20:29.063 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-17T05:20:29.063 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T05:20:29.107 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : cephfs-mirror-2:19.3.0-4963.g820f760e.el9.x86_64 140/165 2024-09-17T05:20:29.130 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4963.g820f760e.el9.x86_64 140/165 2024-09-17T05:20:29.130 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T05:20:29.130 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-17T05:20:29.130 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-17T05:20:29.130 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-17T05:20:29.131 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T05:20:29.441 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : rbd-mirror-2:19.3.0-4963.g820f760e.el9.x86_64 141/165 2024-09-17T05:20:29.465 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4963.g820f760e.el9.x86_64 141/165 2024-09-17T05:20:29.465 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T05:20:29.466 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-17T05:20:29.466 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T05:20:29.466 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T05:20:29.466 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T05:20:30.978 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4963.g820f760e.el9.noa 129/165 2024-09-17T05:20:31.039 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4963.g820f760e.el9.n 130/165 2024-09-17T05:20:32.004 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4963.g820f760e.el9.n 130/165 2024-09-17T05:20:32.031 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4963.g820 131/165 2024-09-17T05:20:32.143 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4963.g820 131/165 2024-09-17T05:20:32.319 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4963.g820f760e.el 132/165 2024-09-17T05:20:32.350 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-2:19.3.0-4963.g820f760e.el9.x86_64 133/165 2024-09-17T05:20:32.373 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4963.g820f760e.el9.x86_64 133/165 2024-09-17T05:20:32.374 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T05:20:32.374 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-17T05:20:32.374 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T05:20:32.374 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T05:20:32.374 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:20:32.417 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-rook-2:19.3.0-4963.g820f760e.el9.noarch 134/165 2024-09-17T05:20:32.429 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4963.g820f760e.el9.noarch 134/165 2024-09-17T05:20:32.526 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-2:19.3.0-4963.g820f760e.el9.x86_64 135/165 2024-09-17T05:20:32.590 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-fuse-2:19.3.0-4963.g820f760e.el9.x86_64 136/165 2024-09-17T05:20:33.539 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-17T05:20:33.570 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-radosgw-2:19.3.0-4963.g820f760e.el9.x86_64 138/165 2024-09-17T05:20:33.594 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4963.g820f760e.el9.x86_64 138/165 2024-09-17T05:20:33.594 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T05:20:33.594 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-17T05:20:33.594 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T05:20:33.594 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T05:20:33.594 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:20:33.637 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4963.g820f7 139/165 2024-09-17T05:20:33.660 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4963.g820f7 139/165 2024-09-17T05:20:33.660 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T05:20:33.660 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-17T05:20:33.660 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:20:33.704 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : cephfs-mirror-2:19.3.0-4963.g820f760e.el9.x86_64 140/165 2024-09-17T05:20:33.727 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4963.g820f760e.el9.x86_64 140/165 2024-09-17T05:20:33.727 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T05:20:33.727 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-17T05:20:33.727 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-17T05:20:33.728 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-17T05:20:33.728 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:20:33.795 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-test-2:19.3.0-4963.g820f760e.el9.x86_64 142/165 2024-09-17T05:20:33.845 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : rbd-fuse-2:19.3.0-4963.g820f760e.el9.x86_64 143/165 2024-09-17T05:20:33.886 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : rbd-nbd-2:19.3.0-4963.g820f760e.el9.x86_64 144/165 2024-09-17T05:20:33.928 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-17T05:20:33.954 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-17T05:20:34.038 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : rbd-mirror-2:19.3.0-4963.g820f760e.el9.x86_64 141/165 2024-09-17T05:20:34.061 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4963.g820f760e.el9.x86_64 141/165 2024-09-17T05:20:34.062 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T05:20:34.062 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-17T05:20:34.062 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T05:20:34.062 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T05:20:34.062 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:20:34.153 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : cephfs-shell-2:19.3.0-4963.g820f760e.el9.x86_64 147/165 2024-09-17T05:20:34.201 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-17T05:20:34.232 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libcephfs-devel-2:19.3.0-4963.g820f760e.el9.x86_ 149/165 2024-09-17T05:20:34.262 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-17T05:20:34.307 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-17T05:20:34.913 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T05:20:34.947 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T05:20:34.968 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T05:20:35.812 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : cephfs-top-2:19.3.0-4963.g820f760e.el9.noarch 153/165 2024-09-17T05:20:35.895 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-17T05:20:35.968 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-17T05:20:36.068 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-17T05:20:36.099 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-17T05:20:36.124 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-17T05:20:36.158 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-17T05:20:36.158 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-17T05:20:36.234 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-17T05:20:36.234 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-17T05:20:36.319 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-17T05:20:36.343 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-17T05:20:36.349 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T05:20:36.349 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T05:20:36.528 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T05:20:36.528 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-17T05:20:36.613 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-17T05:20:36.678 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T05:20:38.405 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-test-2:19.3.0-4963.g820f760e.el9.x86_64 142/165 2024-09-17T05:20:38.443 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : rbd-fuse-2:19.3.0-4963.g820f760e.el9.x86_64 143/165 2024-09-17T05:20:38.484 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : rbd-nbd-2:19.3.0-4963.g820f760e.el9.x86_64 144/165 2024-09-17T05:20:38.516 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-17T05:20:38.543 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-17T05:20:38.732 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : cephfs-shell-2:19.3.0-4963.g820f760e.el9.x86_64 147/165 2024-09-17T05:20:38.790 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-17T05:20:38.820 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcephfs-devel-2:19.3.0-4963.g820f760e.el9.x86_ 149/165 2024-09-17T05:20:38.850 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-17T05:20:38.901 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-17T05:20:39.484 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T05:20:39.528 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T05:20:39.549 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T05:20:40.380 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : cephfs-top-2:19.3.0-4963.g820f760e.el9.noarch 153/165 2024-09-17T05:20:40.474 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-17T05:20:40.529 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-17T05:20:40.617 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-17T05:20:40.653 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-17T05:20:40.678 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-17T05:20:40.712 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-17T05:20:40.712 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-17T05:20:40.797 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-17T05:20:40.797 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-17T05:20:40.881 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-17T05:20:40.906 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-17T05:20:40.911 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T05:20:40.911 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T05:20:41.092 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T05:20:41.093 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-17T05:20:41.175 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-17T05:20:41.248 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T05:20:43.021 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T05:20:43.021 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-2:19.3.0-4963.g820f760e.el9.x86_64 1/165 2024-09-17T05:20:43.022 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-base-2:19.3.0-4963.g820f760e.el9.x86_64 2/165 2024-09-17T05:20:43.022 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-common-2:19.3.0-4963.g820f760e.el9.x86_64 3/165 2024-09-17T05:20:43.022 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-fuse-2:19.3.0-4963.g820f760e.el9.x86_64 4/165 2024-09-17T05:20:43.022 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4963.g820f7 5/165 2024-09-17T05:20:43.022 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mds-2:19.3.0-4963.g820f760e.el9.x86_64 6/165 2024-09-17T05:20:43.022 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-2:19.3.0-4963.g820f760e.el9.x86_64 7/165 2024-09-17T05:20:43.022 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mon-2:19.3.0-4963.g820f760e.el9.x86_64 8/165 2024-09-17T05:20:43.022 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-osd-2:19.3.0-4963.g820f760e.el9.x86_64 9/165 2024-09-17T05:20:43.022 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-radosgw-2:19.3.0-4963.g820f760e.el9.x86_64 10/165 2024-09-17T05:20:43.022 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-selinux-2:19.3.0-4963.g820f760e.el9.x86_64 11/165 2024-09-17T05:20:43.022 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-test-2:19.3.0-4963.g820f760e.el9.x86_64 12/165 2024-09-17T05:20:43.022 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : cephfs-mirror-2:19.3.0-4963.g820f760e.el9.x86_64 13/165 2024-09-17T05:20:43.023 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : cephfs-shell-2:19.3.0-4963.g820f760e.el9.x86_64 14/165 2024-09-17T05:20:43.023 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libcephfs-devel-2:19.3.0-4963.g820f760e.el9.x86_ 15/165 2024-09-17T05:20:43.023 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libcephfs2-2:19.3.0-4963.g820f760e.el9.x86_64 16/165 2024-09-17T05:20:43.023 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libcephsqlite-2:19.3.0-4963.g820f760e.el9.x86_64 17/165 2024-09-17T05:20:43.023 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librados-devel-2:19.3.0-4963.g820f760e.el9.x86_6 18/165 2024-09-17T05:20:43.023 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libradosstriper1-2:19.3.0-4963.g820f760e.el9.x86 19/165 2024-09-17T05:20:43.023 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librgw2-2:19.3.0-4963.g820f760e.el9.x86_64 20/165 2024-09-17T05:20:43.023 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4963.g820f760e.el 21/165 2024-09-17T05:20:43.023 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-ceph-common-2:19.3.0-4963.g820f760e.el9. 22/165 2024-09-17T05:20:43.023 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cephfs-2:19.3.0-4963.g820f760e.el9.x86_6 23/165 2024-09-17T05:20:43.023 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rados-2:19.3.0-4963.g820f760e.el9.x86_64 24/165 2024-09-17T05:20:43.023 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rbd-2:19.3.0-4963.g820f760e.el9.x86_64 25/165 2024-09-17T05:20:43.024 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rgw-2:19.3.0-4963.g820f760e.el9.x86_64 26/165 2024-09-17T05:20:43.024 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : rbd-fuse-2:19.3.0-4963.g820f760e.el9.x86_64 27/165 2024-09-17T05:20:43.035 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : rbd-mirror-2:19.3.0-4963.g820f760e.el9.x86_64 28/165 2024-09-17T05:20:43.036 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : rbd-nbd-2:19.3.0-4963.g820f760e.el9.x86_64 29/165 2024-09-17T05:20:43.036 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4963.g820f760e. 30/165 2024-09-17T05:20:43.036 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4963.g820f760e.el9.noa 31/165 2024-09-17T05:20:43.036 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4963.g820f760e.el9.n 32/165 2024-09-17T05:20:43.036 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4963.g820 33/165 2024-09-17T05:20:43.036 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4963.g820f760e.el 34/165 2024-09-17T05:20:43.036 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4963.g820f760e.el9.noarch 35/165 2024-09-17T05:20:43.036 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4963.g820f760e.e 36/165 2024-09-17T05:20:43.036 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-volume-2:19.3.0-4963.g820f760e.el9.noarch 37/165 2024-09-17T05:20:43.036 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : cephadm-2:19.3.0-4963.g820f760e.el9.noarch 38/165 2024-09-17T05:20:43.036 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : cephfs-top-2:19.3.0-4963.g820f760e.el9.noarch 39/165 2024-09-17T05:20:43.036 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-17T05:20:43.037 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-17T05:20:43.037 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-17T05:20:43.037 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-17T05:20:43.037 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-17T05:20:43.037 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-17T05:20:43.037 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-17T05:20:43.037 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-17T05:20:43.037 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-17T05:20:43.037 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-17T05:20:43.037 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-17T05:20:43.037 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-17T05:20:43.037 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-17T05:20:43.038 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-17T05:20:43.038 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-17T05:20:43.038 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-17T05:20:43.038 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-17T05:20:43.038 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-17T05:20:43.038 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-17T05:20:43.038 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-17T05:20:43.038 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-17T05:20:43.038 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-17T05:20:43.038 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-17T05:20:43.038 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-17T05:20:43.038 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-17T05:20:43.038 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-17T05:20:43.039 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-17T05:20:43.039 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-17T05:20:43.039 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-17T05:20:43.039 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-17T05:20:43.039 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-17T05:20:43.039 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-17T05:20:43.039 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-17T05:20:43.039 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-17T05:20:43.039 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-17T05:20:43.039 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-17T05:20:43.039 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-17T05:20:43.039 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-17T05:20:43.039 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-17T05:20:43.040 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-17T05:20:43.040 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-17T05:20:43.040 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-17T05:20:43.040 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-17T05:20:43.040 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-17T05:20:43.040 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-17T05:20:43.040 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-17T05:20:43.040 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-17T05:20:43.040 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-17T05:20:43.040 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-17T05:20:43.040 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-17T05:20:43.040 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-17T05:20:43.040 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-17T05:20:43.041 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-17T05:20:43.041 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-17T05:20:43.041 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-17T05:20:43.041 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-17T05:20:43.041 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-17T05:20:43.041 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-17T05:20:43.041 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-17T05:20:43.041 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-17T05:20:43.041 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-17T05:20:43.041 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-17T05:20:43.041 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-17T05:20:43.041 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-17T05:20:43.042 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-17T05:20:43.042 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-17T05:20:43.042 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-17T05:20:43.042 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-17T05:20:43.042 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-17T05:20:43.042 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-17T05:20:43.042 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-17T05:20:43.042 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-17T05:20:43.042 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-17T05:20:43.042 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-17T05:20:43.042 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-17T05:20:43.042 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-17T05:20:43.042 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-17T05:20:43.043 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-17T05:20:43.043 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-17T05:20:43.043 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-17T05:20:43.043 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-17T05:20:43.043 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-17T05:20:43.043 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-17T05:20:43.043 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-17T05:20:43.043 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-17T05:20:43.043 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-17T05:20:43.043 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-17T05:20:43.043 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-17T05:20:43.043 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-17T05:20:43.043 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-17T05:20:43.044 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-17T05:20:43.044 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-17T05:20:43.044 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-17T05:20:43.044 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-17T05:20:43.044 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-17T05:20:43.044 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-17T05:20:43.044 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-17T05:20:43.044 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-17T05:20:43.044 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-17T05:20:43.044 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-17T05:20:43.044 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-17T05:20:43.044 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-17T05:20:43.044 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-17T05:20:43.045 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-17T05:20:43.045 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-17T05:20:43.045 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-17T05:20:43.045 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-17T05:20:43.045 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-17T05:20:43.045 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-17T05:20:43.045 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-17T05:20:43.045 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librados2-2:19.3.0-4963.g820f760e.el9.x86_64 150/165 2024-09-17T05:20:43.045 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-17T05:20:43.045 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librbd1-2:19.3.0-4963.g820f760e.el9.x86_64 152/165 2024-09-17T05:20:43.045 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-17T05:20:43.045 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-17T05:20:43.045 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-17T05:20:43.046 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-17T05:20:43.046 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-17T05:20:43.046 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-17T05:20:43.046 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-17T05:20:43.046 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-17T05:20:43.046 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-17T05:20:43.046 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-17T05:20:43.046 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-17T05:20:43.046 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-17T05:20:45.670 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T05:20:45.670 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T05:20:45.670 INFO:teuthology.orchestra.run.smithi167.stdout:Upgraded: 2024-09-17T05:20:45.670 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-17T05:20:45.670 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-17T05:20:45.670 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-17T05:20:45.670 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-17T05:20:45.670 INFO:teuthology.orchestra.run.smithi167.stdout: librados2-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:45.671 INFO:teuthology.orchestra.run.smithi167.stdout: librbd1-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:45.671 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-17T05:20:45.671 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-17T05:20:45.671 INFO:teuthology.orchestra.run.smithi167.stdout:Installed: 2024-09-17T05:20:45.671 INFO:teuthology.orchestra.run.smithi167.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-17T05:20:45.671 INFO:teuthology.orchestra.run.smithi167.stdout: automake-1.16.2-8.el9.noarch 2024-09-17T05:20:45.671 INFO:teuthology.orchestra.run.smithi167.stdout: bison-3.7.4-5.el9.x86_64 2024-09-17T05:20:45.671 INFO:teuthology.orchestra.run.smithi167.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-17T05:20:45.671 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:45.671 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-base-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:45.671 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-common-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:45.671 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-fuse-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:45.672 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-grafana-dashboards-2:19.3.0-4963.g820f760e.el9.noarch 2024-09-17T05:20:45.672 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-immutable-object-cache-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:45.672 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mds-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:45.672 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:45.672 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-cephadm-2:19.3.0-4963.g820f760e.el9.noarch 2024-09-17T05:20:45.672 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-dashboard-2:19.3.0-4963.g820f760e.el9.noarch 2024-09-17T05:20:45.672 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4963.g820f760e.el9.noarch 2024-09-17T05:20:45.672 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-modules-core-2:19.3.0-4963.g820f760e.el9.noarch 2024-09-17T05:20:45.672 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-rook-2:19.3.0-4963.g820f760e.el9.noarch 2024-09-17T05:20:45.672 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mon-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:45.672 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-osd-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:45.672 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-prometheus-alerts-2:19.3.0-4963.g820f760e.el9.noarch 2024-09-17T05:20:45.672 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-radosgw-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:45.673 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-selinux-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:45.673 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-test-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:45.673 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-volume-2:19.3.0-4963.g820f760e.el9.noarch 2024-09-17T05:20:45.673 INFO:teuthology.orchestra.run.smithi167.stdout: cephadm-2:19.3.0-4963.g820f760e.el9.noarch 2024-09-17T05:20:45.673 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-mirror-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:45.673 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-shell-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:45.673 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-top-2:19.3.0-4963.g820f760e.el9.noarch 2024-09-17T05:20:45.673 INFO:teuthology.orchestra.run.smithi167.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-17T05:20:45.673 INFO:teuthology.orchestra.run.smithi167.stdout: flex-2.6.4-9.el9.x86_64 2024-09-17T05:20:45.673 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-17T05:20:45.673 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-17T05:20:45.673 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-17T05:20:45.674 INFO:teuthology.orchestra.run.smithi167.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-17T05:20:45.674 INFO:teuthology.orchestra.run.smithi167.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-17T05:20:45.674 INFO:teuthology.orchestra.run.smithi167.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-17T05:20:45.674 INFO:teuthology.orchestra.run.smithi167.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-17T05:20:45.674 INFO:teuthology.orchestra.run.smithi167.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-17T05:20:45.674 INFO:teuthology.orchestra.run.smithi167.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-17T05:20:45.674 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs-devel-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:45.674 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs2-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:45.674 INFO:teuthology.orchestra.run.smithi167.stdout: libcephsqlite-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:45.674 INFO:teuthology.orchestra.run.smithi167.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-17T05:20:45.674 INFO:teuthology.orchestra.run.smithi167.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-17T05:20:45.675 INFO:teuthology.orchestra.run.smithi167.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-17T05:20:45.675 INFO:teuthology.orchestra.run.smithi167.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-17T05:20:45.675 INFO:teuthology.orchestra.run.smithi167.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-17T05:20:45.675 INFO:teuthology.orchestra.run.smithi167.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-17T05:20:45.675 INFO:teuthology.orchestra.run.smithi167.stdout: librados-devel-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:45.675 INFO:teuthology.orchestra.run.smithi167.stdout: libradosstriper1-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:45.675 INFO:teuthology.orchestra.run.smithi167.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-17T05:20:45.675 INFO:teuthology.orchestra.run.smithi167.stdout: librgw2-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:45.675 INFO:teuthology.orchestra.run.smithi167.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-17T05:20:45.675 INFO:teuthology.orchestra.run.smithi167.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-17T05:20:45.675 INFO:teuthology.orchestra.run.smithi167.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-17T05:20:45.675 INFO:teuthology.orchestra.run.smithi167.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-17T05:20:45.676 INFO:teuthology.orchestra.run.smithi167.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-17T05:20:45.676 INFO:teuthology.orchestra.run.smithi167.stdout: lua-5.4.4-4.el9.x86_64 2024-09-17T05:20:45.676 INFO:teuthology.orchestra.run.smithi167.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-17T05:20:45.676 INFO:teuthology.orchestra.run.smithi167.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-17T05:20:45.676 INFO:teuthology.orchestra.run.smithi167.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-17T05:20:45.676 INFO:teuthology.orchestra.run.smithi167.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-17T05:20:45.676 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-17T05:20:45.676 INFO:teuthology.orchestra.run.smithi167.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-17T05:20:45.676 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-13.16-1.el9.x86_64 2024-09-17T05:20:45.676 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-17T05:20:45.676 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-17T05:20:45.676 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-17T05:20:45.676 INFO:teuthology.orchestra.run.smithi167.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-17T05:20:45.677 INFO:teuthology.orchestra.run.smithi167.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-17T05:20:45.677 INFO:teuthology.orchestra.run.smithi167.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-17T05:20:45.677 INFO:teuthology.orchestra.run.smithi167.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-17T05:20:45.677 INFO:teuthology.orchestra.run.smithi167.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-17T05:20:45.677 INFO:teuthology.orchestra.run.smithi167.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-17T05:20:45.677 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-17T05:20:45.677 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-argparse-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:45.677 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-common-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:45.677 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cephfs-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:45.677 INFO:teuthology.orchestra.run.smithi167.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-17T05:20:45.677 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-17T05:20:45.677 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-17T05:20:45.678 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-17T05:20:45.678 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-17T05:20:45.678 INFO:teuthology.orchestra.run.smithi167.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-17T05:20:45.678 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-17T05:20:45.678 INFO:teuthology.orchestra.run.smithi167.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-17T05:20:45.678 INFO:teuthology.orchestra.run.smithi167.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-17T05:20:45.678 INFO:teuthology.orchestra.run.smithi167.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-17T05:20:45.678 INFO:teuthology.orchestra.run.smithi167.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-17T05:20:45.678 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-17T05:20:45.678 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-17T05:20:45.678 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-17T05:20:45.678 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-17T05:20:45.678 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-17T05:20:45.679 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-17T05:20:45.679 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-17T05:20:45.679 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-17T05:20:45.679 INFO:teuthology.orchestra.run.smithi167.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-17T05:20:45.679 INFO:teuthology.orchestra.run.smithi167.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-17T05:20:45.679 INFO:teuthology.orchestra.run.smithi167.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-17T05:20:45.679 INFO:teuthology.orchestra.run.smithi167.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-17T05:20:45.679 INFO:teuthology.orchestra.run.smithi167.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-17T05:20:45.679 INFO:teuthology.orchestra.run.smithi167.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-17T05:20:45.679 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-17T05:20:45.679 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-17T05:20:45.679 INFO:teuthology.orchestra.run.smithi167.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-17T05:20:45.679 INFO:teuthology.orchestra.run.smithi167.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-17T05:20:45.679 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-17T05:20:45.680 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ply-3.11-14.el9.noarch 2024-09-17T05:20:45.680 INFO:teuthology.orchestra.run.smithi167.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-17T05:20:45.680 INFO:teuthology.orchestra.run.smithi167.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-17T05:20:45.680 INFO:teuthology.orchestra.run.smithi167.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-17T05:20:45.680 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-17T05:20:45.680 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-17T05:20:45.680 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-17T05:20:45.680 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-17T05:20:45.680 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-17T05:20:45.680 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-17T05:20:45.680 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rados-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:45.680 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rbd-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:45.680 INFO:teuthology.orchestra.run.smithi167.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-17T05:20:45.681 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-17T05:20:45.681 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-17T05:20:45.681 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rgw-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:45.681 INFO:teuthology.orchestra.run.smithi167.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-17T05:20:45.681 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-17T05:20:45.681 INFO:teuthology.orchestra.run.smithi167.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-17T05:20:45.681 INFO:teuthology.orchestra.run.smithi167.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-17T05:20:45.681 INFO:teuthology.orchestra.run.smithi167.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-17T05:20:45.681 INFO:teuthology.orchestra.run.smithi167.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-17T05:20:45.681 INFO:teuthology.orchestra.run.smithi167.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-17T05:20:45.681 INFO:teuthology.orchestra.run.smithi167.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-17T05:20:45.681 INFO:teuthology.orchestra.run.smithi167.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-17T05:20:45.681 INFO:teuthology.orchestra.run.smithi167.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-17T05:20:45.682 INFO:teuthology.orchestra.run.smithi167.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-17T05:20:45.682 INFO:teuthology.orchestra.run.smithi167.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-17T05:20:45.682 INFO:teuthology.orchestra.run.smithi167.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-17T05:20:45.682 INFO:teuthology.orchestra.run.smithi167.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-17T05:20:45.682 INFO:teuthology.orchestra.run.smithi167.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-17T05:20:45.682 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-fuse-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:45.682 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-mirror-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:45.682 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-nbd-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:45.682 INFO:teuthology.orchestra.run.smithi167.stdout: re2-1:20211101-20.el9.x86_64 2024-09-17T05:20:45.682 INFO:teuthology.orchestra.run.smithi167.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-17T05:20:45.682 INFO:teuthology.orchestra.run.smithi167.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-17T05:20:45.682 INFO:teuthology.orchestra.run.smithi167.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-17T05:20:45.682 INFO:teuthology.orchestra.run.smithi167.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-17T05:20:45.682 INFO:teuthology.orchestra.run.smithi167.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-17T05:20:45.683 INFO:teuthology.orchestra.run.smithi167.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-17T05:20:45.683 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T05:20:45.683 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-17T05:20:46.132 DEBUG:teuthology.parallel:result is None 2024-09-17T05:20:47.241 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T05:20:47.241 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-2:19.3.0-4963.g820f760e.el9.x86_64 1/165 2024-09-17T05:20:47.241 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-base-2:19.3.0-4963.g820f760e.el9.x86_64 2/165 2024-09-17T05:20:47.242 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-common-2:19.3.0-4963.g820f760e.el9.x86_64 3/165 2024-09-17T05:20:47.242 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-fuse-2:19.3.0-4963.g820f760e.el9.x86_64 4/165 2024-09-17T05:20:47.242 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4963.g820f7 5/165 2024-09-17T05:20:47.242 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mds-2:19.3.0-4963.g820f760e.el9.x86_64 6/165 2024-09-17T05:20:47.242 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-2:19.3.0-4963.g820f760e.el9.x86_64 7/165 2024-09-17T05:20:47.242 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mon-2:19.3.0-4963.g820f760e.el9.x86_64 8/165 2024-09-17T05:20:47.242 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-osd-2:19.3.0-4963.g820f760e.el9.x86_64 9/165 2024-09-17T05:20:47.242 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-radosgw-2:19.3.0-4963.g820f760e.el9.x86_64 10/165 2024-09-17T05:20:47.242 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-selinux-2:19.3.0-4963.g820f760e.el9.x86_64 11/165 2024-09-17T05:20:47.242 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-test-2:19.3.0-4963.g820f760e.el9.x86_64 12/165 2024-09-17T05:20:47.242 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : cephfs-mirror-2:19.3.0-4963.g820f760e.el9.x86_64 13/165 2024-09-17T05:20:47.242 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : cephfs-shell-2:19.3.0-4963.g820f760e.el9.x86_64 14/165 2024-09-17T05:20:47.243 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcephfs-devel-2:19.3.0-4963.g820f760e.el9.x86_ 15/165 2024-09-17T05:20:47.243 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcephfs2-2:19.3.0-4963.g820f760e.el9.x86_64 16/165 2024-09-17T05:20:47.243 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcephsqlite-2:19.3.0-4963.g820f760e.el9.x86_64 17/165 2024-09-17T05:20:47.243 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librados-devel-2:19.3.0-4963.g820f760e.el9.x86_6 18/165 2024-09-17T05:20:47.243 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libradosstriper1-2:19.3.0-4963.g820f760e.el9.x86 19/165 2024-09-17T05:20:47.243 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librgw2-2:19.3.0-4963.g820f760e.el9.x86_64 20/165 2024-09-17T05:20:47.243 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4963.g820f760e.el 21/165 2024-09-17T05:20:47.243 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-ceph-common-2:19.3.0-4963.g820f760e.el9. 22/165 2024-09-17T05:20:47.243 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cephfs-2:19.3.0-4963.g820f760e.el9.x86_6 23/165 2024-09-17T05:20:47.243 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rados-2:19.3.0-4963.g820f760e.el9.x86_64 24/165 2024-09-17T05:20:47.243 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rbd-2:19.3.0-4963.g820f760e.el9.x86_64 25/165 2024-09-17T05:20:47.243 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rgw-2:19.3.0-4963.g820f760e.el9.x86_64 26/165 2024-09-17T05:20:47.243 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : rbd-fuse-2:19.3.0-4963.g820f760e.el9.x86_64 27/165 2024-09-17T05:20:47.243 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : rbd-mirror-2:19.3.0-4963.g820f760e.el9.x86_64 28/165 2024-09-17T05:20:47.244 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : rbd-nbd-2:19.3.0-4963.g820f760e.el9.x86_64 29/165 2024-09-17T05:20:47.244 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4963.g820f760e. 30/165 2024-09-17T05:20:47.244 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4963.g820f760e.el9.noa 31/165 2024-09-17T05:20:47.244 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4963.g820f760e.el9.n 32/165 2024-09-17T05:20:47.244 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4963.g820 33/165 2024-09-17T05:20:47.244 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4963.g820f760e.el 34/165 2024-09-17T05:20:47.244 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4963.g820f760e.el9.noarch 35/165 2024-09-17T05:20:47.244 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4963.g820f760e.e 36/165 2024-09-17T05:20:47.244 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-volume-2:19.3.0-4963.g820f760e.el9.noarch 37/165 2024-09-17T05:20:47.244 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : cephadm-2:19.3.0-4963.g820f760e.el9.noarch 38/165 2024-09-17T05:20:47.244 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : cephfs-top-2:19.3.0-4963.g820f760e.el9.noarch 39/165 2024-09-17T05:20:47.244 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-17T05:20:47.245 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-17T05:20:47.245 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-17T05:20:47.245 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-17T05:20:47.245 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-17T05:20:47.245 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-17T05:20:47.245 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-17T05:20:47.245 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-17T05:20:47.245 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-17T05:20:47.245 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-17T05:20:47.245 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-17T05:20:47.245 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-17T05:20:47.245 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-17T05:20:47.245 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-17T05:20:47.246 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-17T05:20:47.246 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-17T05:20:47.246 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-17T05:20:47.246 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-17T05:20:47.246 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-17T05:20:47.248 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-17T05:20:47.248 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-17T05:20:47.248 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-17T05:20:47.248 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-17T05:20:47.248 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-17T05:20:47.248 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-17T05:20:47.249 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-17T05:20:47.249 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-17T05:20:47.249 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-17T05:20:47.249 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-17T05:20:47.249 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-17T05:20:47.249 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-17T05:20:47.249 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-17T05:20:47.249 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-17T05:20:47.249 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-17T05:20:47.249 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-17T05:20:47.249 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-17T05:20:47.249 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-17T05:20:47.250 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-17T05:20:47.250 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-17T05:20:47.250 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-17T05:20:47.250 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-17T05:20:47.250 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-17T05:20:47.250 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-17T05:20:47.250 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-17T05:20:47.250 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-17T05:20:47.250 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-17T05:20:47.250 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-17T05:20:47.250 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-17T05:20:47.250 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-17T05:20:47.250 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-17T05:20:47.251 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-17T05:20:47.251 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-17T05:20:47.251 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-17T05:20:47.251 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-17T05:20:47.251 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-17T05:20:47.251 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-17T05:20:47.251 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-17T05:20:47.251 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-17T05:20:47.251 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-17T05:20:47.251 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-17T05:20:47.251 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-17T05:20:47.251 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-17T05:20:47.251 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-17T05:20:47.252 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-17T05:20:47.252 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-17T05:20:47.252 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-17T05:20:47.252 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-17T05:20:47.252 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-17T05:20:47.252 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-17T05:20:47.252 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-17T05:20:47.252 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-17T05:20:47.252 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-17T05:20:47.252 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-17T05:20:47.252 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-17T05:20:47.252 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-17T05:20:47.252 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-17T05:20:47.253 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-17T05:20:47.253 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-17T05:20:47.253 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-17T05:20:47.253 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-17T05:20:47.253 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-17T05:20:47.253 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-17T05:20:47.253 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-17T05:20:47.253 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-17T05:20:47.253 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-17T05:20:47.253 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-17T05:20:47.253 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-17T05:20:47.253 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-17T05:20:47.253 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-17T05:20:47.254 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-17T05:20:47.254 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-17T05:20:47.254 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-17T05:20:47.254 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-17T05:20:47.254 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-17T05:20:47.254 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-17T05:20:47.254 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-17T05:20:47.254 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-17T05:20:47.254 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-17T05:20:47.254 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-17T05:20:47.254 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-17T05:20:47.254 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-17T05:20:47.255 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-17T05:20:47.255 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-17T05:20:47.255 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-17T05:20:47.255 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-17T05:20:47.255 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-17T05:20:47.255 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-17T05:20:47.255 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-17T05:20:47.255 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-17T05:20:47.255 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-17T05:20:47.255 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librados2-2:19.3.0-4963.g820f760e.el9.x86_64 150/165 2024-09-17T05:20:47.255 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-17T05:20:47.255 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librbd1-2:19.3.0-4963.g820f760e.el9.x86_64 152/165 2024-09-17T05:20:47.255 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-17T05:20:47.256 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-17T05:20:47.256 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-17T05:20:47.256 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-17T05:20:47.256 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-17T05:20:47.256 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-17T05:20:47.256 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-17T05:20:47.256 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-17T05:20:47.256 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-17T05:20:47.256 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-17T05:20:47.256 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-17T05:20:47.256 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-17T05:20:49.715 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T05:20:49.715 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:20:49.715 INFO:teuthology.orchestra.run.smithi098.stdout:Upgraded: 2024-09-17T05:20:49.715 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-17T05:20:49.715 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-17T05:20:49.715 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-17T05:20:49.716 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-17T05:20:49.716 INFO:teuthology.orchestra.run.smithi098.stdout: librados2-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:49.716 INFO:teuthology.orchestra.run.smithi098.stdout: librbd1-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:49.716 INFO:teuthology.orchestra.run.smithi098.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-17T05:20:49.716 INFO:teuthology.orchestra.run.smithi098.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-17T05:20:49.716 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-17T05:20:49.716 INFO:teuthology.orchestra.run.smithi098.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-17T05:20:49.716 INFO:teuthology.orchestra.run.smithi098.stdout: automake-1.16.2-8.el9.noarch 2024-09-17T05:20:49.716 INFO:teuthology.orchestra.run.smithi098.stdout: bison-3.7.4-5.el9.x86_64 2024-09-17T05:20:49.716 INFO:teuthology.orchestra.run.smithi098.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-17T05:20:49.716 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:49.717 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-base-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:49.717 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-common-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:49.717 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-fuse-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:49.717 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-grafana-dashboards-2:19.3.0-4963.g820f760e.el9.noarch 2024-09-17T05:20:49.717 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-immutable-object-cache-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:49.717 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mds-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:49.717 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:49.717 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-cephadm-2:19.3.0-4963.g820f760e.el9.noarch 2024-09-17T05:20:49.717 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-dashboard-2:19.3.0-4963.g820f760e.el9.noarch 2024-09-17T05:20:49.718 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4963.g820f760e.el9.noarch 2024-09-17T05:20:49.718 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-modules-core-2:19.3.0-4963.g820f760e.el9.noarch 2024-09-17T05:20:49.718 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-rook-2:19.3.0-4963.g820f760e.el9.noarch 2024-09-17T05:20:49.718 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mon-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:49.718 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-osd-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:49.718 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-prometheus-alerts-2:19.3.0-4963.g820f760e.el9.noarch 2024-09-17T05:20:49.718 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-radosgw-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:49.718 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-selinux-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:49.718 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-test-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:49.718 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-volume-2:19.3.0-4963.g820f760e.el9.noarch 2024-09-17T05:20:49.718 INFO:teuthology.orchestra.run.smithi098.stdout: cephadm-2:19.3.0-4963.g820f760e.el9.noarch 2024-09-17T05:20:49.719 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-mirror-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:49.719 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-shell-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:49.719 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-top-2:19.3.0-4963.g820f760e.el9.noarch 2024-09-17T05:20:49.719 INFO:teuthology.orchestra.run.smithi098.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-17T05:20:49.719 INFO:teuthology.orchestra.run.smithi098.stdout: flex-2.6.4-9.el9.x86_64 2024-09-17T05:20:49.719 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-17T05:20:49.719 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-17T05:20:49.719 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-17T05:20:49.719 INFO:teuthology.orchestra.run.smithi098.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-17T05:20:49.719 INFO:teuthology.orchestra.run.smithi098.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-17T05:20:49.720 INFO:teuthology.orchestra.run.smithi098.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-17T05:20:49.720 INFO:teuthology.orchestra.run.smithi098.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-17T05:20:49.720 INFO:teuthology.orchestra.run.smithi098.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-17T05:20:49.720 INFO:teuthology.orchestra.run.smithi098.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-17T05:20:49.720 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs-devel-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:49.720 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs2-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:49.720 INFO:teuthology.orchestra.run.smithi098.stdout: libcephsqlite-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:49.720 INFO:teuthology.orchestra.run.smithi098.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-17T05:20:49.720 INFO:teuthology.orchestra.run.smithi098.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-17T05:20:49.721 INFO:teuthology.orchestra.run.smithi098.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-17T05:20:49.721 INFO:teuthology.orchestra.run.smithi098.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-17T05:20:49.721 INFO:teuthology.orchestra.run.smithi098.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-17T05:20:49.721 INFO:teuthology.orchestra.run.smithi098.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-17T05:20:49.721 INFO:teuthology.orchestra.run.smithi098.stdout: librados-devel-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:49.721 INFO:teuthology.orchestra.run.smithi098.stdout: libradosstriper1-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:49.721 INFO:teuthology.orchestra.run.smithi098.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-17T05:20:49.721 INFO:teuthology.orchestra.run.smithi098.stdout: librgw2-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:49.721 INFO:teuthology.orchestra.run.smithi098.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-17T05:20:49.721 INFO:teuthology.orchestra.run.smithi098.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-17T05:20:49.721 INFO:teuthology.orchestra.run.smithi098.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-17T05:20:49.721 INFO:teuthology.orchestra.run.smithi098.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-17T05:20:49.721 INFO:teuthology.orchestra.run.smithi098.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-17T05:20:49.722 INFO:teuthology.orchestra.run.smithi098.stdout: lua-5.4.4-4.el9.x86_64 2024-09-17T05:20:49.722 INFO:teuthology.orchestra.run.smithi098.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-17T05:20:49.722 INFO:teuthology.orchestra.run.smithi098.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-17T05:20:49.722 INFO:teuthology.orchestra.run.smithi098.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-17T05:20:49.722 INFO:teuthology.orchestra.run.smithi098.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-17T05:20:49.722 INFO:teuthology.orchestra.run.smithi098.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-17T05:20:49.722 INFO:teuthology.orchestra.run.smithi098.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-17T05:20:49.722 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-13.16-1.el9.x86_64 2024-09-17T05:20:49.723 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-17T05:20:49.723 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-17T05:20:49.723 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-17T05:20:49.723 INFO:teuthology.orchestra.run.smithi098.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-17T05:20:49.723 INFO:teuthology.orchestra.run.smithi098.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-17T05:20:49.723 INFO:teuthology.orchestra.run.smithi098.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-17T05:20:49.723 INFO:teuthology.orchestra.run.smithi098.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-17T05:20:49.723 INFO:teuthology.orchestra.run.smithi098.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-17T05:20:49.723 INFO:teuthology.orchestra.run.smithi098.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-17T05:20:49.723 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-17T05:20:49.723 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-argparse-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:49.723 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-common-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:49.723 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cephfs-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:49.724 INFO:teuthology.orchestra.run.smithi098.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-17T05:20:49.724 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-17T05:20:49.724 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-17T05:20:49.724 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-17T05:20:49.724 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-17T05:20:49.724 INFO:teuthology.orchestra.run.smithi098.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-17T05:20:49.724 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-17T05:20:49.724 INFO:teuthology.orchestra.run.smithi098.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-17T05:20:49.724 INFO:teuthology.orchestra.run.smithi098.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-17T05:20:49.724 INFO:teuthology.orchestra.run.smithi098.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-17T05:20:49.724 INFO:teuthology.orchestra.run.smithi098.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-17T05:20:49.724 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-17T05:20:49.725 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-17T05:20:49.725 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-17T05:20:49.725 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-17T05:20:49.725 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-17T05:20:49.725 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-17T05:20:49.725 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-17T05:20:49.725 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-17T05:20:49.725 INFO:teuthology.orchestra.run.smithi098.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-17T05:20:49.725 INFO:teuthology.orchestra.run.smithi098.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-17T05:20:49.725 INFO:teuthology.orchestra.run.smithi098.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-17T05:20:49.726 INFO:teuthology.orchestra.run.smithi098.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-17T05:20:49.726 INFO:teuthology.orchestra.run.smithi098.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-17T05:20:49.726 INFO:teuthology.orchestra.run.smithi098.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-17T05:20:49.726 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-17T05:20:49.726 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-17T05:20:49.726 INFO:teuthology.orchestra.run.smithi098.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-17T05:20:49.726 INFO:teuthology.orchestra.run.smithi098.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-17T05:20:49.726 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-17T05:20:49.726 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ply-3.11-14.el9.noarch 2024-09-17T05:20:49.727 INFO:teuthology.orchestra.run.smithi098.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-17T05:20:49.727 INFO:teuthology.orchestra.run.smithi098.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-17T05:20:49.727 INFO:teuthology.orchestra.run.smithi098.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-17T05:20:49.727 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-17T05:20:49.727 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-17T05:20:49.727 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-17T05:20:49.727 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-17T05:20:49.727 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-17T05:20:49.727 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-17T05:20:49.727 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rados-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:49.727 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rbd-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:49.727 INFO:teuthology.orchestra.run.smithi098.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-17T05:20:49.727 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-17T05:20:49.728 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-17T05:20:49.728 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rgw-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:49.728 INFO:teuthology.orchestra.run.smithi098.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-17T05:20:49.728 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-17T05:20:49.728 INFO:teuthology.orchestra.run.smithi098.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-17T05:20:49.728 INFO:teuthology.orchestra.run.smithi098.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-17T05:20:49.728 INFO:teuthology.orchestra.run.smithi098.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-17T05:20:49.728 INFO:teuthology.orchestra.run.smithi098.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-17T05:20:49.728 INFO:teuthology.orchestra.run.smithi098.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-17T05:20:49.728 INFO:teuthology.orchestra.run.smithi098.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-17T05:20:49.728 INFO:teuthology.orchestra.run.smithi098.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-17T05:20:49.728 INFO:teuthology.orchestra.run.smithi098.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-17T05:20:49.728 INFO:teuthology.orchestra.run.smithi098.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-17T05:20:49.729 INFO:teuthology.orchestra.run.smithi098.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-17T05:20:49.729 INFO:teuthology.orchestra.run.smithi098.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-17T05:20:49.729 INFO:teuthology.orchestra.run.smithi098.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-17T05:20:49.729 INFO:teuthology.orchestra.run.smithi098.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-17T05:20:49.729 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-fuse-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:49.729 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-mirror-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:49.729 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-nbd-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:20:49.729 INFO:teuthology.orchestra.run.smithi098.stdout: re2-1:20211101-20.el9.x86_64 2024-09-17T05:20:49.729 INFO:teuthology.orchestra.run.smithi098.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-17T05:20:49.729 INFO:teuthology.orchestra.run.smithi098.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-17T05:20:49.729 INFO:teuthology.orchestra.run.smithi098.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-17T05:20:49.729 INFO:teuthology.orchestra.run.smithi098.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-17T05:20:49.729 INFO:teuthology.orchestra.run.smithi098.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-17T05:20:49.730 INFO:teuthology.orchestra.run.smithi098.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-17T05:20:49.730 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:20:49.730 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-17T05:20:50.127 DEBUG:teuthology.parallel:result is None 2024-09-17T05:20:50.127 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=820f760e4779dafd30d668ecea7aba6355dfd3d8 2024-09-17T05:20:50.279 DEBUG:teuthology.orchestra.run.smithi098:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-17T05:20:50.302 INFO:teuthology.orchestra.run.smithi098.stdout:19.3.0-4963.g820f760e.el9 2024-09-17T05:20:50.302 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4963.g820f760e.el9 2024-09-17T05:20:50.302 INFO:teuthology.task.install:The correct ceph version 19.3.0-4963.g820f760e is installed. 2024-09-17T05:20:50.305 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=820f760e4779dafd30d668ecea7aba6355dfd3d8 2024-09-17T05:20:50.452 DEBUG:teuthology.orchestra.run.smithi167:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-17T05:20:50.478 INFO:teuthology.orchestra.run.smithi167.stdout:19.3.0-4963.g820f760e.el9 2024-09-17T05:20:50.478 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4963.g820f760e.el9 2024-09-17T05:20:50.478 INFO:teuthology.task.install:The correct ceph version 19.3.0-4963.g820f760e is installed. 2024-09-17T05:20:50.481 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-17T05:20:50.481 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T05:20:50.482 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T05:20:50.510 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-17T05:20:50.510 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T05:20:50.551 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-17T05:20:50.551 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T05:20:50.552 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T05:20:50.577 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T05:20:50.641 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-17T05:20:50.641 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T05:20:50.669 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T05:20:50.736 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-17T05:20:50.736 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T05:20:50.736 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T05:20:50.761 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T05:20:50.825 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-17T05:20:50.825 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T05:20:50.852 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T05:20:50.920 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-17T05:20:50.921 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T05:20:50.921 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T05:20:50.945 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T05:20:51.010 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-17T05:20:51.010 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T05:20:51.036 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T05:20:51.103 INFO:teuthology.run_tasks:Running task ceph... 2024-09-17T05:20:51.189 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-17T05:20:51.189 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 777 /var/log/ceph 2024-09-17T05:20:51.191 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 777 /var/log/ceph 2024-09-17T05:20:51.217 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-17T05:20:51.217 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-17T05:20:51.257 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-17T05:20:51.282 INFO:tasks.ceph:Creating extra log directories... 2024-09-17T05:20:51.282 DEBUG:teuthology.orchestra.run.smithi098:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-17T05:20:51.323 DEBUG:teuthology.orchestra.run.smithi167:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-17T05:20:51.355 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-17T05:20:51.355 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-17T05:20:51.355 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-17T05:20:51.355 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T05:20:51.356 DEBUG:teuthology.orchestra.run.smithi098:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-17T05:20:51.400 DEBUG:teuthology.orchestra.run.smithi098:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-17T05:20:51.509 DEBUG:teuthology.orchestra.run.smithi098:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-17T05:20:51.549 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-17T05:20:51.549 DEBUG:teuthology.orchestra.run.smithi167:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-17T05:20:51.565 DEBUG:teuthology.orchestra.run.smithi167:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-17T05:20:51.676 DEBUG:teuthology.orchestra.run.smithi167:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-17T05:20:51.706 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-17T05:20:51.706 INFO:tasks.ceph:config {'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-17T05:20:51.706 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/avan-2024-09-17_05:02:16-fs:volumes-wip-athakkar-testing-2024-09-16-2351-distro-default-smithi/7908691', 'branch': 'wip-athakkar-testing-2024-09-16-2351', 'description': 'fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/finisher_per_module}}', 'email': 'athakkar@redhat.com', 'first_in_suite': False, 'job_id': '7908691', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'avan-2024-09-17_05:02:16-fs:volumes-wip-athakkar-testing-2024-09-16-2351-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-athakkar-testing-2024-09-16-2351'}, 'ceph': {'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '820f760e4779dafd30d668ecea7aba6355dfd3d8'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '820f760e4779dafd30d668ecea7aba6355dfd3d8'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-athakkar-testing-2024-09-16-2351', 'sha1': '820f760e4779dafd30d668ecea7aba6355dfd3d8'}}, 'owner': 'scheduled_avan@teuthology', 'priority': 80, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 448, 'sha1': '820f760e4779dafd30d668ecea7aba6355dfd3d8', 'sleep_before_teardown': 0, 'subset': '1/20', 'suite': 'fs:volumes', 'suite_branch': 'wip-athakkar-testing-2024-09-16-2351', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_820f760e4779dafd30d668ecea7aba6355dfd3d8/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '820f760e4779dafd30d668ecea7aba6355dfd3d8', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi098.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD74atD4R/M8JPFcp16JaiXzGRKCLmtDm4K6Y7x5+uBM6OBIQW0Yziefv0WE9V+o6M6sYcABisGPNjC9187AvOA=', 'smithi167.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEJIB6ESXO301QmYrrl2md1O3w/5okFx4e0jJS/8CgQdchYILn5nj20pXusM90/EOE2NOFY/xhA255XyWw7jyYs='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '820f760e4779dafd30d668ecea7aba6355dfd3d8'}}, {'ceph': {'create_rbd_pool': False, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '820f760e4779dafd30d668ecea7aba6355dfd3d8', 'cluster': 'ceph'}}, {'kclient': None}, {'check-counter': {'counters': {'mgr': [{'min': 4, 'name': 'finisher-volumes.complete_latency.avgcount'}, {'expected_val': 0, 'name': 'finisher-volumes.queue_len'}]}}}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestPerModuleFinsherThread']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-17_05:02:16', 'tube': 'smithi', 'user': 'avan', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-17T05:20:51.707 DEBUG:teuthology.orchestra.run.smithi098:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-17T05:20:51.709 DEBUG:teuthology.orchestra.run.smithi167:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-17T05:20:51.756 DEBUG:teuthology.orchestra.run.smithi098:> sudo install -d -m0777 -- /var/run/ceph 2024-09-17T05:20:51.765 DEBUG:teuthology.orchestra.run.smithi167:> sudo install -d -m0777 -- /var/run/ceph 2024-09-17T05:20:51.822 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T05:20:51.822 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T05:20:51.843 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T05:20:51.844 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_1 2024-09-17T05:20:51.899 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T05:20:51.899 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T05:20:51.899 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-17T05:20:51.899 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T05:20:51.899 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T05:20:51.899 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-17 05:20:41.605665772 +0000 2024-09-17T05:20:51.899 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-17 05:18:51.750115471 +0000 2024-09-17T05:20:51.899 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-17 05:18:51.750115471 +0000 2024-09-17T05:20:51.899 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2024-09-17 05:18:51.750115471 +0000 2024-09-17T05:20:51.900 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T05:20:51.962 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-09-17T05:20:51.962 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-09-17T05:20:51.962 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000208664 s, 2.5 MB/s 2024-09-17T05:20:51.963 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T05:20:52.020 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_2 2024-09-17T05:20:52.075 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T05:20:52.075 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T05:20:52.075 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-17T05:20:52.075 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T05:20:52.075 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T05:20:52.075 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-17 05:20:41.606665759 +0000 2024-09-17T05:20:52.075 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-17 05:18:52.078111219 +0000 2024-09-17T05:20:52.076 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-17 05:18:52.078111219 +0000 2024-09-17T05:20:52.076 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2024-09-17 05:18:52.078111219 +0000 2024-09-17T05:20:52.076 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T05:20:52.138 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-09-17T05:20:52.139 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-09-17T05:20:52.139 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000307334 s, 1.7 MB/s 2024-09-17T05:20:52.140 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T05:20:52.196 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_3 2024-09-17T05:20:52.252 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T05:20:52.252 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T05:20:52.252 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-17T05:20:52.252 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T05:20:52.252 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T05:20:52.252 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-17 05:20:41.606665759 +0000 2024-09-17T05:20:52.252 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-17 05:18:52.417106821 +0000 2024-09-17T05:20:52.252 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-17 05:18:52.417106821 +0000 2024-09-17T05:20:52.252 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2024-09-17 05:18:52.417106821 +0000 2024-09-17T05:20:52.253 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T05:20:52.314 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-09-17T05:20:52.315 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-09-17T05:20:52.315 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000189355 s, 2.7 MB/s 2024-09-17T05:20:52.316 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T05:20:52.372 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_4 2024-09-17T05:20:52.428 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T05:20:52.428 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T05:20:52.428 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-17T05:20:52.428 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T05:20:52.428 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T05:20:52.428 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-17 05:20:41.606665759 +0000 2024-09-17T05:20:52.429 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-17 05:18:52.742102604 +0000 2024-09-17T05:20:52.429 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-17 05:18:52.742102604 +0000 2024-09-17T05:20:52.429 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2024-09-17 05:18:52.742102604 +0000 2024-09-17T05:20:52.429 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T05:20:52.492 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-09-17T05:20:52.492 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-09-17T05:20:52.492 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000233296 s, 2.2 MB/s 2024-09-17T05:20:52.493 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T05:20:52.549 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T05:20:52.550 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-17T05:20:52.550 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T05:20:52.567 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T05:20:52.567 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_1 2024-09-17T05:20:52.623 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T05:20:52.624 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T05:20:52.624 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-17T05:20:52.624 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T05:20:52.624 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T05:20:52.624 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2024-09-17 05:20:37.050173925 +0000 2024-09-17T05:20:52.624 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2024-09-17 05:18:51.753081782 +0000 2024-09-17T05:20:52.624 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2024-09-17 05:18:51.753081782 +0000 2024-09-17T05:20:52.624 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2024-09-17 05:18:51.753081782 +0000 2024-09-17T05:20:52.625 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T05:20:52.689 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2024-09-17T05:20:52.689 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2024-09-17T05:20:52.689 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000363118 s, 1.4 MB/s 2024-09-17T05:20:52.690 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T05:20:52.749 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_2 2024-09-17T05:20:52.805 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T05:20:52.805 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T05:20:52.805 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-17T05:20:52.805 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T05:20:52.805 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T05:20:52.805 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2024-09-17 05:20:37.050173925 +0000 2024-09-17T05:20:52.806 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2024-09-17 05:18:52.091075985 +0000 2024-09-17T05:20:52.806 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2024-09-17 05:18:52.091075985 +0000 2024-09-17T05:20:52.806 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2024-09-17 05:18:52.091075985 +0000 2024-09-17T05:20:52.806 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T05:20:52.869 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2024-09-17T05:20:52.869 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2024-09-17T05:20:52.869 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000224137 s, 2.3 MB/s 2024-09-17T05:20:52.872 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T05:20:52.929 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_3 2024-09-17T05:20:52.985 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T05:20:52.985 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T05:20:52.985 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-17T05:20:52.985 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T05:20:52.985 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T05:20:52.985 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2024-09-17 05:20:37.051173909 +0000 2024-09-17T05:20:52.986 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2024-09-17 05:18:52.417070394 +0000 2024-09-17T05:20:52.986 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2024-09-17 05:18:52.417070394 +0000 2024-09-17T05:20:52.986 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2024-09-17 05:18:52.417070394 +0000 2024-09-17T05:20:52.986 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T05:20:53.049 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2024-09-17T05:20:53.049 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2024-09-17T05:20:53.049 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000198206 s, 2.6 MB/s 2024-09-17T05:20:53.050 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T05:20:53.107 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_4 2024-09-17T05:20:53.164 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T05:20:53.164 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T05:20:53.164 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-17T05:20:53.164 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T05:20:53.164 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T05:20:53.164 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2024-09-17 05:20:37.051173909 +0000 2024-09-17T05:20:53.165 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2024-09-17 05:18:52.748064717 +0000 2024-09-17T05:20:53.165 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2024-09-17 05:18:52.748064717 +0000 2024-09-17T05:20:53.165 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2024-09-17 05:18:52.748064717 +0000 2024-09-17T05:20:53.165 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T05:20:53.227 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2024-09-17T05:20:53.228 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2024-09-17T05:20:53.228 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000192267 s, 2.7 MB/s 2024-09-17T05:20:53.229 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T05:20:53.285 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T05:20:53.285 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi098.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi167.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-17T05:20:53.285 INFO:tasks.ceph:Generating config... 2024-09-17T05:20:53.286 INFO:tasks.ceph:[client] pid file = 2024-09-17T05:20:53.286 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-09-17T05:20:53.287 INFO:tasks.ceph:[mgr] client mount timeout = 30 2024-09-17T05:20:53.287 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-17T05:20:53.287 INFO:tasks.ceph:[mgr] debug finisher = 20 2024-09-17T05:20:53.287 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-17T05:20:53.287 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-17T05:20:53.287 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-17T05:20:53.287 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-17T05:20:53.287 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-17T05:20:53.287 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-17T05:20:53.288 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-17T05:20:53.288 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-17T05:20:53.288 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-17T05:20:53.288 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-17T05:20:53.288 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-17T05:20:53.288 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-17T05:20:53.288 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-17T05:20:53.288 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-17T05:20:53.288 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-17T05:20:53.288 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-17T05:20:53.288 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-17T05:20:53.288 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-17T05:20:53.289 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-17T05:20:53.289 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-17T05:20:53.289 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-17T05:20:53.289 INFO:tasks.ceph:Setting up mon.a... 2024-09-17T05:20:53.289 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-17T05:20:53.339 INFO:teuthology.orchestra.run.smithi098.stdout:creating /etc/ceph/ceph.keyring 2024-09-17T05:20:53.342 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-17T05:20:53.385 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T05:20:53.449 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.98'), ('mon.b', '172.21.15.167'), ('mon.c', '[v2:172.21.15.167:3301,v1:172.21.15.167:6790]')] 2024-09-17T05:20:53.450 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.98,172.21.15.167,[v2:172.21.15.167:3301,v1:172.21.15.167:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'client mount timeout': 30, 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'pid file': ''}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}} 2024-09-17T05:20:53.450 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T05:20:53.450 DEBUG:teuthology.orchestra.run.smithi098:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-17T05:20:53.505 DEBUG:teuthology.orchestra.run.smithi098:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.98 --add b 172.21.15.167 --addv c '[v2:172.21.15.167:3301,v1:172.21.15.167:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:20:53.592 INFO:teuthology.orchestra.run.smithi098.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:20:53.592 INFO:teuthology.orchestra.run.smithi098.stdout:monmaptool: generated fsid fcbf5a43-b3d8-497c-b15d-3cc022477cf0 2024-09-17T05:20:53.592 INFO:teuthology.orchestra.run.smithi098.stdout:setting min_mon_release = quincy 2024-09-17T05:20:53.592 INFO:teuthology.orchestra.run.smithi098.stdout:epoch 0 2024-09-17T05:20:53.592 INFO:teuthology.orchestra.run.smithi098.stdout:fsid fcbf5a43-b3d8-497c-b15d-3cc022477cf0 2024-09-17T05:20:53.592 INFO:teuthology.orchestra.run.smithi098.stdout:last_changed 2024-09-17T05:20:53.592184+0000 2024-09-17T05:20:53.592 INFO:teuthology.orchestra.run.smithi098.stdout:created 2024-09-17T05:20:53.592184+0000 2024-09-17T05:20:53.592 INFO:teuthology.orchestra.run.smithi098.stdout:min_mon_release 17 (quincy) 2024-09-17T05:20:53.592 INFO:teuthology.orchestra.run.smithi098.stdout:election_strategy: 1 2024-09-17T05:20:53.593 INFO:teuthology.orchestra.run.smithi098.stdout:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-17T05:20:53.593 INFO:teuthology.orchestra.run.smithi098.stdout:1: [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] mon.b 2024-09-17T05:20:53.593 INFO:teuthology.orchestra.run.smithi098.stdout:2: [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] mon.c 2024-09-17T05:20:53.593 INFO:teuthology.orchestra.run.smithi098.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-17T05:20:53.598 DEBUG:teuthology.orchestra.run.smithi098:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-17T05:20:53.613 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID fcbf5a43-b3d8-497c-b15d-3cc022477cf0... 2024-09-17T05:20:53.614 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T05:20:53.656 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T05:20:53.696 INFO:teuthology.orchestra.run.smithi098.stdout:[global] 2024-09-17T05:20:53.696 INFO:teuthology.orchestra.run.smithi098.stdout: chdir = "" 2024-09-17T05:20:53.696 INFO:teuthology.orchestra.run.smithi098.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T05:20:53.696 INFO:teuthology.orchestra.run.smithi098.stdout: auth supported = cephx 2024-09-17T05:20:53.696 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:20:53.697 INFO:teuthology.orchestra.run.smithi098.stdout: filestore xattr use omap = true 2024-09-17T05:20:53.697 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:20:53.697 INFO:teuthology.orchestra.run.smithi098.stdout: mon clock drift allowed = 1.000 2024-09-17T05:20:53.697 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:20:53.697 INFO:teuthology.orchestra.run.smithi098.stdout: osd crush chooseleaf type = 0 2024-09-17T05:20:53.697 INFO:teuthology.orchestra.run.smithi098.stdout: auth debug = true 2024-09-17T05:20:53.697 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:20:53.697 INFO:teuthology.orchestra.run.smithi098.stdout: ms die on old message = true 2024-09-17T05:20:53.697 INFO:teuthology.orchestra.run.smithi098.stdout: ms die on bug = true 2024-09-17T05:20:53.697 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:20:53.697 INFO:teuthology.orchestra.run.smithi098.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T05:20:53.697 INFO:teuthology.orchestra.run.smithi098.stdout: mon pg warn max object skew = 0 2024-09-17T05:20:53.697 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:20:53.698 INFO:teuthology.orchestra.run.smithi098.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T05:20:53.698 INFO:teuthology.orchestra.run.smithi098.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T05:20:53.698 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:20:53.698 INFO:teuthology.orchestra.run.smithi098.stdout: osd pool default size = 2 2024-09-17T05:20:53.698 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:20:53.698 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd allow primary affinity = true 2024-09-17T05:20:53.698 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd allow pg remap = true 2024-09-17T05:20:53.698 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on legacy crush tunables = false 2024-09-17T05:20:53.698 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on crush straw calc version zero = false 2024-09-17T05:20:53.698 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on no sortbitwise = false 2024-09-17T05:20:53.698 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on osd down out interval zero = false 2024-09-17T05:20:53.698 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on too few osds = false 2024-09-17T05:20:53.698 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T05:20:53.698 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T05:20:53.699 INFO:teuthology.orchestra.run.smithi098.stdout: mon_allow_pool_size_one = true 2024-09-17T05:20:53.699 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:20:53.699 INFO:teuthology.orchestra.run.smithi098.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T05:20:53.699 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:20:53.699 INFO:teuthology.orchestra.run.smithi098.stdout: osd default data pool replay window = 5 2024-09-17T05:20:53.699 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:20:53.699 INFO:teuthology.orchestra.run.smithi098.stdout: mon allow pool delete = true 2024-09-17T05:20:53.699 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:20:53.699 INFO:teuthology.orchestra.run.smithi098.stdout: mon cluster log file level = debug 2024-09-17T05:20:53.699 INFO:teuthology.orchestra.run.smithi098.stdout: debug asserts on shutdown = true 2024-09-17T05:20:53.699 INFO:teuthology.orchestra.run.smithi098.stdout: mon health detail to clog = false 2024-09-17T05:20:53.699 INFO:teuthology.orchestra.run.smithi098.stdout: mon host = "172.21.15.98,172.21.15.167,[v2:172.21.15.167:3301,v1:172.21.15.167:6790]" 2024-09-17T05:20:53.700 INFO:teuthology.orchestra.run.smithi098.stdout: ms die on skipped message = False 2024-09-17T05:20:53.700 INFO:teuthology.orchestra.run.smithi098.stdout: fsid = fcbf5a43-b3d8-497c-b15d-3cc022477cf0 2024-09-17T05:20:53.700 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:20:53.700 INFO:teuthology.orchestra.run.smithi098.stdout:[osd] 2024-09-17T05:20:53.700 INFO:teuthology.orchestra.run.smithi098.stdout: osd journal size = 100 2024-09-17T05:20:53.700 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:20:53.700 INFO:teuthology.orchestra.run.smithi098.stdout: osd scrub load threshold = 5.0 2024-09-17T05:20:53.700 INFO:teuthology.orchestra.run.smithi098.stdout: osd scrub max interval = 600 2024-09-17T05:20:53.700 INFO:teuthology.orchestra.run.smithi098.stdout: osd mclock profile = high_recovery_ops 2024-09-17T05:20:53.700 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:20:53.700 INFO:teuthology.orchestra.run.smithi098.stdout: osd recover clone overlap = true 2024-09-17T05:20:53.700 INFO:teuthology.orchestra.run.smithi098.stdout: osd recovery max chunk = 1048576 2024-09-17T05:20:53.700 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:20:53.701 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug shutdown = true 2024-09-17T05:20:53.701 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug op order = true 2024-09-17T05:20:53.701 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug verify stray on activate = true 2024-09-17T05:20:53.701 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug trim objects = true 2024-09-17T05:20:53.701 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:20:53.701 INFO:teuthology.orchestra.run.smithi098.stdout: osd open classes on start = true 2024-09-17T05:20:53.701 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug pg log writeout = true 2024-09-17T05:20:53.701 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:20:53.701 INFO:teuthology.orchestra.run.smithi098.stdout: osd deep scrub update digest min age = 30 2024-09-17T05:20:53.701 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:20:53.701 INFO:teuthology.orchestra.run.smithi098.stdout: osd map max advance = 10 2024-09-17T05:20:53.701 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:20:53.701 INFO:teuthology.orchestra.run.smithi098.stdout: journal zero on create = true 2024-09-17T05:20:53.702 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:20:53.702 INFO:teuthology.orchestra.run.smithi098.stdout: filestore ondisk finisher threads = 3 2024-09-17T05:20:53.702 INFO:teuthology.orchestra.run.smithi098.stdout: filestore apply finisher threads = 3 2024-09-17T05:20:53.702 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:20:53.702 INFO:teuthology.orchestra.run.smithi098.stdout: bdev debug aio = true 2024-09-17T05:20:53.702 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug misdirected ops = true 2024-09-17T05:20:53.702 INFO:teuthology.orchestra.run.smithi098.stdout: bdev async discard = True 2024-09-17T05:20:53.702 INFO:teuthology.orchestra.run.smithi098.stdout: bdev enable discard = True 2024-09-17T05:20:53.702 INFO:teuthology.orchestra.run.smithi098.stdout: bluestore allocator = bitmap 2024-09-17T05:20:53.702 INFO:teuthology.orchestra.run.smithi098.stdout: bluestore block size = 96636764160 2024-09-17T05:20:53.702 INFO:teuthology.orchestra.run.smithi098.stdout: bluestore fsck on mount = True 2024-09-17T05:20:53.702 INFO:teuthology.orchestra.run.smithi098.stdout: debug bluefs = 1/20 2024-09-17T05:20:53.702 INFO:teuthology.orchestra.run.smithi098.stdout: debug bluestore = 1/20 2024-09-17T05:20:53.702 INFO:teuthology.orchestra.run.smithi098.stdout: debug ms = 1 2024-09-17T05:20:53.703 INFO:teuthology.orchestra.run.smithi098.stdout: debug osd = 20 2024-09-17T05:20:53.703 INFO:teuthology.orchestra.run.smithi098.stdout: debug rocksdb = 4/10 2024-09-17T05:20:53.703 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T05:20:53.703 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd full ratio = 0.9 2024-09-17T05:20:53.703 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd nearfull ratio = 0.8 2024-09-17T05:20:53.703 INFO:teuthology.orchestra.run.smithi098.stdout: osd failsafe full ratio = 0.95 2024-09-17T05:20:53.703 INFO:teuthology.orchestra.run.smithi098.stdout: osd objectstore = bluestore 2024-09-17T05:20:53.703 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:20:53.703 INFO:teuthology.orchestra.run.smithi098.stdout:[mgr] 2024-09-17T05:20:53.703 INFO:teuthology.orchestra.run.smithi098.stdout: debug ms = 1 2024-09-17T05:20:53.703 INFO:teuthology.orchestra.run.smithi098.stdout: debug mgr = 20 2024-09-17T05:20:53.703 INFO:teuthology.orchestra.run.smithi098.stdout: debug mon = 20 2024-09-17T05:20:53.703 INFO:teuthology.orchestra.run.smithi098.stdout: debug auth = 20 2024-09-17T05:20:53.704 INFO:teuthology.orchestra.run.smithi098.stdout: mon reweight min pgs per osd = 4 2024-09-17T05:20:53.704 INFO:teuthology.orchestra.run.smithi098.stdout: mon reweight min bytes per osd = 10 2024-09-17T05:20:53.704 INFO:teuthology.orchestra.run.smithi098.stdout: mgr/telemetry/nag = false 2024-09-17T05:20:53.704 INFO:teuthology.orchestra.run.smithi098.stdout: client mount timeout = 30 2024-09-17T05:20:53.704 INFO:teuthology.orchestra.run.smithi098.stdout: debug client = 20 2024-09-17T05:20:53.704 INFO:teuthology.orchestra.run.smithi098.stdout: debug finisher = 20 2024-09-17T05:20:53.704 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:20:53.704 INFO:teuthology.orchestra.run.smithi098.stdout:[mon] 2024-09-17T05:20:53.704 INFO:teuthology.orchestra.run.smithi098.stdout: debug ms = 1 2024-09-17T05:20:53.704 INFO:teuthology.orchestra.run.smithi098.stdout: debug mon = 20 2024-09-17T05:20:53.704 INFO:teuthology.orchestra.run.smithi098.stdout: debug paxos = 20 2024-09-17T05:20:53.704 INFO:teuthology.orchestra.run.smithi098.stdout: debug auth = 20 2024-09-17T05:20:53.705 INFO:teuthology.orchestra.run.smithi098.stdout: mon data avail warn = 5 2024-09-17T05:20:53.705 INFO:teuthology.orchestra.run.smithi098.stdout: mon mgr mkfs grace = 240 2024-09-17T05:20:53.705 INFO:teuthology.orchestra.run.smithi098.stdout: mon reweight min pgs per osd = 4 2024-09-17T05:20:53.705 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd reporter subtree level = osd 2024-09-17T05:20:53.705 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd prime pg temp = true 2024-09-17T05:20:53.705 INFO:teuthology.orchestra.run.smithi098.stdout: mon reweight min bytes per osd = 10 2024-09-17T05:20:53.705 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:20:53.705 INFO:teuthology.orchestra.run.smithi098.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T05:20:53.705 INFO:teuthology.orchestra.run.smithi098.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T05:20:53.705 INFO:teuthology.orchestra.run.smithi098.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T05:20:53.706 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:20:53.706 INFO:teuthology.orchestra.run.smithi098.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T05:20:53.706 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T05:20:53.706 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T05:20:53.706 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:20:53.706 INFO:teuthology.orchestra.run.smithi098.stdout: # 1m isn't quite enough 2024-09-17T05:20:53.706 INFO:teuthology.orchestra.run.smithi098.stdout: mon_down_mkfs_grace = 2m 2024-09-17T05:20:53.706 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:20:53.706 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_filestore_osds = false 2024-09-17T05:20:53.706 INFO:teuthology.orchestra.run.smithi098.stdout: mon down mkfs grace = 300 2024-09-17T05:20:53.706 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:20:53.707 INFO:teuthology.orchestra.run.smithi098.stdout:[client] 2024-09-17T05:20:53.707 INFO:teuthology.orchestra.run.smithi098.stdout: rgw cache enabled = true 2024-09-17T05:20:53.707 INFO:teuthology.orchestra.run.smithi098.stdout: rgw enable ops log = true 2024-09-17T05:20:53.707 INFO:teuthology.orchestra.run.smithi098.stdout: rgw enable usage log = true 2024-09-17T05:20:53.707 INFO:teuthology.orchestra.run.smithi098.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T05:20:53.707 INFO:teuthology.orchestra.run.smithi098.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T05:20:53.707 INFO:teuthology.orchestra.run.smithi098.stdout: pid file = "" 2024-09-17T05:20:53.707 INFO:teuthology.orchestra.run.smithi098.stdout:[mon.a] 2024-09-17T05:20:53.707 INFO:teuthology.orchestra.run.smithi098.stdout:[mon.b] 2024-09-17T05:20:53.707 INFO:teuthology.orchestra.run.smithi098.stdout:[mon.c] 2024-09-17T05:20:53.707 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.a] 2024-09-17T05:20:53.707 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.c] 2024-09-17T05:20:53.707 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.b] 2024-09-17T05:20:53.707 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.d] 2024-09-17T05:20:53.708 INFO:teuthology.orchestra.run.smithi167.stdout:[global] 2024-09-17T05:20:53.708 INFO:teuthology.orchestra.run.smithi167.stdout: chdir = "" 2024-09-17T05:20:53.708 INFO:teuthology.orchestra.run.smithi167.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T05:20:53.708 INFO:teuthology.orchestra.run.smithi167.stdout: auth supported = cephx 2024-09-17T05:20:53.708 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T05:20:53.709 INFO:teuthology.orchestra.run.smithi167.stdout: filestore xattr use omap = true 2024-09-17T05:20:53.709 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T05:20:53.709 INFO:teuthology.orchestra.run.smithi167.stdout: mon clock drift allowed = 1.000 2024-09-17T05:20:53.709 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T05:20:53.709 INFO:teuthology.orchestra.run.smithi167.stdout: osd crush chooseleaf type = 0 2024-09-17T05:20:53.709 INFO:teuthology.orchestra.run.smithi167.stdout: auth debug = true 2024-09-17T05:20:53.709 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T05:20:53.709 INFO:teuthology.orchestra.run.smithi167.stdout: ms die on old message = true 2024-09-17T05:20:53.709 INFO:teuthology.orchestra.run.smithi167.stdout: ms die on bug = true 2024-09-17T05:20:53.709 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T05:20:53.709 INFO:teuthology.orchestra.run.smithi167.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T05:20:53.709 INFO:teuthology.orchestra.run.smithi167.stdout: mon pg warn max object skew = 0 2024-09-17T05:20:53.710 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T05:20:53.710 INFO:teuthology.orchestra.run.smithi167.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T05:20:53.710 INFO:teuthology.orchestra.run.smithi167.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T05:20:53.710 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T05:20:53.710 INFO:teuthology.orchestra.run.smithi167.stdout: osd pool default size = 2 2024-09-17T05:20:53.710 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T05:20:53.710 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd allow primary affinity = true 2024-09-17T05:20:53.710 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd allow pg remap = true 2024-09-17T05:20:53.710 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on legacy crush tunables = false 2024-09-17T05:20:53.710 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on crush straw calc version zero = false 2024-09-17T05:20:53.710 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on no sortbitwise = false 2024-09-17T05:20:53.710 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on osd down out interval zero = false 2024-09-17T05:20:53.710 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on too few osds = false 2024-09-17T05:20:53.711 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T05:20:53.711 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T05:20:53.711 INFO:teuthology.orchestra.run.smithi167.stdout: mon_allow_pool_size_one = true 2024-09-17T05:20:53.711 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T05:20:53.711 INFO:teuthology.orchestra.run.smithi167.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T05:20:53.711 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T05:20:53.711 INFO:teuthology.orchestra.run.smithi167.stdout: osd default data pool replay window = 5 2024-09-17T05:20:53.711 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T05:20:53.711 INFO:teuthology.orchestra.run.smithi167.stdout: mon allow pool delete = true 2024-09-17T05:20:53.711 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T05:20:53.711 INFO:teuthology.orchestra.run.smithi167.stdout: mon cluster log file level = debug 2024-09-17T05:20:53.711 INFO:teuthology.orchestra.run.smithi167.stdout: debug asserts on shutdown = true 2024-09-17T05:20:53.711 INFO:teuthology.orchestra.run.smithi167.stdout: mon health detail to clog = false 2024-09-17T05:20:53.711 INFO:teuthology.orchestra.run.smithi167.stdout: mon host = "172.21.15.98,172.21.15.167,[v2:172.21.15.167:3301,v1:172.21.15.167:6790]" 2024-09-17T05:20:53.712 INFO:teuthology.orchestra.run.smithi167.stdout: ms die on skipped message = False 2024-09-17T05:20:53.712 INFO:teuthology.orchestra.run.smithi167.stdout: fsid = fcbf5a43-b3d8-497c-b15d-3cc022477cf0 2024-09-17T05:20:53.712 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T05:20:53.712 INFO:teuthology.orchestra.run.smithi167.stdout:[osd] 2024-09-17T05:20:53.712 INFO:teuthology.orchestra.run.smithi167.stdout: osd journal size = 100 2024-09-17T05:20:53.712 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T05:20:53.712 INFO:teuthology.orchestra.run.smithi167.stdout: osd scrub load threshold = 5.0 2024-09-17T05:20:53.712 INFO:teuthology.orchestra.run.smithi167.stdout: osd scrub max interval = 600 2024-09-17T05:20:53.712 INFO:teuthology.orchestra.run.smithi167.stdout: osd mclock profile = high_recovery_ops 2024-09-17T05:20:53.712 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T05:20:53.712 INFO:teuthology.orchestra.run.smithi167.stdout: osd recover clone overlap = true 2024-09-17T05:20:53.712 INFO:teuthology.orchestra.run.smithi167.stdout: osd recovery max chunk = 1048576 2024-09-17T05:20:53.713 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T05:20:53.713 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug shutdown = true 2024-09-17T05:20:53.713 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug op order = true 2024-09-17T05:20:53.713 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug verify stray on activate = true 2024-09-17T05:20:53.713 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug trim objects = true 2024-09-17T05:20:53.713 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T05:20:53.713 INFO:teuthology.orchestra.run.smithi167.stdout: osd open classes on start = true 2024-09-17T05:20:53.713 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug pg log writeout = true 2024-09-17T05:20:53.713 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T05:20:53.713 INFO:teuthology.orchestra.run.smithi167.stdout: osd deep scrub update digest min age = 30 2024-09-17T05:20:53.713 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T05:20:53.713 INFO:teuthology.orchestra.run.smithi167.stdout: osd map max advance = 10 2024-09-17T05:20:53.713 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T05:20:53.713 INFO:teuthology.orchestra.run.smithi167.stdout: journal zero on create = true 2024-09-17T05:20:53.714 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T05:20:53.714 INFO:teuthology.orchestra.run.smithi167.stdout: filestore ondisk finisher threads = 3 2024-09-17T05:20:53.714 INFO:teuthology.orchestra.run.smithi167.stdout: filestore apply finisher threads = 3 2024-09-17T05:20:53.714 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T05:20:53.714 INFO:teuthology.orchestra.run.smithi167.stdout: bdev debug aio = true 2024-09-17T05:20:53.714 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug misdirected ops = true 2024-09-17T05:20:53.714 INFO:teuthology.orchestra.run.smithi167.stdout: bdev async discard = True 2024-09-17T05:20:53.714 INFO:teuthology.orchestra.run.smithi167.stdout: bdev enable discard = True 2024-09-17T05:20:53.714 INFO:teuthology.orchestra.run.smithi167.stdout: bluestore allocator = bitmap 2024-09-17T05:20:53.714 INFO:teuthology.orchestra.run.smithi167.stdout: bluestore block size = 96636764160 2024-09-17T05:20:53.714 INFO:teuthology.orchestra.run.smithi167.stdout: bluestore fsck on mount = True 2024-09-17T05:20:53.714 INFO:teuthology.orchestra.run.smithi167.stdout: debug bluefs = 1/20 2024-09-17T05:20:53.715 INFO:teuthology.orchestra.run.smithi167.stdout: debug bluestore = 1/20 2024-09-17T05:20:53.715 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-09-17T05:20:53.715 INFO:teuthology.orchestra.run.smithi167.stdout: debug osd = 20 2024-09-17T05:20:53.715 INFO:teuthology.orchestra.run.smithi167.stdout: debug rocksdb = 4/10 2024-09-17T05:20:53.715 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T05:20:53.715 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd full ratio = 0.9 2024-09-17T05:20:53.715 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd nearfull ratio = 0.8 2024-09-17T05:20:53.715 INFO:teuthology.orchestra.run.smithi167.stdout: osd failsafe full ratio = 0.95 2024-09-17T05:20:53.715 INFO:teuthology.orchestra.run.smithi167.stdout: osd objectstore = bluestore 2024-09-17T05:20:53.715 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T05:20:53.715 INFO:teuthology.orchestra.run.smithi167.stdout:[mgr] 2024-09-17T05:20:53.715 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-09-17T05:20:53.715 INFO:teuthology.orchestra.run.smithi167.stdout: debug mgr = 20 2024-09-17T05:20:53.716 INFO:teuthology.orchestra.run.smithi167.stdout: debug mon = 20 2024-09-17T05:20:53.716 INFO:teuthology.orchestra.run.smithi167.stdout: debug auth = 20 2024-09-17T05:20:53.716 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min pgs per osd = 4 2024-09-17T05:20:53.716 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min bytes per osd = 10 2024-09-17T05:20:53.716 INFO:teuthology.orchestra.run.smithi167.stdout: mgr/telemetry/nag = false 2024-09-17T05:20:53.717 INFO:teuthology.orchestra.run.smithi167.stdout: client mount timeout = 30 2024-09-17T05:20:53.717 INFO:teuthology.orchestra.run.smithi167.stdout: debug client = 20 2024-09-17T05:20:53.717 INFO:teuthology.orchestra.run.smithi167.stdout: debug finisher = 20 2024-09-17T05:20:53.717 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T05:20:53.717 INFO:teuthology.orchestra.run.smithi167.stdout:[mon] 2024-09-17T05:20:53.717 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-09-17T05:20:53.717 INFO:teuthology.orchestra.run.smithi167.stdout: debug mon = 20 2024-09-17T05:20:53.717 INFO:teuthology.orchestra.run.smithi167.stdout: debug paxos = 20 2024-09-17T05:20:53.717 INFO:teuthology.orchestra.run.smithi167.stdout: debug auth = 20 2024-09-17T05:20:53.717 INFO:teuthology.orchestra.run.smithi167.stdout: mon data avail warn = 5 2024-09-17T05:20:53.717 INFO:teuthology.orchestra.run.smithi167.stdout: mon mgr mkfs grace = 240 2024-09-17T05:20:53.717 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min pgs per osd = 4 2024-09-17T05:20:53.718 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd reporter subtree level = osd 2024-09-17T05:20:53.718 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd prime pg temp = true 2024-09-17T05:20:53.718 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min bytes per osd = 10 2024-09-17T05:20:53.718 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T05:20:53.718 INFO:teuthology.orchestra.run.smithi167.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T05:20:53.718 INFO:teuthology.orchestra.run.smithi167.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T05:20:53.718 INFO:teuthology.orchestra.run.smithi167.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T05:20:53.718 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T05:20:53.718 INFO:teuthology.orchestra.run.smithi167.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T05:20:53.718 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T05:20:53.718 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T05:20:53.718 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T05:20:53.718 INFO:teuthology.orchestra.run.smithi167.stdout: # 1m isn't quite enough 2024-09-17T05:20:53.718 INFO:teuthology.orchestra.run.smithi167.stdout: mon_down_mkfs_grace = 2m 2024-09-17T05:20:53.718 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T05:20:53.719 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_filestore_osds = false 2024-09-17T05:20:53.719 INFO:teuthology.orchestra.run.smithi167.stdout: mon down mkfs grace = 300 2024-09-17T05:20:53.719 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T05:20:53.719 INFO:teuthology.orchestra.run.smithi167.stdout:[client] 2024-09-17T05:20:53.719 INFO:teuthology.orchestra.run.smithi167.stdout: rgw cache enabled = true 2024-09-17T05:20:53.719 INFO:teuthology.orchestra.run.smithi167.stdout: rgw enable ops log = true 2024-09-17T05:20:53.719 INFO:teuthology.orchestra.run.smithi167.stdout: rgw enable usage log = true 2024-09-17T05:20:53.719 INFO:teuthology.orchestra.run.smithi167.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T05:20:53.719 INFO:teuthology.orchestra.run.smithi167.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T05:20:53.719 INFO:teuthology.orchestra.run.smithi167.stdout: pid file = "" 2024-09-17T05:20:53.719 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.a] 2024-09-17T05:20:53.719 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.b] 2024-09-17T05:20:53.719 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.c] 2024-09-17T05:20:53.720 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.a] 2024-09-17T05:20:53.720 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.c] 2024-09-17T05:20:53.720 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.b] 2024-09-17T05:20:53.720 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.d] 2024-09-17T05:20:53.721 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-17T05:20:53.721 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-17T05:20:53.816 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-17T05:20:53.816 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T05:20:53.816 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-17T05:20:53.837 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T05:20:53.852 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-17T05:20:53.893 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi098.front.sepia.ceph.com 2024-09-17T05:20:53.893 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T05:20:53.894 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-17T05:20:53.894 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T05:20:53.968 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T05:20:53.968 DEBUG:teuthology.orchestra.run.smithi098:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:20:54.023 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi167.front.sepia.ceph.com 2024-09-17T05:20:54.023 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-17T05:20:54.023 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-17T05:20:54.023 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T05:20:54.062 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-17T05:20:54.062 DEBUG:teuthology.orchestra.run.smithi167:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:20:54.119 INFO:tasks.ceph:Setting up mon nodes... 2024-09-17T05:20:54.119 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-17T05:20:54.119 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-17T05:20:54.170 INFO:teuthology.orchestra.run.smithi098.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-17T05:20:54.173 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-17T05:20:54.233 INFO:teuthology.orchestra.run.smithi167.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-17T05:20:54.235 INFO:tasks.ceph:Setting up mds nodes... 2024-09-17T05:20:54.235 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-17T05:20:54.287 INFO:teuthology.orchestra.run.smithi098.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-17T05:20:54.289 DEBUG:teuthology.orchestra.run.smithi098:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-17T05:20:54.314 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-17T05:20:54.405 INFO:teuthology.orchestra.run.smithi098.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-17T05:20:54.408 DEBUG:teuthology.orchestra.run.smithi098:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-17T05:20:54.433 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-17T05:20:54.487 INFO:teuthology.orchestra.run.smithi167.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-17T05:20:54.490 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-17T05:20:54.515 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-17T05:20:54.607 INFO:teuthology.orchestra.run.smithi167.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-17T05:20:54.609 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-17T05:20:54.634 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-17T05:20:54.634 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-17T05:20:54.675 INFO:teuthology.orchestra.run.smithi098.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-17T05:20:54.688 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-17T05:20:54.769 INFO:teuthology.orchestra.run.smithi098.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-17T05:20:54.781 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-17T05:20:54.823 INFO:teuthology.orchestra.run.smithi167.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-17T05:20:54.835 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-17T05:20:54.918 INFO:teuthology.orchestra.run.smithi167.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-17T05:20:54.931 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-17T05:20:54.931 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi098.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi167.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-17T05:20:54.931 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-17T05:20:54.956 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T05:20:54.956 INFO:tasks.ceph:role: osd.0 2024-09-17T05:20:54.956 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi098.front.sepia.ceph.com 2024-09-17T05:20:54.956 DEBUG:teuthology.orchestra.run.smithi098:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-17T05:20:55.028 INFO:teuthology.orchestra.run.smithi098.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T05:20:55.028 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T05:20:55.028 INFO:teuthology.orchestra.run.smithi098.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T05:20:55.028 INFO:teuthology.orchestra.run.smithi098.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T05:20:55.028 INFO:teuthology.orchestra.run.smithi098.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T05:20:55.029 INFO:teuthology.orchestra.run.smithi098.stdout: = sunit=0 swidth=0 blks 2024-09-17T05:20:55.029 INFO:teuthology.orchestra.run.smithi098.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T05:20:55.029 INFO:teuthology.orchestra.run.smithi098.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T05:20:55.029 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T05:20:55.029 INFO:teuthology.orchestra.run.smithi098.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T05:20:55.534 INFO:teuthology.orchestra.run.smithi098.stdout:Discarding blocks...Done. 2024-09-17T05:20:55.536 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi098.front.sepia.ceph.com -o noatime 2024-09-17T05:20:55.536 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-17T05:20:55.659 DEBUG:teuthology.orchestra.run.smithi098:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-17T05:20:55.691 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-17T05:20:55.755 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T05:20:55.756 INFO:tasks.ceph:role: osd.1 2024-09-17T05:20:55.756 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi098.front.sepia.ceph.com 2024-09-17T05:20:55.756 DEBUG:teuthology.orchestra.run.smithi098:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-17T05:20:55.827 INFO:teuthology.orchestra.run.smithi098.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T05:20:55.827 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T05:20:55.828 INFO:teuthology.orchestra.run.smithi098.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T05:20:55.828 INFO:teuthology.orchestra.run.smithi098.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T05:20:55.828 INFO:teuthology.orchestra.run.smithi098.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T05:20:55.828 INFO:teuthology.orchestra.run.smithi098.stdout: = sunit=0 swidth=0 blks 2024-09-17T05:20:55.828 INFO:teuthology.orchestra.run.smithi098.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T05:20:55.828 INFO:teuthology.orchestra.run.smithi098.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T05:20:55.828 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T05:20:55.828 INFO:teuthology.orchestra.run.smithi098.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T05:20:56.298 INFO:teuthology.orchestra.run.smithi098.stdout:Discarding blocks...Done. 2024-09-17T05:20:56.300 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi098.front.sepia.ceph.com -o noatime 2024-09-17T05:20:56.300 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-17T05:20:56.390 DEBUG:teuthology.orchestra.run.smithi098:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-17T05:20:56.418 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-17T05:20:56.484 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T05:20:56.484 INFO:tasks.ceph:role: osd.2 2024-09-17T05:20:56.484 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi098.front.sepia.ceph.com 2024-09-17T05:20:56.484 DEBUG:teuthology.orchestra.run.smithi098:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-17T05:20:56.557 INFO:teuthology.orchestra.run.smithi098.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T05:20:56.557 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T05:20:56.557 INFO:teuthology.orchestra.run.smithi098.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T05:20:56.557 INFO:teuthology.orchestra.run.smithi098.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T05:20:56.557 INFO:teuthology.orchestra.run.smithi098.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T05:20:56.557 INFO:teuthology.orchestra.run.smithi098.stdout: = sunit=0 swidth=0 blks 2024-09-17T05:20:56.557 INFO:teuthology.orchestra.run.smithi098.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T05:20:56.557 INFO:teuthology.orchestra.run.smithi098.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T05:20:56.557 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T05:20:56.558 INFO:teuthology.orchestra.run.smithi098.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T05:20:57.052 INFO:teuthology.orchestra.run.smithi098.stdout:Discarding blocks...Done. 2024-09-17T05:20:57.057 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi098.front.sepia.ceph.com -o noatime 2024-09-17T05:20:57.057 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-17T05:20:57.189 DEBUG:teuthology.orchestra.run.smithi098:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-17T05:20:57.219 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-17T05:20:57.284 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T05:20:57.284 INFO:tasks.ceph:role: osd.3 2024-09-17T05:20:57.284 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi098.front.sepia.ceph.com 2024-09-17T05:20:57.284 DEBUG:teuthology.orchestra.run.smithi098:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-17T05:20:57.355 INFO:teuthology.orchestra.run.smithi098.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T05:20:57.356 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T05:20:57.356 INFO:teuthology.orchestra.run.smithi098.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T05:20:57.356 INFO:teuthology.orchestra.run.smithi098.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T05:20:57.356 INFO:teuthology.orchestra.run.smithi098.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T05:20:57.356 INFO:teuthology.orchestra.run.smithi098.stdout: = sunit=0 swidth=0 blks 2024-09-17T05:20:57.356 INFO:teuthology.orchestra.run.smithi098.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T05:20:57.356 INFO:teuthology.orchestra.run.smithi098.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T05:20:57.356 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T05:20:57.356 INFO:teuthology.orchestra.run.smithi098.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T05:20:57.878 INFO:teuthology.orchestra.run.smithi098.stdout:Discarding blocks...Done. 2024-09-17T05:20:57.881 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi098.front.sepia.ceph.com -o noatime 2024-09-17T05:20:57.881 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-17T05:20:57.998 DEBUG:teuthology.orchestra.run.smithi098:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-17T05:20:58.031 DEBUG:teuthology.orchestra.run.smithi098:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:20:58.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:20:58.123+0000 7f5c9b622640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-17T05:20:58.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:20:58.123+0000 7f5c9b622640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-17T05:20:58.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:20:58.124+0000 7f5c9b622640 -1 bdev(0x55c51b357800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-17T05:20:58.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:20:58.124+0000 7f5c9b622640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-17T05:21:01.550 DEBUG:teuthology.orchestra.run.smithi098:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-17T05:21:01.582 DEBUG:teuthology.orchestra.run.smithi098:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:21:01.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:01.672+0000 7f1c321a4640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-17T05:21:01.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:01.672+0000 7f1c321a4640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-17T05:21:01.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:01.672+0000 7f1c321a4640 -1 bdev(0x558b45e55800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-17T05:21:01.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:01.672+0000 7f1c321a4640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-17T05:21:05.086 DEBUG:teuthology.orchestra.run.smithi098:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-17T05:21:05.116 DEBUG:teuthology.orchestra.run.smithi098:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:21:05.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:05.204+0000 7fd407830640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-17T05:21:05.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:05.204+0000 7fd407830640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-17T05:21:05.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:05.204+0000 7fd407830640 -1 bdev(0x55f1fb93d800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-17T05:21:05.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:05.205+0000 7fd407830640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-17T05:21:08.113 DEBUG:teuthology.orchestra.run.smithi098:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-17T05:21:08.139 DEBUG:teuthology.orchestra.run.smithi098:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:21:08.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:08.224+0000 7fe81071e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-17T05:21:08.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:08.224+0000 7fe81071e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-17T05:21:08.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:08.224+0000 7fe81071e640 -1 bdev(0x5594fadb1800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-17T05:21:08.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:08.224+0000 7fe81071e640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-17T05:21:11.132 DEBUG:teuthology.orchestra.run.smithi098:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-17T05:21:11.161 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-17T05:21:11.192 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T05:21:11.193 INFO:tasks.ceph:role: osd.4 2024-09-17T05:21:11.193 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi167.front.sepia.ceph.com 2024-09-17T05:21:11.193 DEBUG:teuthology.orchestra.run.smithi167:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-17T05:21:11.270 INFO:teuthology.orchestra.run.smithi167.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T05:21:11.270 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T05:21:11.270 INFO:teuthology.orchestra.run.smithi167.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T05:21:11.270 INFO:teuthology.orchestra.run.smithi167.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T05:21:11.270 INFO:teuthology.orchestra.run.smithi167.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T05:21:11.271 INFO:teuthology.orchestra.run.smithi167.stdout: = sunit=0 swidth=0 blks 2024-09-17T05:21:11.271 INFO:teuthology.orchestra.run.smithi167.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T05:21:11.271 INFO:teuthology.orchestra.run.smithi167.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T05:21:11.271 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T05:21:11.271 INFO:teuthology.orchestra.run.smithi167.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T05:21:11.770 INFO:teuthology.orchestra.run.smithi167.stdout:Discarding blocks...Done. 2024-09-17T05:21:11.772 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi167.front.sepia.ceph.com -o noatime 2024-09-17T05:21:11.772 DEBUG:teuthology.orchestra.run.smithi167:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-17T05:21:11.883 DEBUG:teuthology.orchestra.run.smithi167:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-17T05:21:11.915 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-17T05:21:11.980 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T05:21:11.980 INFO:tasks.ceph:role: osd.5 2024-09-17T05:21:11.980 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi167.front.sepia.ceph.com 2024-09-17T05:21:11.980 DEBUG:teuthology.orchestra.run.smithi167:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-17T05:21:12.053 INFO:teuthology.orchestra.run.smithi167.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T05:21:12.053 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T05:21:12.053 INFO:teuthology.orchestra.run.smithi167.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T05:21:12.053 INFO:teuthology.orchestra.run.smithi167.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T05:21:12.053 INFO:teuthology.orchestra.run.smithi167.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T05:21:12.053 INFO:teuthology.orchestra.run.smithi167.stdout: = sunit=0 swidth=0 blks 2024-09-17T05:21:12.053 INFO:teuthology.orchestra.run.smithi167.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T05:21:12.053 INFO:teuthology.orchestra.run.smithi167.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T05:21:12.054 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T05:21:12.054 INFO:teuthology.orchestra.run.smithi167.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T05:21:12.519 INFO:teuthology.orchestra.run.smithi167.stdout:Discarding blocks...Done. 2024-09-17T05:21:12.521 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi167.front.sepia.ceph.com -o noatime 2024-09-17T05:21:12.521 DEBUG:teuthology.orchestra.run.smithi167:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-17T05:21:12.605 DEBUG:teuthology.orchestra.run.smithi167:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-17T05:21:12.635 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-17T05:21:12.700 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T05:21:12.700 INFO:tasks.ceph:role: osd.6 2024-09-17T05:21:12.700 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi167.front.sepia.ceph.com 2024-09-17T05:21:12.701 DEBUG:teuthology.orchestra.run.smithi167:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-17T05:21:12.772 INFO:teuthology.orchestra.run.smithi167.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T05:21:12.772 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T05:21:12.772 INFO:teuthology.orchestra.run.smithi167.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T05:21:12.772 INFO:teuthology.orchestra.run.smithi167.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T05:21:12.772 INFO:teuthology.orchestra.run.smithi167.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T05:21:12.773 INFO:teuthology.orchestra.run.smithi167.stdout: = sunit=0 swidth=0 blks 2024-09-17T05:21:12.773 INFO:teuthology.orchestra.run.smithi167.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T05:21:12.773 INFO:teuthology.orchestra.run.smithi167.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T05:21:12.773 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T05:21:12.773 INFO:teuthology.orchestra.run.smithi167.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T05:21:13.262 INFO:teuthology.orchestra.run.smithi167.stdout:Discarding blocks...Done. 2024-09-17T05:21:13.265 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi167.front.sepia.ceph.com -o noatime 2024-09-17T05:21:13.265 DEBUG:teuthology.orchestra.run.smithi167:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-17T05:21:13.399 DEBUG:teuthology.orchestra.run.smithi167:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-17T05:21:13.428 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-17T05:21:13.493 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T05:21:13.493 INFO:tasks.ceph:role: osd.7 2024-09-17T05:21:13.493 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi167.front.sepia.ceph.com 2024-09-17T05:21:13.493 DEBUG:teuthology.orchestra.run.smithi167:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-17T05:21:13.565 INFO:teuthology.orchestra.run.smithi167.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T05:21:13.565 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T05:21:13.565 INFO:teuthology.orchestra.run.smithi167.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T05:21:13.565 INFO:teuthology.orchestra.run.smithi167.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T05:21:13.566 INFO:teuthology.orchestra.run.smithi167.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T05:21:13.566 INFO:teuthology.orchestra.run.smithi167.stdout: = sunit=0 swidth=0 blks 2024-09-17T05:21:13.566 INFO:teuthology.orchestra.run.smithi167.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T05:21:13.566 INFO:teuthology.orchestra.run.smithi167.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T05:21:13.566 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T05:21:13.566 INFO:teuthology.orchestra.run.smithi167.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T05:21:14.066 INFO:teuthology.orchestra.run.smithi167.stdout:Discarding blocks...Done. 2024-09-17T05:21:14.068 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi167.front.sepia.ceph.com -o noatime 2024-09-17T05:21:14.069 DEBUG:teuthology.orchestra.run.smithi167:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-17T05:21:14.224 DEBUG:teuthology.orchestra.run.smithi167:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-17T05:21:14.256 DEBUG:teuthology.orchestra.run.smithi167:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:21:14.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:14.354+0000 7fab7e82e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-17T05:21:14.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:14.354+0000 7fab7e82e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-17T05:21:14.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:14.354+0000 7fab7e82e640 -1 bdev(0x55adbe8cb800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-17T05:21:14.356 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:14.354+0000 7fab7e82e640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-17T05:21:17.277 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-17T05:21:17.307 DEBUG:teuthology.orchestra.run.smithi167:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:21:17.397 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:17.396+0000 7f7477e26640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-17T05:21:17.398 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:17.396+0000 7f7477e26640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-17T05:21:17.398 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:17.396+0000 7f7477e26640 -1 bdev(0x561801c91800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-17T05:21:17.398 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:17.396+0000 7f7477e26640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-17T05:21:20.809 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-17T05:21:20.838 DEBUG:teuthology.orchestra.run.smithi167:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:21:20.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:20.927+0000 7f6c4e917640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-17T05:21:20.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:20.927+0000 7f6c4e917640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-17T05:21:20.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:20.927+0000 7f6c4e917640 -1 bdev(0x5584aa905800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-17T05:21:20.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:20.929+0000 7f6c4e917640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-17T05:21:21.708 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:21:21.711 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:21:23.842 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-17T05:21:23.867 DEBUG:teuthology.orchestra.run.smithi167:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:21:23.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:23.953+0000 7f8b5dc10640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-17T05:21:23.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:23.953+0000 7f8b5dc10640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-17T05:21:23.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:23.953+0000 7f8b5dc10640 -1 bdev(0x55e49c381800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-17T05:21:23.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:23.953+0000 7f8b5dc10640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-17T05:21:26.860 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-17T05:21:26.886 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-17T05:21:26.887 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T05:21:26.887 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-17T05:21:26.916 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T05:21:26.916 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-17T05:21:26.985 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T05:21:26.986 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-17T05:21:27.056 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T05:21:27.056 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-17T05:21:27.121 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T05:21:27.122 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-17T05:21:27.189 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T05:21:27.189 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-17T05:21:27.255 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T05:21:27.255 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-17T05:21:27.321 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-17T05:21:27.321 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-17T05:21:27.351 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-17T05:21:27.352 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-17T05:21:27.422 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-17T05:21:27.422 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-17T05:21:27.492 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-17T05:21:27.493 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-17T05:21:27.559 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-17T05:21:27.560 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-17T05:21:27.626 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-17T05:21:27.626 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-17T05:21:27.694 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-17T05:21:27.695 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-17T05:21:27.761 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T05:21:27.762 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-17T05:21:27.780 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T05:21:27.781 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-17T05:21:27.839 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-17T05:21:27.839 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-17T05:21:27.856 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-17T05:21:27.856 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-17T05:21:27.913 INFO:tasks.ceph:Adding keys to all mons... 2024-09-17T05:21:27.913 DEBUG:teuthology.orchestra.run.smithi098:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-17T05:21:27.916 DEBUG:teuthology.orchestra.run.smithi167:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-17T05:21:27.957 INFO:teuthology.orchestra.run.smithi098.stdout:[mgr.y] 2024-09-17T05:21:27.957 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQC2EelmCEkxChAAMnvoSm0EN6RXpSr1DG1ioA== 2024-09-17T05:21:27.957 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.a] 2024-09-17T05:21:27.957 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQC2EelmWdIiERAA4HMb0F3k0oYcwhkoYS/FJA== 2024-09-17T05:21:27.957 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.c] 2024-09-17T05:21:27.958 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQC2EelmRzMvGBAAd7hCIMHumQYyJ1qYKn9Y5A== 2024-09-17T05:21:27.958 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.0] 2024-09-17T05:21:27.958 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQC6EelmzxdsBxAAiZ//FCaukUdkU4O0w8L7MA== 2024-09-17T05:21:27.958 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.1] 2024-09-17T05:21:27.958 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQC9EelmhSIdKBAAHroQTeKOhU/EmpEBQ6jmSw== 2024-09-17T05:21:27.958 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.2] 2024-09-17T05:21:27.958 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQDBEelm3wI/DBAAEqVMzgg03GXB9jKN9MwG8w== 2024-09-17T05:21:27.959 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.3] 2024-09-17T05:21:27.959 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQDEEelmyhZvDRAAxm9qIXHA27E68zXS3BslkA== 2024-09-17T05:21:27.959 INFO:teuthology.orchestra.run.smithi098.stdout:[mgr.x] 2024-09-17T05:21:27.959 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQC2Eelme+LlDRAAkuzoXi+8KWoc1aIq1k6tDQ== 2024-09-17T05:21:27.959 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.b] 2024-09-17T05:21:27.959 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQC2EelmV0UQHRAAALkvMpdBz71cUZjjiEiP/w== 2024-09-17T05:21:27.959 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.d] 2024-09-17T05:21:27.959 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQC2EelmtuA1JBAAAbIqdaVsptCdWaptWM2NRw== 2024-09-17T05:21:27.959 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.4] 2024-09-17T05:21:27.959 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQDKEelmuPw2FRAAdqhDXn+wCy73oM/oFT56Ug== 2024-09-17T05:21:27.959 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.5] 2024-09-17T05:21:27.960 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQDNEelmFi60FxAAZWWAfc8CsmEKlGRO9I+MzA== 2024-09-17T05:21:27.960 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.6] 2024-09-17T05:21:27.960 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQDQEelmSMpgNxAAJBbanlZzzQwzB/yn1jqcNA== 2024-09-17T05:21:27.960 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.7] 2024-09-17T05:21:27.960 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQDTEelmd6rXOBAAUd9wfuxRVZ2lkZDDDlSL+A== 2024-09-17T05:21:27.960 INFO:teuthology.orchestra.run.smithi098.stdout:[client.0] 2024-09-17T05:21:27.960 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQC2EelmTC1KKBAAXutxPyhWEuBL6NvHRzTrpg== 2024-09-17T05:21:27.960 INFO:teuthology.orchestra.run.smithi098.stdout:[client.2] 2024-09-17T05:21:27.960 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQC2EelmjDbfLRAA7oy8N8um+i6CFwXMZ7cqEw== 2024-09-17T05:21:27.960 INFO:teuthology.orchestra.run.smithi098.stdout:[client.1] 2024-09-17T05:21:27.960 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQC2EelmO/wRMRAAF/Xcv4IC0ZfNQxiGQwYKBg== 2024-09-17T05:21:27.960 INFO:teuthology.orchestra.run.smithi098.stdout:[client.3] 2024-09-17T05:21:27.961 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQC2EelmiUbBNhAAEltib5g5KVsJfYrwxQkNqg== 2024-09-17T05:21:27.977 INFO:teuthology.orchestra.run.smithi167.stdout:[mgr.y] 2024-09-17T05:21:27.977 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQC2EelmCEkxChAAMnvoSm0EN6RXpSr1DG1ioA== 2024-09-17T05:21:27.977 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.a] 2024-09-17T05:21:27.977 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQC2EelmWdIiERAA4HMb0F3k0oYcwhkoYS/FJA== 2024-09-17T05:21:27.978 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.c] 2024-09-17T05:21:27.978 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQC2EelmRzMvGBAAd7hCIMHumQYyJ1qYKn9Y5A== 2024-09-17T05:21:27.978 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.0] 2024-09-17T05:21:27.978 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQC6EelmzxdsBxAAiZ//FCaukUdkU4O0w8L7MA== 2024-09-17T05:21:27.978 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.1] 2024-09-17T05:21:27.978 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQC9EelmhSIdKBAAHroQTeKOhU/EmpEBQ6jmSw== 2024-09-17T05:21:27.978 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.2] 2024-09-17T05:21:27.978 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQDBEelm3wI/DBAAEqVMzgg03GXB9jKN9MwG8w== 2024-09-17T05:21:27.978 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.3] 2024-09-17T05:21:27.978 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQDEEelmyhZvDRAAxm9qIXHA27E68zXS3BslkA== 2024-09-17T05:21:27.978 INFO:teuthology.orchestra.run.smithi167.stdout:[mgr.x] 2024-09-17T05:21:27.978 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQC2Eelme+LlDRAAkuzoXi+8KWoc1aIq1k6tDQ== 2024-09-17T05:21:27.978 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.b] 2024-09-17T05:21:27.979 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQC2EelmV0UQHRAAALkvMpdBz71cUZjjiEiP/w== 2024-09-17T05:21:27.979 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.d] 2024-09-17T05:21:27.979 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQC2EelmtuA1JBAAAbIqdaVsptCdWaptWM2NRw== 2024-09-17T05:21:27.979 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.4] 2024-09-17T05:21:27.979 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQDKEelmuPw2FRAAdqhDXn+wCy73oM/oFT56Ug== 2024-09-17T05:21:27.979 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.5] 2024-09-17T05:21:27.979 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQDNEelmFi60FxAAZWWAfc8CsmEKlGRO9I+MzA== 2024-09-17T05:21:27.979 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.6] 2024-09-17T05:21:27.979 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQDQEelmSMpgNxAAJBbanlZzzQwzB/yn1jqcNA== 2024-09-17T05:21:27.979 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.7] 2024-09-17T05:21:27.979 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQDTEelmd6rXOBAAUd9wfuxRVZ2lkZDDDlSL+A== 2024-09-17T05:21:27.980 INFO:teuthology.orchestra.run.smithi167.stdout:[client.0] 2024-09-17T05:21:27.980 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQC2EelmTC1KKBAAXutxPyhWEuBL6NvHRzTrpg== 2024-09-17T05:21:27.980 INFO:teuthology.orchestra.run.smithi167.stdout:[client.2] 2024-09-17T05:21:27.980 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQC2EelmjDbfLRAA7oy8N8um+i6CFwXMZ7cqEw== 2024-09-17T05:21:27.980 INFO:teuthology.orchestra.run.smithi167.stdout:[client.1] 2024-09-17T05:21:27.980 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQC2EelmO/wRMRAAF/Xcv4IC0ZfNQxiGQwYKBg== 2024-09-17T05:21:27.980 INFO:teuthology.orchestra.run.smithi167.stdout:[client.3] 2024-09-17T05:21:27.980 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQC2EelmiUbBNhAAEltib5g5KVsJfYrwxQkNqg== 2024-09-17T05:21:27.981 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T05:21:28.005 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T05:21:28.073 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T05:21:28.075 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T05:21:28.130 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T05:21:28.133 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T05:21:28.187 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:21:28.189 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:21:28.241 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:21:28.244 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:21:28.295 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:21:28.297 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:21:28.348 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:21:28.350 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:21:28.401 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T05:21:28.404 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T05:21:28.456 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T05:21:28.458 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T05:21:28.512 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T05:21:28.515 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T05:21:28.569 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:21:28.571 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:21:28.623 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:21:28.626 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:21:28.677 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:21:28.679 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:21:28.730 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:21:28.733 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:21:28.785 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T05:21:28.787 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T05:21:28.842 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T05:21:28.844 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T05:21:28.898 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T05:21:28.901 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T05:21:28.957 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T05:21:28.960 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T05:21:29.014 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-17T05:21:29.014 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-17T05:21:29.039 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T05:21:29.135 DEBUG:teuthology.orchestra.run.smithi098:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-17T05:21:29.161 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-17T05:21:29.186 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T05:21:29.283 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-17T05:21:29.309 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-17T05:21:29.374 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T05:21:29.470 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-17T05:21:29.495 DEBUG:teuthology.orchestra.run.smithi098:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:21:29.497 DEBUG:teuthology.orchestra.run.smithi167:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:21:29.550 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-17T05:21:29.550 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-17T05:21:29.551 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-17T05:21:29.554 INFO:tasks.ceph.mon.a:Started 2024-09-17T05:21:29.554 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-17T05:21:29.554 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-17T05:21:29.592 INFO:tasks.ceph.mon.b:Started 2024-09-17T05:21:29.592 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-17T05:21:29.593 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-17T05:21:29.595 INFO:tasks.ceph.mon.c:Started 2024-09-17T05:21:29.595 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-17T05:21:29.595 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-17T05:21:29.595 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-17T05:21:29.597 INFO:tasks.ceph.mgr.y:Started 2024-09-17T05:21:29.598 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-17T05:21:29.598 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-17T05:21:29.602 INFO:tasks.ceph.mgr.x:Started 2024-09-17T05:21:29.603 INFO:tasks.ceph:setting config [client] client_mount_timeout = 600 2024-09-17T05:21:29.603 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph config set client client_mount_timeout 600 2024-09-17T05:21:29.605 INFO:tasks.ceph:setting config [client] debug_client = 20 2024-09-17T05:21:29.605 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph config set client debug_client 20 2024-09-17T05:21:29.649 INFO:tasks.ceph:setting config [client] debug_ms = 1 2024-09-17T05:21:29.649 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph config set client debug_ms 1 2024-09-17T05:21:29.693 INFO:tasks.ceph:setting config [client] rados_mon_op_timeout = 900 2024-09-17T05:21:29.694 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph config set client rados_mon_op_timeout 900 2024-09-17T05:21:29.736 INFO:tasks.ceph:setting config [client] rados_osd_op_timeout = 900 2024-09-17T05:21:29.737 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph config set client rados_osd_op_timeout 900 2024-09-17T05:21:29.780 INFO:tasks.ceph:setting config [mds] debug_mds = 20 2024-09-17T05:21:29.780 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph config set mds debug_mds 20 2024-09-17T05:21:29.823 INFO:tasks.ceph:setting config [mds] debug_mds_balancer = 20 2024-09-17T05:21:29.823 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph config set mds debug_mds_balancer 20 2024-09-17T05:21:29.867 INFO:tasks.ceph:setting config [mds] debug_ms = 2 2024-09-17T05:21:29.867 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph config set mds debug_ms 2 2024-09-17T05:21:29.910 INFO:tasks.ceph:setting config [mds] mds_debug_frag = True 2024-09-17T05:21:29.911 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph config set mds mds_debug_frag True 2024-09-17T05:21:29.955 INFO:tasks.ceph:setting config [mds] mds_debug_scatterstat = True 2024-09-17T05:21:29.955 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph config set mds mds_debug_scatterstat True 2024-09-17T05:21:30.001 INFO:tasks.ceph:setting config [mds] mds_op_complaint_time = 180 2024-09-17T05:21:30.002 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph config set mds mds_op_complaint_time 180 2024-09-17T05:21:30.050 INFO:tasks.ceph:setting config [mds] mds_verify_scatter = True 2024-09-17T05:21:30.050 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph config set mds mds_verify_scatter True 2024-09-17T05:21:30.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.048+0000 7f2fc6ffd640 1 -- 172.21.15.98:0/1554703057 <== mon.2 v2:172.21.15.167:3301/0 10 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f2fcc046d70 con 0x7f2fd80c6420 2024-09-17T05:21:30.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.048+0000 7f2fc6ffd640 1 -- 172.21.15.98:0/1554703057 <== mon.2 v2:172.21.15.167:3301/0 11 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v5)=0 v5) ==== 114+0+0 (secure 0 0 0) 0x7f2fcc04f3f0 con 0x7f2fd80c6420 2024-09-17T05:21:30.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.047+0000 7fdd56bec640 1 -- 172.21.15.98:0/2794617992 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd40003a50 msgr2=0x7fdd50151f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.047+0000 7fdd56bec640 1 --2- 172.21.15.98:0/2794617992 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd40003a50 0x7fdd50151f50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdd44005f10 tx=0x7fdd44004730 comp rx=0 tx=0).stop 2024-09-17T05:21:30.052 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.049+0000 7f2eb97fa640 1 -- 172.21.15.98:0/2986342697 <== mon.0 v2:172.21.15.98:3300/0 10 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f2eac03d410 con 0x7f2ebc070550 2024-09-17T05:21:30.052 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.049+0000 7f072a7fc640 1 -- 172.21.15.98:0/4224300740 <== mon.1 v2:172.21.15.167:3300/0 10 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f073000f3e0 con 0x7f07380cffa0 2024-09-17T05:21:30.052 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.051+0000 7f2fdcc52640 1 -- 172.21.15.98:0/1554703057 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2fd80c6420 msgr2=0x7f2fd80b5500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.051+0000 7f2fdcc52640 1 --2- 172.21.15.98:0/1554703057 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2fd80c6420 0x7f2fd80b5500 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2fc000bb80 tx=0x7f2fcc004730 comp rx=0 tx=0).stop 2024-09-17T05:21:30.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.051+0000 7fdd56bec640 1 -- 172.21.15.98:0/2794617992 shutdown_connections 2024-09-17T05:21:30.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.051+0000 7fdd56bec640 1 --2- 172.21.15.98:0/2794617992 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd500c8e60 0x7fdd500c92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.051+0000 7fdd56bec640 1 --2- 172.21.15.98:0/2794617992 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd500c6610 0x7fdd500c6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.051+0000 7fdd56bec640 1 --2- 172.21.15.98:0/2794617992 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd40003a50 0x7fdd50151f50 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.051+0000 7fdd56bec640 1 -- 172.21.15.98:0/2794617992 >> 172.21.15.98:0/2794617992 conn(0x7fdd500d0d40 msgr2=0x7fdd500b3b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:30.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.051+0000 7f2fdcc52640 1 -- 172.21.15.98:0/1554703057 shutdown_connections 2024-09-17T05:21:30.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.051+0000 7f2fdcc52640 1 --2- 172.21.15.98:0/1554703057 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2fd815ae00 0x7f2fd80b5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.055 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.051+0000 7f2fdcc52640 1 --2- 172.21.15.98:0/1554703057 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2fd80c6420 0x7f2fd80b5500 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.055 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.051+0000 7f2fdcc52640 1 --2- 172.21.15.98:0/1554703057 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fc00037a0 0x7f2fd815a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.055 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.051+0000 7f2fdcc52640 1 -- 172.21.15.98:0/1554703057 >> 172.21.15.98:0/1554703057 conn(0x7f2fd80d0500 msgr2=0x7f2fd80b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:30.055 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.051+0000 7f2fdcc52640 1 -- 172.21.15.98:0/1554703057 shutdown_connections 2024-09-17T05:21:30.055 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.051+0000 7f2fdcc52640 1 -- 172.21.15.98:0/1554703057 wait complete. 2024-09-17T05:21:30.055 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.051+0000 7fdd56bec640 1 -- 172.21.15.98:0/2794617992 shutdown_connections 2024-09-17T05:21:30.055 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.051+0000 7fdd56bec640 1 -- 172.21.15.98:0/2794617992 wait complete. 2024-09-17T05:21:30.056 INFO:tasks.ceph:setting config [mds] osd_op_complaint_time = 180 2024-09-17T05:21:30.057 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph config set mds osd_op_complaint_time 180 2024-09-17T05:21:30.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.058+0000 7feac4356640 1 -- 172.21.15.98:0/1157905455 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feabc0b2db0 msgr2=0x7feabc15eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.058+0000 7feac4356640 1 --2- 172.21.15.98:0/1157905455 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feabc0b2db0 0x7feabc15eb00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7feabc072710 tx=0x7feaac02a4b0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.058+0000 7feac4356640 1 -- 172.21.15.98:0/1157905455 shutdown_connections 2024-09-17T05:21:30.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.058+0000 7feac4356640 1 --2- 172.21.15.98:0/1157905455 >> v2:172.21.15.167:3300/0 conn(0x7feabc0b3190 0x7feabc15f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.058+0000 7feac4356640 1 --2- 172.21.15.98:0/1157905455 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feabc0b2db0 0x7feabc15eb00 secure :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7feabc072710 tx=0x7feaac02a4b0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.058+0000 7feac4356640 1 -- 172.21.15.98:0/1157905455 >> 172.21.15.98:0/1157905455 conn(0x7feabc0b1840 msgr2=0x7feabc0b1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:30.066 INFO:tasks.ceph:setting config [mds] rados_mon_op_timeout = 900 2024-09-17T05:21:30.066 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph config set mds rados_mon_op_timeout 900 2024-09-17T05:21:30.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.065+0000 7feac4356640 1 -- 172.21.15.98:0/1157905455 shutdown_connections 2024-09-17T05:21:30.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.069+0000 7feac4356640 1 -- 172.21.15.98:0/1157905455 wait complete. 2024-09-17T05:21:30.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.070+0000 7feac4356640 1 Processor -- start 2024-09-17T05:21:30.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.070+0000 7feac4356640 1 -- start start 2024-09-17T05:21:30.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.072+0000 7feac4356640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feabc0b3190 0x7feabc14ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:30.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.072+0000 7feac4356640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feabc13e3d0 0x7feabc138390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:30.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.072+0000 7feac4356640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feabc1388d0 0x7feabc0b0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:30.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.072+0000 7feac4356640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7feabc13f2a0 con 0x7feabc1388d0 2024-09-17T05:21:30.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.072+0000 7feac4356640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7feabc13f120 con 0x7feabc13e3d0 2024-09-17T05:21:30.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.072+0000 7feac4356640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7feabc13f420 con 0x7feabc0b3190 2024-09-17T05:21:30.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.072+0000 7feac18f1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feabc13e3d0 0x7feabc138390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:30.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.072+0000 7feac18f1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feabc13e3d0 0x7feabc138390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.98:39430/0 (socket says 172.21.15.98:39430) 2024-09-17T05:21:30.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.072+0000 7feac18f1640 1 -- 172.21.15.98:0/2334621855 learned_addr learned my addr 172.21.15.98:0/2334621855 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:21:30.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.072+0000 7feac28f3640 1 --2- 172.21.15.98:0/2334621855 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feabc1388d0 0x7feabc0b0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:30.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.073+0000 7feac28f3640 1 -- 172.21.15.98:0/2334621855 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feabc0b3190 msgr2=0x7feabc14ac90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T05:21:30.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.073+0000 7feac28f3640 1 --2- 172.21.15.98:0/2334621855 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feabc0b3190 0x7feabc14ac90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.073+0000 7feac28f3640 1 -- 172.21.15.98:0/2334621855 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feabc13e3d0 msgr2=0x7feabc138390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.073+0000 7feac28f3640 1 --2- 172.21.15.98:0/2334621855 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feabc13e3d0 0x7feabc138390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.073+0000 7feac28f3640 1 -- 172.21.15.98:0/2334621855 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feabc14e1e0 con 0x7feabc1388d0 2024-09-17T05:21:30.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.073+0000 7feac28f3640 1 --2- 172.21.15.98:0/2334621855 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feabc1388d0 0x7feabc0b0960 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7feab400cda0 tx=0x7feab400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:30.078 INFO:tasks.ceph:setting config [mds] rados_osd_op_timeout = 900 2024-09-17T05:21:30.078 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph config set mds rados_osd_op_timeout 900 2024-09-17T05:21:30.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.075+0000 7feab2ffd640 1 -- 172.21.15.98:0/2334621855 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab4016020 con 0x7feabc1388d0 2024-09-17T05:21:30.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.075+0000 7feab2ffd640 1 -- 172.21.15.98:0/2334621855 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7feab400ac10 con 0x7feabc1388d0 2024-09-17T05:21:30.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.075+0000 7feab2ffd640 1 -- 172.21.15.98:0/2334621855 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab4012420 con 0x7feabc1388d0 2024-09-17T05:21:30.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.075+0000 7feac4356640 1 -- 172.21.15.98:0/2334621855 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feabc14e4c0 con 0x7feabc1388d0 2024-09-17T05:21:30.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.075+0000 7feac4356640 1 -- 172.21.15.98:0/2334621855 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feabc14a770 con 0x7feabc1388d0 2024-09-17T05:21:30.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.075+0000 7feab2ffd640 1 -- 172.21.15.98:0/2334621855 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7feab4019020 con 0x7feabc1388d0 2024-09-17T05:21:30.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.075+0000 7feab2ffd640 1 -- 172.21.15.98:0/2334621855 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7feab401bbf0 con 0x7feabc1388d0 2024-09-17T05:21:30.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.080+0000 7feac4356640 1 -- 172.21.15.98:0/2334621855 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feaa4005290 con 0x7feabc1388d0 2024-09-17T05:21:30.085 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.084+0000 7feab2ffd640 1 -- 172.21.15.98:0/2334621855 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7feab4020020 con 0x7feabc1388d0 2024-09-17T05:21:30.089 INFO:tasks.ceph:setting config [mon] mon_op_complaint_time = 120 2024-09-17T05:21:30.089 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph config set mon mon_op_complaint_time 120 2024-09-17T05:21:30.107 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.107+0000 7f2ec2ea9640 1 -- 172.21.15.98:0/2986342697 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f2e94005310 con 0x7f2ebc070550 2024-09-17T05:21:30.109 INFO:tasks.ceph:setting config [mon] mon_warn_on_pool_no_app = False 2024-09-17T05:21:30.109 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph config set mon mon_warn_on_pool_no_app False 2024-09-17T05:21:30.110 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.108+0000 7fa1f9f9f640 1 -- 172.21.15.98:0/730650728 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1f415b910 msgr2=0x7fa1f40688b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.110 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.108+0000 7fa1f9f9f640 1 --2- 172.21.15.98:0/730650728 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1f415b910 0x7fa1f40688b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8005fd0 tx=0x7fa1e8032d40 comp rx=0 tx=0).stop 2024-09-17T05:21:30.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.109+0000 7fa1f9f9f640 1 -- 172.21.15.98:0/730650728 shutdown_connections 2024-09-17T05:21:30.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.109+0000 7fa1f9f9f640 1 --2- 172.21.15.98:0/730650728 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1f415b910 0x7fa1f40688b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.109+0000 7fa1f9f9f640 1 -- 172.21.15.98:0/730650728 >> 172.21.15.98:0/730650728 conn(0x7fa1f40ccec0 msgr2=0x7fa1f40cd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:30.114 INFO:tasks.ceph:setting config [osd] osd_op_complaint_time = 180 2024-09-17T05:21:30.115 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph config set osd osd_op_complaint_time 180 2024-09-17T05:21:30.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.113+0000 7fa1f9f9f640 1 -- 172.21.15.98:0/730650728 shutdown_connections 2024-09-17T05:21:30.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.113+0000 7fa1f9f9f640 1 -- 172.21.15.98:0/730650728 wait complete. 2024-09-17T05:21:30.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.115+0000 7f2eb97fa640 1 -- 172.21.15.98:0/2986342697 <== mon.0 v2:172.21.15.98:3300/0 11 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7f2eac04b020 con 0x7f2ebc070550 2024-09-17T05:21:30.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.115+0000 7f2eb97fa640 1 -- 172.21.15.98:0/2986342697 <== mon.0 v2:172.21.15.98:3300/0 12 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2eac03d720 con 0x7f2ebc070550 2024-09-17T05:21:30.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.114+0000 7f072a7fc640 1 -- 172.21.15.98:0/4224300740 <== mon.1 v2:172.21.15.167:3300/0 11 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f073000f760 con 0x7f07380cffa0 2024-09-17T05:21:30.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.114+0000 7fa1f9f9f640 1 Processor -- start 2024-09-17T05:21:30.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.114+0000 7fa1f9f9f640 1 -- start start 2024-09-17T05:21:30.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.116+0000 7fa1f9f9f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1f406f090 0x7fa1f41e5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:30.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.116+0000 7fa1f9f9f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1f40cea20 0x7fa1f4154080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:30.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.116+0000 7fa1f9f9f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa1f415b910 0x7fa1f41e6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:30.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.116+0000 7fa1f9f9f640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f415f260 con 0x7fa1f40cea20 2024-09-17T05:21:30.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.116+0000 7fa1f9f9f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f4073950 con 0x7fa1f406f090 2024-09-17T05:21:30.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.116+0000 7fa1f9f9f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fa1f406f520 con 0x7fa1f415b910 2024-09-17T05:21:30.119 DEBUG:tasks.ceph:set 18 configs 2024-09-17T05:21:30.119 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi098') 2024-09-17T05:21:30.120 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi098') 2024-09-17T05:21:30.120 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi098') 2024-09-17T05:21:30.120 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi098') 2024-09-17T05:21:30.120 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi098') 2024-09-17T05:21:30.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.117+0000 7f2ea2ffd640 1 -- 172.21.15.98:0/2986342697 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ebc070550 msgr2=0x7f2ebc0cce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.117+0000 7f2ea2ffd640 1 --2- 172.21.15.98:0/2986342697 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ebc070550 0x7f2ebc0cce60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2eac00dd50 tx=0x7f2eac0046c0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.118+0000 7f2ea2ffd640 1 -- 172.21.15.98:0/2986342697 shutdown_connections 2024-09-17T05:21:30.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.118+0000 7f2ea2ffd640 1 --2- 172.21.15.98:0/2986342697 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ebc154960 0x7f2ebc156850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.118+0000 7f2ea2ffd640 1 --2- 172.21.15.98:0/2986342697 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ebc072af0 0x7f2ebc2015d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.118+0000 7f2ea2ffd640 1 --2- 172.21.15.98:0/2986342697 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ebc070550 0x7f2ebc0cce60 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.118+0000 7f2ea2ffd640 1 -- 172.21.15.98:0/2986342697 >> 172.21.15.98:0/2986342697 conn(0x7f2ebc06ebe0 msgr2=0x7f2ebc15cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:30.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.118+0000 7f2ea2ffd640 1 -- 172.21.15.98:0/2986342697 shutdown_connections 2024-09-17T05:21:30.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.118+0000 7f2ea2ffd640 1 -- 172.21.15.98:0/2986342697 wait complete. 2024-09-17T05:21:30.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.117+0000 7feab2ffd640 1 -- 172.21.15.98:0/2334621855 <== mon.0 v2:172.21.15.98:3300/0 7 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feab401b4f0 con 0x7feabc1388d0 2024-09-17T05:21:30.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.116+0000 7fa1f3fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1f40cea20 0x7fa1f4154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:30.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.116+0000 7fa1f3fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1f40cea20 0x7fa1f4154080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60024/0 (socket says 172.21.15.98:60024) 2024-09-17T05:21:30.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.116+0000 7fa1f3fff640 1 -- 172.21.15.98:0/4218622055 learned_addr learned my addr 172.21.15.98:0/4218622055 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:21:30.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.117+0000 7fa1f979e640 1 --2- 172.21.15.98:0/4218622055 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa1f415b910 0x7fa1f41e6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:30.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.117+0000 7fa1f8f9d640 1 --2- 172.21.15.98:0/4218622055 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1f406f090 0x7fa1f41e5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:30.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.119+0000 7fa1f979e640 1 -- 172.21.15.98:0/4218622055 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1f406f090 msgr2=0x7fa1f41e5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.119+0000 7fa1f979e640 1 --2- 172.21.15.98:0/4218622055 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1f406f090 0x7fa1f41e5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.119+0000 7fa1f979e640 1 -- 172.21.15.98:0/4218622055 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1f40cea20 msgr2=0x7fa1f4154080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.137+0000 7fa1f979e640 1 --2- 172.21.15.98:0/4218622055 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1f40cea20 0x7fa1f4154080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.137+0000 7fa1f979e640 1 -- 172.21.15.98:0/4218622055 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1f41e4570 con 0x7fa1f415b910 2024-09-17T05:21:30.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.137+0000 7fa1f3fff640 1 --2- 172.21.15.98:0/4218622055 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1f40cea20 0x7fa1f4154080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:21:30.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.137+0000 7fa1f979e640 1 --2- 172.21.15.98:0/4218622055 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa1f415b910 0x7fa1f41e6510 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec00c780 tx=0x7fa1ec00cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:30.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.138+0000 7fa1f17fa640 1 -- 172.21.15.98:0/4218622055 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec017070 con 0x7fa1f415b910 2024-09-17T05:21:30.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.138+0000 7fa1f17fa640 1 -- 172.21.15.98:0/4218622055 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa1ec00ce30 con 0x7fa1f415b910 2024-09-17T05:21:30.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.138+0000 7fa1f17fa640 1 -- 172.21.15.98:0/4218622055 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec005290 con 0x7fa1f415b910 2024-09-17T05:21:30.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.145+0000 7fa1f9f9f640 1 -- 172.21.15.98:0/4218622055 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1f41e4850 con 0x7fa1f415b910 2024-09-17T05:21:30.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.145+0000 7fa1f9f9f640 1 -- 172.21.15.98:0/4218622055 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1f41e4e10 con 0x7fa1f415b910 2024-09-17T05:21:30.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.148+0000 7fa1f17fa640 1 -- 172.21.15.98:0/4218622055 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa1ec005430 con 0x7fa1f415b910 2024-09-17T05:21:30.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.148+0000 7fa1f17fa640 1 -- 172.21.15.98:0/4218622055 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa1ec012620 con 0x7fa1f415b910 2024-09-17T05:21:30.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.148+0000 7fa1f9f9f640 1 -- 172.21.15.98:0/4218622055 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1f406f920 con 0x7fa1f415b910 2024-09-17T05:21:30.157 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.157+0000 7fa1f17fa640 1 -- 172.21.15.98:0/4218622055 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fa1ec020070 con 0x7fa1f415b910 2024-09-17T05:21:30.164 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi098') 2024-09-17T05:21:30.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.207+0000 7f5c1dc0c640 1 -- 172.21.15.98:0/1129545545 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c100e6dc0 msgr2=0x7f5c10036850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.207+0000 7f5c1dc0c640 1 --2- 172.21.15.98:0/1129545545 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c100e6dc0 0x7f5c10036850 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5c10035e30 tx=0x7f5c180a5da0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.208+0000 7f5c1dc0c640 1 -- 172.21.15.98:0/1129545545 shutdown_connections 2024-09-17T05:21:30.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.208+0000 7f5c1dc0c640 1 --2- 172.21.15.98:0/1129545545 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c100e6dc0 0x7f5c10036850 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.208+0000 7f5c1dc0c640 1 --2- 172.21.15.98:0/1129545545 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5c100e69e0 0x7f5c10006e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.208+0000 7f5c1dc0c640 1 -- 172.21.15.98:0/1129545545 >> 172.21.15.98:0/1129545545 conn(0x7f5c1001d7a0 msgr2=0x7f5c10054590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:30.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.208+0000 7f5c1dc0c640 1 -- 172.21.15.98:0/1129545545 shutdown_connections 2024-09-17T05:21:30.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.208+0000 7f5c1dc0c640 1 -- 172.21.15.98:0/1129545545 wait complete. 2024-09-17T05:21:30.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.210+0000 7f5c1dc0c640 1 Processor -- start 2024-09-17T05:21:30.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.211+0000 7f5c1dc0c640 1 -- start start 2024-09-17T05:21:30.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.212+0000 7f5c1dc0c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c1004eb50 0x7f5c10005330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:30.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.212+0000 7f5c1dc0c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5c100e69e0 0x7f5c10186310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:30.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.212+0000 7f5c1dc0c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5c100e6dc0 0x7f5c1000acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:30.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.212+0000 7f5c1dc0c640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5c100552c0 con 0x7f5c1004eb50 2024-09-17T05:21:30.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.212+0000 7f5c1dc0c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5c10036fb0 con 0x7f5c100e69e0 2024-09-17T05:21:30.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.212+0000 7f5c1dc0c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f5c10187310 con 0x7f5c100e6dc0 2024-09-17T05:21:30.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.213+0000 7f5c16ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5c100e69e0 0x7f5c10186310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:30.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.213+0000 7f5c177fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c1004eb50 0x7f5c10005330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:30.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.213+0000 7f5c177fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c1004eb50 0x7f5c10005330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60048/0 (socket says 172.21.15.98:60048) 2024-09-17T05:21:30.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.213+0000 7f5c177fe640 1 -- 172.21.15.98:0/2522116797 learned_addr learned my addr 172.21.15.98:0/2522116797 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:21:30.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.217+0000 7f5c177fe640 1 -- 172.21.15.98:0/2522116797 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5c100e6dc0 msgr2=0x7f5c1000acf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T05:21:30.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.217+0000 7f5c177fe640 1 --2- 172.21.15.98:0/2522116797 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5c100e6dc0 0x7f5c1000acf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.217+0000 7f5c177fe640 1 -- 172.21.15.98:0/2522116797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5c100e69e0 msgr2=0x7f5c10186310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.217+0000 7f5c177fe640 1 --2- 172.21.15.98:0/2522116797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5c100e69e0 0x7f5c10186310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.217+0000 7f5c177fe640 1 -- 172.21.15.98:0/2522116797 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c10186d50 con 0x7f5c1004eb50 2024-09-17T05:21:30.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.218+0000 7f5c177fe640 1 --2- 172.21.15.98:0/2522116797 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c1004eb50 0x7f5c10005330 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c00eb30 tx=0x7f5c0c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:30.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.218+0000 7f5c03fff640 1 -- 172.21.15.98:0/2522116797 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c0c00cd00 con 0x7f5c1004eb50 2024-09-17T05:21:30.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.218+0000 7f5c1dc0c640 1 -- 172.21.15.98:0/2522116797 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c10187030 con 0x7f5c1004eb50 2024-09-17T05:21:30.220 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.218+0000 7f5c1dc0c640 1 -- 172.21.15.98:0/2522116797 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c10004e10 con 0x7f5c1004eb50 2024-09-17T05:21:30.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.220+0000 7f5c03fff640 1 -- 172.21.15.98:0/2522116797 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5c0c010430 con 0x7f5c1004eb50 2024-09-17T05:21:30.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.221+0000 7f5c03fff640 1 -- 172.21.15.98:0/2522116797 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c0c010840 con 0x7f5c1004eb50 2024-09-17T05:21:30.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.221+0000 7f5c03fff640 1 -- 172.21.15.98:0/2522116797 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5c0c0109e0 con 0x7f5c1004eb50 2024-09-17T05:21:30.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.221+0000 7f5c03fff640 1 -- 172.21.15.98:0/2522116797 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5c0c0213f0 con 0x7f5c1004eb50 2024-09-17T05:21:30.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.222+0000 7f5c1dc0c640 1 -- 172.21.15.98:0/2522116797 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bf8005290 con 0x7f5c1004eb50 2024-09-17T05:21:30.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.226+0000 7f5c03fff640 1 -- 172.21.15.98:0/2522116797 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f5c0c018420 con 0x7f5c1004eb50 2024-09-17T05:21:30.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.240+0000 7f0740041640 1 -- 172.21.15.98:0/4224300740 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f07140052f0 con 0x7f07380cffa0 2024-09-17T05:21:30.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.247+0000 7f072a7fc640 1 -- 172.21.15.98:0/4224300740 <== mon.1 v2:172.21.15.167:3300/0 12 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v7)=0 v7) ==== 108+0+0 (secure 0 0 0) 0x7f073000fae0 con 0x7f07380cffa0 2024-09-17T05:21:30.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.255+0000 7f071bfff640 1 -- 172.21.15.98:0/4224300740 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07380cffa0 msgr2=0x7f07380ad100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.255+0000 7f071bfff640 1 --2- 172.21.15.98:0/4224300740 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07380cffa0 0x7f07380ad100 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f073000c880 tx=0x7f073000cd40 comp rx=0 tx=0).stop 2024-09-17T05:21:30.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.255+0000 7f071bfff640 1 -- 172.21.15.98:0/4224300740 shutdown_connections 2024-09-17T05:21:30.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.255+0000 7f071bfff640 1 --2- 172.21.15.98:0/4224300740 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f073815da20 0x7f07380b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.255+0000 7f071bfff640 1 --2- 172.21.15.98:0/4224300740 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f07380d0900 0x7f073815b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.255+0000 7f071bfff640 1 --2- 172.21.15.98:0/4224300740 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07380cffa0 0x7f07380ad100 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.255+0000 7f071bfff640 1 -- 172.21.15.98:0/4224300740 >> 172.21.15.98:0/4224300740 conn(0x7f0738074240 msgr2=0x7f07380c4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:30.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.255+0000 7f071bfff640 1 -- 172.21.15.98:0/4224300740 shutdown_connections 2024-09-17T05:21:30.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.255+0000 7f071bfff640 1 -- 172.21.15.98:0/4224300740 wait complete. 2024-09-17T05:21:30.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.255+0000 7f899f352640 1 -- 172.21.15.98:0/2332660650 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8998162440 msgr2=0x7f89980cf100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.255+0000 7f899f352640 1 --2- 172.21.15.98:0/2332660650 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8998162440 0x7f89980cf100 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8988005fd0 tx=0x7f898802a580 comp rx=0 tx=0).stop 2024-09-17T05:21:30.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.255+0000 7f899f352640 1 -- 172.21.15.98:0/2332660650 shutdown_connections 2024-09-17T05:21:30.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.255+0000 7f899f352640 1 --2- 172.21.15.98:0/2332660650 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8998162440 0x7f89980cf100 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.255+0000 7f899f352640 1 --2- 172.21.15.98:0/2332660650 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89980cbe00 0x7f899815efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.255+0000 7f899f352640 1 -- 172.21.15.98:0/2332660650 >> 172.21.15.98:0/2332660650 conn(0x7f89980cdde0 msgr2=0x7f89980d0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:30.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.256+0000 7f899f352640 1 -- 172.21.15.98:0/2332660650 shutdown_connections 2024-09-17T05:21:30.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.256+0000 7f899f352640 1 -- 172.21.15.98:0/2332660650 wait complete. 2024-09-17T05:21:30.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.257+0000 7f899f352640 1 Processor -- start 2024-09-17T05:21:30.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.258+0000 7f899f352640 1 -- start start 2024-09-17T05:21:30.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.259+0000 7f899f352640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f899806cb70 0x7f8998201ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:30.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.259+0000 7f899f352640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89980cbe00 0x7f89982041a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:30.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.259+0000 7f899c8ed640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89980cbe00 0x7f89982041a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:30.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.259+0000 7f899d0ee640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f899806cb70 0x7f8998201ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:30.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.259+0000 7f899d0ee640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f899806cb70 0x7f8998201ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.98:43068/0 (socket says 172.21.15.98:43068) 2024-09-17T05:21:30.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.260+0000 7f899c8ed640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89980cbe00 0x7f89982041a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60058/0 (socket says 172.21.15.98:60058) 2024-09-17T05:21:30.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.260+0000 7f899f352640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8998162440 0x7f89980aefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:30.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.260+0000 7f899f352640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f89980cf850 con 0x7f89980cbe00 2024-09-17T05:21:30.263 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.260+0000 7f899f352640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8998162ac0 con 0x7f8998162440 2024-09-17T05:21:30.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.260+0000 7f899f352640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f89980cf9d0 con 0x7f899806cb70 2024-09-17T05:21:30.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.260+0000 7f899d0ee640 1 -- 172.21.15.98:0/1462105228 learned_addr learned my addr 172.21.15.98:0/1462105228 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:21:30.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.261+0000 7f899d8ef640 1 --2- 172.21.15.98:0/1462105228 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8998162440 0x7f89980aefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:30.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.261+0000 7f899c8ed640 1 -- 172.21.15.98:0/1462105228 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f899806cb70 msgr2=0x7f8998201ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.261+0000 7f899c8ed640 1 --2- 172.21.15.98:0/1462105228 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f899806cb70 0x7f8998201ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.261+0000 7f899c8ed640 1 -- 172.21.15.98:0/1462105228 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8998162440 msgr2=0x7f89980aefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.261+0000 7f899c8ed640 1 --2- 172.21.15.98:0/1462105228 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8998162440 0x7f89980aefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.261+0000 7f899c8ed640 1 -- 172.21.15.98:0/1462105228 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89980b0bd0 con 0x7f89980cbe00 2024-09-17T05:21:30.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.261+0000 7f899c8ed640 1 --2- 172.21.15.98:0/1462105228 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89980cbe00 0x7f89982041a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f899400d900 tx=0x7f899400ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:30.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.262+0000 7f898dffb640 1 -- 172.21.15.98:0/1462105228 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8994017070 con 0x7f89980cbe00 2024-09-17T05:21:30.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.262+0000 7f898dffb640 1 -- 172.21.15.98:0/1462105228 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8994004310 con 0x7f89980cbe00 2024-09-17T05:21:30.265 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.262+0000 7f899f352640 1 -- 172.21.15.98:0/1462105228 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89980b0eb0 con 0x7f89980cbe00 2024-09-17T05:21:30.265 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.263+0000 7f899f352640 1 -- 172.21.15.98:0/1462105228 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89980b1470 con 0x7f89980cbe00 2024-09-17T05:21:30.265 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.264+0000 7f898dffb640 1 -- 172.21.15.98:0/1462105228 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8994009b40 con 0x7f89980cbe00 2024-09-17T05:21:30.265 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.265+0000 7f898dffb640 1 -- 172.21.15.98:0/1462105228 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f89940035f0 con 0x7f89980cbe00 2024-09-17T05:21:30.265 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.265+0000 7f898dffb640 1 -- 172.21.15.98:0/1462105228 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f89940106c0 con 0x7f89980cbe00 2024-09-17T05:21:30.267 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.266+0000 7f899f352640 1 -- 172.21.15.98:0/1462105228 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f897c005290 con 0x7f89980cbe00 2024-09-17T05:21:30.271 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.270+0000 7f898dffb640 1 -- 172.21.15.98:0/1462105228 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f8994009ce0 con 0x7f89980cbe00 2024-09-17T05:21:30.278 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi098') 2024-09-17T05:21:30.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.308+0000 7f6e96732640 1 -- 172.21.15.98:0/3333308382 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e900cbe00 msgr2=0x7f6e9015efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.308+0000 7f6e96732640 1 --2- 172.21.15.98:0/3333308382 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e900cbe00 0x7f6e9015efe0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6e80005fd0 tx=0x7f6e8003b4c0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.312+0000 7f6e96732640 1 -- 172.21.15.98:0/3333308382 shutdown_connections 2024-09-17T05:21:30.315 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.312+0000 7f6e96732640 1 --2- 172.21.15.98:0/3333308382 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e900cbe00 0x7f6e9015efe0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.315 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.312+0000 7f6e96732640 1 -- 172.21.15.98:0/3333308382 >> 172.21.15.98:0/3333308382 conn(0x7f6e900cdde0 msgr2=0x7f6e900d0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:30.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.322+0000 7f4b5ddc9640 1 -- 172.21.15.98:0/1719358736 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b5808b8e0 msgr2=0x7f4b580ca070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.322+0000 7f4b5ddc9640 1 --2- 172.21.15.98:0/1719358736 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b5808b8e0 0x7f4b580ca070 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4b480097e0 tx=0x7f4b4802a3b0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.322+0000 7f4b5ddc9640 1 -- 172.21.15.98:0/1719358736 shutdown_connections 2024-09-17T05:21:30.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.322+0000 7f4b5ddc9640 1 --2- 172.21.15.98:0/1719358736 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b5808b8e0 0x7f4b580ca070 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.322+0000 7f4b5ddc9640 1 -- 172.21.15.98:0/1719358736 >> 172.21.15.98:0/1719358736 conn(0x7f4b580b15f0 msgr2=0x7f4b580b19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:30.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.323+0000 7f33a6717640 1 -- 172.21.15.98:0/2257518626 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f33a00af430 msgr2=0x7f33a00afb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.323+0000 7f33a6717640 1 --2- 172.21.15.98:0/2257518626 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f33a00af430 0x7f33a00afb10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3398005fd0 tx=0x7f339802a7a0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.323+0000 7f6e96732640 1 -- 172.21.15.98:0/3333308382 shutdown_connections 2024-09-17T05:21:30.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.323+0000 7f33a6717640 1 -- 172.21.15.98:0/2257518626 shutdown_connections 2024-09-17T05:21:30.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.323+0000 7f33a6717640 1 --2- 172.21.15.98:0/2257518626 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f33a00af430 0x7f33a00afb10 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.323+0000 7f33a6717640 1 --2- 172.21.15.98:0/2257518626 >> v2:172.21.15.167:3300/0 conn(0x7f33a00cf820 0x7f33a0161d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.323+0000 7f33a6717640 1 -- 172.21.15.98:0/2257518626 >> 172.21.15.98:0/2257518626 conn(0x7f33a0074240 msgr2=0x7f33a0074650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:30.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.322+0000 7f4b5ddc9640 1 -- 172.21.15.98:0/1719358736 shutdown_connections 2024-09-17T05:21:30.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.322+0000 7f4b5ddc9640 1 -- 172.21.15.98:0/1719358736 wait complete. 2024-09-17T05:21:30.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.324+0000 7f4b5ddc9640 1 Processor -- start 2024-09-17T05:21:30.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.325+0000 7f4b5ddc9640 1 -- start start 2024-09-17T05:21:30.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.326+0000 7f4b5ddc9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b5806ffa0 0x7f4b580c9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:30.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.326+0000 7f4b5ddc9640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b580cc430 0x7f4b58204b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:30.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.326+0000 7f4b5ddc9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b580c6af0 0x7f4b581f0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:30.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.326+0000 7f4b5ddc9640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4b5808bda0 con 0x7f4b580c6af0 2024-09-17T05:21:30.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.326+0000 7f4b5ddc9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4b580cdf10 con 0x7f4b5806ffa0 2024-09-17T05:21:30.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.326+0000 7f4b5ddc9640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f4b580cc8e0 con 0x7f4b580cc430 2024-09-17T05:21:30.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.326+0000 7f4b56ffd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b580cc430 0x7f4b58204b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:30.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.326+0000 7f4b577fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b5806ffa0 0x7f4b580c9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:30.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.326+0000 7f4b56ffd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b580cc430 0x7f4b58204b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.98:43094/0 (socket says 172.21.15.98:43094) 2024-09-17T05:21:30.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.326+0000 7f4b56ffd640 1 -- 172.21.15.98:0/323181567 learned_addr learned my addr 172.21.15.98:0/323181567 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:21:30.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.326+0000 7f4b57fff640 1 --2- 172.21.15.98:0/323181567 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b580c6af0 0x7f4b581f0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:30.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.327+0000 7f4b56ffd640 1 -- 172.21.15.98:0/323181567 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b5806ffa0 msgr2=0x7f4b580c9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.327+0000 7f4b56ffd640 1 --2- 172.21.15.98:0/323181567 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b5806ffa0 0x7f4b580c9330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.327+0000 7f4b56ffd640 1 -- 172.21.15.98:0/323181567 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b580c6af0 msgr2=0x7f4b581f0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.327+0000 7f4b56ffd640 1 --2- 172.21.15.98:0/323181567 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b580c6af0 0x7f4b581f0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.327+0000 7f4b56ffd640 1 -- 172.21.15.98:0/323181567 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b580c6ff0 con 0x7f4b580cc430 2024-09-17T05:21:30.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.327+0000 7f4b57fff640 1 --2- 172.21.15.98:0/323181567 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b580c6af0 0x7f4b581f0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:21:30.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.329+0000 7f4b56ffd640 1 --2- 172.21.15.98:0/323181567 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b580cc430 0x7f4b58204b90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4b5000cad0 tx=0x7f4b5000cf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:30.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.328+0000 7f6e96732640 1 -- 172.21.15.98:0/3333308382 wait complete. 2024-09-17T05:21:30.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.330+0000 7f6e96732640 1 Processor -- start 2024-09-17T05:21:30.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.330+0000 7f6e96732640 1 -- start start 2024-09-17T05:21:30.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.331+0000 7f6e96732640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e9006cb70 0x7f6e900c7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:30.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.331+0000 7f6e96732640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6e900cbe00 0x7f6e90156640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:30.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.331+0000 7f6e96732640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6e90162440 0x7f6e900b4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:30.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.331+0000 7f6e96732640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6e900d0bb0 con 0x7f6e9006cb70 2024-09-17T05:21:30.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.331+0000 7f6e96732640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6e900d0a30 con 0x7f6e900cbe00 2024-09-17T05:21:30.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.331+0000 7f6e96732640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f6e9015c990 con 0x7f6e90162440 2024-09-17T05:21:30.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.323+0000 7f33a6717640 1 -- 172.21.15.98:0/2257518626 shutdown_connections 2024-09-17T05:21:30.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.330+0000 7f33a6717640 1 -- 172.21.15.98:0/2257518626 wait complete. 2024-09-17T05:21:30.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.332+0000 7f6e8ffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e9006cb70 0x7f6e900c7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:30.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.332+0000 7f6e8ffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e9006cb70 0x7f6e900c7e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60088/0 (socket says 172.21.15.98:60088) 2024-09-17T05:21:30.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.332+0000 7f6e8ffff640 1 -- 172.21.15.98:0/1432967822 learned_addr learned my addr 172.21.15.98:0/1432967822 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:21:30.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.333+0000 7f6e94ccf640 1 --2- 172.21.15.98:0/1432967822 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6e90162440 0x7f6e900b4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:30.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.333+0000 7f6e8ffff640 1 -- 172.21.15.98:0/1432967822 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6e90162440 msgr2=0x7f6e900b4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.333+0000 7f6e8f7fe640 1 --2- 172.21.15.98:0/1432967822 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6e900cbe00 0x7f6e90156640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:30.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.333+0000 7f6e8ffff640 1 --2- 172.21.15.98:0/1432967822 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6e90162440 0x7f6e900b4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.333+0000 7f6e8ffff640 1 -- 172.21.15.98:0/1432967822 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6e900cbe00 msgr2=0x7f6e90156640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.333+0000 7f6e8ffff640 1 --2- 172.21.15.98:0/1432967822 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6e900cbe00 0x7f6e90156640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.333+0000 7f6e8ffff640 1 -- 172.21.15.98:0/1432967822 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e90156b80 con 0x7f6e9006cb70 2024-09-17T05:21:30.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.333+0000 7f6e94ccf640 1 --2- 172.21.15.98:0/1432967822 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6e90162440 0x7f6e900b4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:21:30.338 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.333+0000 7f4b3ffff640 1 -- 172.21.15.98:0/323181567 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b50003da0 con 0x7f4b580cc430 2024-09-17T05:21:30.338 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.333+0000 7f4b5ddc9640 1 -- 172.21.15.98:0/323181567 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b580c7330 con 0x7f4b580cc430 2024-09-17T05:21:30.338 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.335+0000 7f6e8ffff640 1 --2- 172.21.15.98:0/1432967822 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e9006cb70 0x7f6e900c7e00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6e8800bd60 tx=0x7f6e88009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:30.338 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.333+0000 7f4b5ddc9640 1 -- 172.21.15.98:0/323181567 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b580c7b70 con 0x7f4b580cc430 2024-09-17T05:21:30.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.335+0000 7f4b3ffff640 1 -- 172.21.15.98:0/323181567 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4b5000a700 con 0x7f4b580cc430 2024-09-17T05:21:30.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.335+0000 7f4b3ffff640 1 -- 172.21.15.98:0/323181567 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b5000ab50 con 0x7f4b580cc430 2024-09-17T05:21:30.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.337+0000 7f6e8cff9640 1 -- 172.21.15.98:0/1432967822 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e88019070 con 0x7f6e9006cb70 2024-09-17T05:21:30.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.337+0000 7f6e8cff9640 1 -- 172.21.15.98:0/1432967822 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6e8800cd70 con 0x7f6e9006cb70 2024-09-17T05:21:30.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.337+0000 7f6e96732640 1 -- 172.21.15.98:0/1432967822 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e900b2190 con 0x7f6e9006cb70 2024-09-17T05:21:30.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.337+0000 7f6e96732640 1 -- 172.21.15.98:0/1432967822 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e900b1860 con 0x7f6e9006cb70 2024-09-17T05:21:30.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.337+0000 7f6e8cff9640 1 -- 172.21.15.98:0/1432967822 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e880146a0 con 0x7f6e9006cb70 2024-09-17T05:21:30.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.337+0000 7f4b3ffff640 1 -- 172.21.15.98:0/323181567 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4b50005070 con 0x7f4b580cc430 2024-09-17T05:21:30.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.337+0000 7f6e8cff9640 1 -- 172.21.15.98:0/1432967822 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6e8801c070 con 0x7f6e9006cb70 2024-09-17T05:21:30.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.337+0000 7f6e8cff9640 1 -- 172.21.15.98:0/1432967822 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6e8801edc0 con 0x7f6e9006cb70 2024-09-17T05:21:30.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.337+0000 7f4b3ffff640 1 -- 172.21.15.98:0/323181567 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4b5001bb50 con 0x7f4b580cc430 2024-09-17T05:21:30.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.331+0000 7f33a6717640 1 Processor -- start 2024-09-17T05:21:30.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.339+0000 7f33a6717640 1 -- start start 2024-09-17T05:21:30.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.340+0000 7f33a6717640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33a00af430 0x7f33a00b3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:30.342 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.341+0000 7f33a6717640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33a00cf820 0x7f33a00c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:30.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.341+0000 7f33a6717640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f33a00cfc00 0x7f33a00b5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:30.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.341+0000 7f339f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33a00cf820 0x7f33a00c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:30.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.341+0000 7f33a4cb4640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f33a00cfc00 0x7f33a00b5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:30.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.341+0000 7f33a4cb4640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f33a00cfc00 0x7f33a00b5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.98:43108/0 (socket says 172.21.15.98:43108) 2024-09-17T05:21:30.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.341+0000 7f33a4cb4640 1 -- 172.21.15.98:0/1975892080 learned_addr learned my addr 172.21.15.98:0/1975892080 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:21:30.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.341+0000 7f33a6717640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f33a0162b60 con 0x7f33a00af430 2024-09-17T05:21:30.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.341+0000 7f33a6717640 1 -- 172.21.15.98:0/1975892080 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f33a01629e0 con 0x7f33a00cf820 2024-09-17T05:21:30.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.341+0000 7f33a6717640 1 -- 172.21.15.98:0/1975892080 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f33a00cc4a0 con 0x7f33a00cfc00 2024-09-17T05:21:30.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.342+0000 7f4b5ddc9640 1 -- 172.21.15.98:0/323181567 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b38005290 con 0x7f4b580cc430 2024-09-17T05:21:30.344 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.342+0000 7f33a4cb4640 1 -- 172.21.15.98:0/1975892080 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33a00cf820 msgr2=0x7f33a00c9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.344 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.342+0000 7f33a4cb4640 1 --2- 172.21.15.98:0/1975892080 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33a00cf820 0x7f33a00c9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.344 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.342+0000 7f33a4cb4640 1 -- 172.21.15.98:0/1975892080 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33a00af430 msgr2=0x7f33a00b3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.341+0000 7f339ffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33a00af430 0x7f33a00b3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:30.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.345+0000 7f33a4cb4640 1 --2- 172.21.15.98:0/1975892080 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33a00af430 0x7f33a00b3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.345+0000 7f33a4cb4640 1 -- 172.21.15.98:0/1975892080 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33a00c8f70 con 0x7f33a00cfc00 2024-09-17T05:21:30.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.345+0000 7f339ffff640 1 --2- 172.21.15.98:0/1975892080 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33a00af430 0x7f33a00b3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:21:30.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.345+0000 7f6e96732640 1 -- 172.21.15.98:0/1432967822 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e70005290 con 0x7f6e9006cb70 2024-09-17T05:21:30.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.345+0000 7f33a4cb4640 1 --2- 172.21.15.98:0/1975892080 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f33a00cfc00 0x7f33a00b5b20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3398006010 tx=0x7f3398030890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:30.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.350+0000 7fa3fe732640 1 -- 172.21.15.98:0/595783677 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3f00e6d90 msgr2=0x7fa3f0036650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.350+0000 7fa3fe732640 1 --2- 172.21.15.98:0/595783677 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3f00e6d90 0x7fa3f0036650 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa3f806bf20 tx=0x7fa3f80a5df0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.349+0000 7f6e8cff9640 1 -- 172.21.15.98:0/1432967822 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f6e88023070 con 0x7f6e9006cb70 2024-09-17T05:21:30.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.354+0000 7fa3fe732640 1 -- 172.21.15.98:0/595783677 shutdown_connections 2024-09-17T05:21:30.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.354+0000 7fa3fe732640 1 --2- 172.21.15.98:0/595783677 >> v2:172.21.15.167:3300/0 conn(0x7fa3f004eb20 0x7fa3f0036110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.354+0000 7fa3fe732640 1 --2- 172.21.15.98:0/595783677 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3f00e6d90 0x7fa3f0036650 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.354+0000 7fa3fe732640 1 --2- 172.21.15.98:0/595783677 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa3f00e69b0 0x7fa3f0006e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.354+0000 7fa3fe732640 1 -- 172.21.15.98:0/595783677 >> 172.21.15.98:0/595783677 conn(0x7fa3f001d770 msgr2=0x7fa3f0054560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:30.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.354+0000 7f4b3ffff640 1 -- 172.21.15.98:0/323181567 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f4b580c7330 con 0x7f4b580cc430 2024-09-17T05:21:30.359 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.358+0000 7f339cff9640 1 -- 172.21.15.98:0/1975892080 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3398041020 con 0x7f33a00cfc00 2024-09-17T05:21:30.359 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.358+0000 7f339cff9640 1 -- 172.21.15.98:0/1975892080 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3398030d90 con 0x7f33a00cfc00 2024-09-17T05:21:30.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.358+0000 7f339cff9640 1 -- 172.21.15.98:0/1975892080 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3398036040 con 0x7f33a00cfc00 2024-09-17T05:21:30.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.359+0000 7f33a6717640 1 -- 172.21.15.98:0/1975892080 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33a00c91e0 con 0x7f33a00cfc00 2024-09-17T05:21:30.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.359+0000 7f33a6717640 1 -- 172.21.15.98:0/1975892080 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f33a00c97a0 con 0x7f33a00cfc00 2024-09-17T05:21:30.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.359+0000 7fa3fe732640 1 -- 172.21.15.98:0/595783677 shutdown_connections 2024-09-17T05:21:30.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.360+0000 7f339cff9640 1 -- 172.21.15.98:0/1975892080 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3398044020 con 0x7f33a00cfc00 2024-09-17T05:21:30.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.360+0000 7f339cff9640 1 -- 172.21.15.98:0/1975892080 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f339803da80 con 0x7f33a00cfc00 2024-09-17T05:21:30.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.361+0000 7f33867fc640 1 -- 172.21.15.98:0/1975892080 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33a0161d90 con 0x7f33a00cfc00 2024-09-17T05:21:30.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.363+0000 7feac4356640 1 -- 172.21.15.98:0/2334621855 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7feaa4005580 con 0x7feabc1388d0 2024-09-17T05:21:30.368 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.363+0000 7fa3fe732640 1 -- 172.21.15.98:0/595783677 wait complete. 2024-09-17T05:21:30.368 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.365+0000 7fa3fe732640 1 Processor -- start 2024-09-17T05:21:30.369 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.363+0000 7f339cff9640 1 -- 172.21.15.98:0/1975892080 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f339804b030 con 0x7f33a00cfc00 2024-09-17T05:21:30.370 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.368+0000 7fa3fe732640 1 -- start start 2024-09-17T05:21:30.370 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.369+0000 7fa3fe732640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa3f004eb20 0x7fa3f0186070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:30.370 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.369+0000 7fa3fe732640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3f00e69b0 0x7fa3f00de940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:30.370 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.369+0000 7fa3fe732640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3f00e6d90 0x7fa3f00dee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:30.370 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.369+0000 7fa3fe732640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f0036b90 con 0x7fa3f00e69b0 2024-09-17T05:21:30.370 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.369+0000 7fa3fe732640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f0036d10 con 0x7fa3f00e6d90 2024-09-17T05:21:30.370 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.369+0000 7fa3fe732640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fa3f0036e90 con 0x7fa3f004eb20 2024-09-17T05:21:30.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.371+0000 7fa3fcf2f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3f00e69b0 0x7fa3f00de940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:30.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.371+0000 7fa3fcf2f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3f00e69b0 0x7fa3f00de940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60110/0 (socket says 172.21.15.98:60110) 2024-09-17T05:21:30.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.371+0000 7fa3fcf2f640 1 -- 172.21.15.98:0/3092591207 learned_addr learned my addr 172.21.15.98:0/3092591207 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:21:30.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.371+0000 7feab2ffd640 1 -- 172.21.15.98:0/2334621855 <== mon.0 v2:172.21.15.98:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v8)=0 v8) ==== 117+0+0 (secure 0 0 0) 0x7feab4012ae0 con 0x7feabc1388d0 2024-09-17T05:21:30.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.371+0000 7fa3fdf31640 1 --2- 172.21.15.98:0/3092591207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3f00e6d90 0x7fa3f00dee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:30.373 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.371+0000 7fa3fd730640 1 --2- 172.21.15.98:0/3092591207 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa3f004eb20 0x7fa3f0186070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:30.373 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.372+0000 7fa3fd730640 1 -- 172.21.15.98:0/3092591207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3f00e6d90 msgr2=0x7fa3f00dee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.372+0000 7fa3fd730640 1 --2- 172.21.15.98:0/3092591207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3f00e6d90 0x7fa3f00dee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.372+0000 7fa3fd730640 1 -- 172.21.15.98:0/3092591207 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3f00e69b0 msgr2=0x7fa3f00de940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.372+0000 7fa3fd730640 1 --2- 172.21.15.98:0/3092591207 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3f00e69b0 0x7fa3f00de940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.373+0000 7fa3fd730640 1 -- 172.21.15.98:0/3092591207 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3f0043090 con 0x7fa3f004eb20 2024-09-17T05:21:30.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.373+0000 7feac4356640 1 -- 172.21.15.98:0/2334621855 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feabc1388d0 msgr2=0x7feabc0b0960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.373+0000 7feac4356640 1 --2- 172.21.15.98:0/2334621855 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feabc1388d0 0x7feabc0b0960 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7feab400cda0 tx=0x7feab400a430 comp rx=0 tx=0).stop 2024-09-17T05:21:30.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.373+0000 7feac4356640 1 -- 172.21.15.98:0/2334621855 shutdown_connections 2024-09-17T05:21:30.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.373+0000 7feac4356640 1 --2- 172.21.15.98:0/2334621855 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feabc1388d0 0x7feabc0b0960 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.373+0000 7feac4356640 1 --2- 172.21.15.98:0/2334621855 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feabc13e3d0 0x7feabc138390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.373+0000 7feac4356640 1 --2- 172.21.15.98:0/2334621855 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feabc0b3190 0x7feabc14ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.373+0000 7feac4356640 1 -- 172.21.15.98:0/2334621855 >> 172.21.15.98:0/2334621855 conn(0x7feabc0b1840 msgr2=0x7feabc0cdad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:30.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.373+0000 7feac4356640 1 -- 172.21.15.98:0/2334621855 shutdown_connections 2024-09-17T05:21:30.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.373+0000 7feac4356640 1 -- 172.21.15.98:0/2334621855 wait complete. 2024-09-17T05:21:30.385 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.385+0000 7fa3fd730640 1 --2- 172.21.15.98:0/3092591207 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa3f004eb20 0x7fa3f0186070 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa3f400ea20 tx=0x7fa3f400eee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:30.386 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.386+0000 7fa3edffb640 1 -- 172.21.15.98:0/3092591207 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f400cd80 con 0x7fa3f004eb20 2024-09-17T05:21:30.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.387+0000 7f5c1dc0c640 1 -- 172.21.15.98:0/2522116797 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f5bf8005580 con 0x7f5c1004eb50 2024-09-17T05:21:30.388 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.386+0000 7fa3fe732640 1 -- 172.21.15.98:0/3092591207 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3f00df3c0 con 0x7fa3f004eb20 2024-09-17T05:21:30.388 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.386+0000 7fa3fe732640 1 -- 172.21.15.98:0/3092591207 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3f0009c00 con 0x7fa3f004eb20 2024-09-17T05:21:30.388 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.387+0000 7fa3edffb640 1 -- 172.21.15.98:0/3092591207 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa3f4010430 con 0x7fa3f004eb20 2024-09-17T05:21:30.388 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.387+0000 7fa3edffb640 1 -- 172.21.15.98:0/3092591207 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f4010840 con 0x7fa3f004eb20 2024-09-17T05:21:30.388 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.388+0000 7fa3edffb640 1 -- 172.21.15.98:0/3092591207 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa3f4010a60 con 0x7fa3f004eb20 2024-09-17T05:21:30.390 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.389+0000 7fa3edffb640 1 -- 172.21.15.98:0/3092591207 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa3f40213f0 con 0x7fa3f004eb20 2024-09-17T05:21:30.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.393+0000 7fa3fe732640 1 -- 172.21.15.98:0/3092591207 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3d8005290 con 0x7fa3f004eb20 2024-09-17T05:21:30.394 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi098') 2024-09-17T05:21:30.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.398+0000 7f5c03fff640 1 -- 172.21.15.98:0/2522116797 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v9)=0 v9) ==== 115+0+0 (secure 0 0 0) 0x7f5c0c018600 con 0x7f5c1004eb50 2024-09-17T05:21:30.408 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.408+0000 7f5c01ffb640 1 -- 172.21.15.98:0/2522116797 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c1004eb50 msgr2=0x7f5c10005330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.408 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.408+0000 7f5c01ffb640 1 --2- 172.21.15.98:0/2522116797 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c1004eb50 0x7f5c10005330 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c00eb30 tx=0x7f5c0c00c2d0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.409 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.408+0000 7fa3edffb640 1 -- 172.21.15.98:0/3092591207 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fa3f4018420 con 0x7fa3f004eb20 2024-09-17T05:21:30.410 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.409+0000 7f5c01ffb640 1 -- 172.21.15.98:0/2522116797 shutdown_connections 2024-09-17T05:21:30.410 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.409+0000 7f5c01ffb640 1 --2- 172.21.15.98:0/2522116797 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5c100e6dc0 0x7f5c1000acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.410 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.409+0000 7f5c01ffb640 1 --2- 172.21.15.98:0/2522116797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5c100e69e0 0x7f5c10186310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.410 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.408+0000 7fd8b822b640 1 -- 172.21.15.98:0/4003114603 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8b00cfc00 msgr2=0x7fd8b01624a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.410 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.408+0000 7fd8b822b640 1 --2- 172.21.15.98:0/4003114603 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8b00cfc00 0x7fd8b01624a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd8a0005fd0 tx=0x7fd8a003b620 comp rx=0 tx=0).stop 2024-09-17T05:21:30.410 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.409+0000 7f5c01ffb640 1 --2- 172.21.15.98:0/2522116797 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c1004eb50 0x7f5c10005330 secure :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c00eb30 tx=0x7f5c0c00c2d0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.409+0000 7f5c01ffb640 1 -- 172.21.15.98:0/2522116797 >> 172.21.15.98:0/2522116797 conn(0x7f5c1001d7a0 msgr2=0x7f5c1000a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:30.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.409+0000 7fd8b822b640 1 -- 172.21.15.98:0/4003114603 shutdown_connections 2024-09-17T05:21:30.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.409+0000 7fd8b822b640 1 --2- 172.21.15.98:0/4003114603 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8b00cfc00 0x7fd8b01624a0 secure :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd8a0005fd0 tx=0x7fd8a003b620 comp rx=0 tx=0).stop 2024-09-17T05:21:30.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.409+0000 7fd8b822b640 1 -- 172.21.15.98:0/4003114603 >> 172.21.15.98:0/4003114603 conn(0x7fd8b0074240 msgr2=0x7fd8b0074650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:30.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.409+0000 7fd8b822b640 1 -- 172.21.15.98:0/4003114603 shutdown_connections 2024-09-17T05:21:30.412 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.409+0000 7fd8b822b640 1 -- 172.21.15.98:0/4003114603 wait complete. 2024-09-17T05:21:30.412 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.411+0000 7fd8b822b640 1 Processor -- start 2024-09-17T05:21:30.413 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.412+0000 7fa1f9f9f640 1 -- 172.21.15.98:0/4218622055 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7fa1f40cdd20 con 0x7fa1f415b910 2024-09-17T05:21:30.413 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.411+0000 7fd8b822b640 1 -- start start 2024-09-17T05:21:30.413 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.413+0000 7f5c01ffb640 1 -- 172.21.15.98:0/2522116797 shutdown_connections 2024-09-17T05:21:30.414 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.413+0000 7f5c01ffb640 1 -- 172.21.15.98:0/2522116797 wait complete. 2024-09-17T05:21:30.415 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.413+0000 7fd8b822b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8b00af430 0x7fd8b0151c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:30.415 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.413+0000 7fd8b822b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8b00cf820 0x7fd8b015d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:30.415 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.413+0000 7fd8b5fc7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8b00af430 0x7fd8b0151c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:30.415 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.413+0000 7fd8b5fc7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8b00af430 0x7fd8b0151c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.98:39526/0 (socket says 172.21.15.98:39526) 2024-09-17T05:21:30.415 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.413+0000 7fd8b5fc7640 1 -- 172.21.15.98:0/202336500 learned_addr learned my addr 172.21.15.98:0/202336500 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:21:30.415 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.414+0000 7fd8b822b640 1 --2- 172.21.15.98:0/202336500 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8b0099290 0x7fd8b0158740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:30.415 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.414+0000 7fd8b822b640 1 -- 172.21.15.98:0/202336500 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd8b00b1d10 con 0x7fd8b0099290 2024-09-17T05:21:30.415 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.414+0000 7fd8b822b640 1 -- 172.21.15.98:0/202336500 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd8b0162bf0 con 0x7fd8b00af430 2024-09-17T05:21:30.415 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.414+0000 7fd8b822b640 1 -- 172.21.15.98:0/202336500 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fd8b00cc4a0 con 0x7fd8b00cf820 2024-09-17T05:21:30.416 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.415+0000 7fd8b5fc7640 1 -- 172.21.15.98:0/202336500 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8b00cf820 msgr2=0x7fd8b015d600 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T05:21:30.417 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.415+0000 7fd8b5fc7640 1 --2- 172.21.15.98:0/202336500 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8b00cf820 0x7fd8b015d600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.417 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.415+0000 7fd8b5fc7640 1 -- 172.21.15.98:0/202336500 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8b0099290 msgr2=0x7fd8b0158740 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T05:21:30.418 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.417+0000 7fd8b67c8640 1 --2- 172.21.15.98:0/202336500 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8b0099290 0x7fd8b0158740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:30.418 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.418+0000 7fd8b5fc7640 1 --2- 172.21.15.98:0/202336500 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8b0099290 0x7fd8b0158740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.419 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.418+0000 7fd8b5fc7640 1 -- 172.21.15.98:0/202336500 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8b0152320 con 0x7fd8b00af430 2024-09-17T05:21:30.419 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.418+0000 7fd8b5fc7640 1 --2- 172.21.15.98:0/202336500 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8b00af430 0x7fd8b0151c40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd8a800c780 tx=0x7fd8a800cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:30.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.419+0000 7f7491c23640 1 -- 172.21.15.98:0/3765359428 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7484035e70 msgr2=0x7f7484034310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.419+0000 7f7491c23640 1 --2- 172.21.15.98:0/3765359428 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7484035e70 0x7f7484034310 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f748c077330 tx=0x7f748c0ae080 comp rx=0 tx=0).stop 2024-09-17T05:21:30.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.419+0000 7f7491c23640 1 -- 172.21.15.98:0/3765359428 shutdown_connections 2024-09-17T05:21:30.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.419+0000 7f7491c23640 1 --2- 172.21.15.98:0/3765359428 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7484035e70 0x7f7484034310 secure :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f748c077330 tx=0x7f748c0ae080 comp rx=0 tx=0).stop 2024-09-17T05:21:30.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.419+0000 7f7491c23640 1 --2- 172.21.15.98:0/3765359428 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f74840e2240 0x7f748403a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.422 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.419+0000 7f7491c23640 1 -- 172.21.15.98:0/3765359428 >> 172.21.15.98:0/3765359428 conn(0x7f748401dbc0 msgr2=0x7f74840549b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:30.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.421+0000 7fd8b67c8640 1 --2- 172.21.15.98:0/202336500 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8b0099290 0x7fd8b0158740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:21:30.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.421+0000 7f7491c23640 1 -- 172.21.15.98:0/3765359428 shutdown_connections 2024-09-17T05:21:30.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.421+0000 7f7491c23640 1 -- 172.21.15.98:0/3765359428 wait complete. 2024-09-17T05:21:30.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.423+0000 7f7491c23640 1 Processor -- start 2024-09-17T05:21:30.425 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.423+0000 7fd8a67fc640 1 -- 172.21.15.98:0/202336500 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a8003b70 con 0x7fd8b00af430 2024-09-17T05:21:30.425 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.423+0000 7fd8b822b640 1 -- 172.21.15.98:0/202336500 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8b00b4630 con 0x7fd8b00af430 2024-09-17T05:21:30.425 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.424+0000 7fd8b822b640 1 -- 172.21.15.98:0/202336500 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8b00b4bf0 con 0x7fd8b00af430 2024-09-17T05:21:30.425 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.424+0000 7f7491c23640 1 -- start start 2024-09-17T05:21:30.425 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.425+0000 7fa1f17fa640 1 -- 172.21.15.98:0/4218622055 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v10)=0 v10) ==== 106+0+0 (secure 0 0 0) 0x7fa1ec012870 con 0x7fa1f415b910 2024-09-17T05:21:30.426 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.425+0000 7fd8a67fc640 1 -- 172.21.15.98:0/202336500 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd8a8003d10 con 0x7fd8b00af430 2024-09-17T05:21:30.426 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.425+0000 7fd8a67fc640 1 -- 172.21.15.98:0/202336500 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a800aab0 con 0x7fd8b00af430 2024-09-17T05:21:30.426 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.425+0000 7fd8a67fc640 1 -- 172.21.15.98:0/202336500 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd8a800ad10 con 0x7fd8b00af430 2024-09-17T05:21:30.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.425+0000 7f7491c23640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7484005e50 0x7f748404f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:30.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.425+0000 7f7491c23640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74840e2240 0x7f74840dcd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:30.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.425+0000 7f7491c23640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f748404e790 0x7f74840513c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:30.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.425+0000 7f7491c23640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f74840062e0 con 0x7f7484005e50 2024-09-17T05:21:30.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.425+0000 7f7491c23640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7484004d10 con 0x7f74840e2240 2024-09-17T05:21:30.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.425+0000 7f7491c23640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f7484006460 con 0x7f748404e790 2024-09-17T05:21:30.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.426+0000 7fd8a67fc640 1 -- 172.21.15.98:0/202336500 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd8a8012ac0 con 0x7fd8b00af430 2024-09-17T05:21:30.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.426+0000 7f748bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74840e2240 0x7f74840dcd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:30.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.426+0000 7f748bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74840e2240 0x7f74840dcd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.98:39538/0 (socket says 172.21.15.98:39538) 2024-09-17T05:21:30.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.426+0000 7f7491422640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f748404e790 0x7f74840513c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:30.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.426+0000 7f748bfff640 1 -- 172.21.15.98:0/4277257704 learned_addr learned my addr 172.21.15.98:0/4277257704 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:21:30.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.427+0000 7fd89bfff640 1 -- 172.21.15.98:0/202336500 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd890005290 con 0x7fd8b00af430 2024-09-17T05:21:30.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.427+0000 7f7491422640 1 -- 172.21.15.98:0/4277257704 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74840e2240 msgr2=0x7f74840dcd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.427+0000 7f7491422640 1 --2- 172.21.15.98:0/4277257704 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74840e2240 0x7f74840dcd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.427+0000 7f7490c21640 1 --2- 172.21.15.98:0/4277257704 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7484005e50 0x7f748404f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:30.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.427+0000 7f7491422640 1 -- 172.21.15.98:0/4277257704 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7484005e50 msgr2=0x7f748404f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.427+0000 7f7491422640 1 --2- 172.21.15.98:0/4277257704 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7484005e50 0x7f748404f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.427+0000 7f7491422640 1 -- 172.21.15.98:0/4277257704 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f748404af50 con 0x7f748404e790 2024-09-17T05:21:30.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.427+0000 7f7490c21640 1 --2- 172.21.15.98:0/4277257704 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7484005e50 0x7f748404f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:21:30.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.429+0000 7fd8a67fc640 1 -- 172.21.15.98:0/202336500 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fd8a80050d0 con 0x7fd8b00af430 2024-09-17T05:21:30.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.429+0000 7fa1f9f9f640 1 -- 172.21.15.98:0/4218622055 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa1f415b910 msgr2=0x7fa1f41e6510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.429+0000 7fa1f9f9f640 1 --2- 172.21.15.98:0/4218622055 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa1f415b910 0x7fa1f41e6510 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec00c780 tx=0x7fa1ec00cc40 comp rx=0 tx=0).stop 2024-09-17T05:21:30.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.430+0000 7fa1f9f9f640 1 -- 172.21.15.98:0/4218622055 shutdown_connections 2024-09-17T05:21:30.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.430+0000 7fa1f9f9f640 1 --2- 172.21.15.98:0/4218622055 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa1f415b910 0x7fa1f41e6510 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.430+0000 7fa1f9f9f640 1 --2- 172.21.15.98:0/4218622055 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1f40cea20 0x7fa1f4154080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.430+0000 7fa1f9f9f640 1 --2- 172.21.15.98:0/4218622055 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1f406f090 0x7fa1f41e5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.430+0000 7fa1f9f9f640 1 -- 172.21.15.98:0/4218622055 >> 172.21.15.98:0/4218622055 conn(0x7fa1f40ccec0 msgr2=0x7fa1f406fb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:30.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.430+0000 7fa1f9f9f640 1 -- 172.21.15.98:0/4218622055 shutdown_connections 2024-09-17T05:21:30.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.430+0000 7fa1f9f9f640 1 -- 172.21.15.98:0/4218622055 wait complete. 2024-09-17T05:21:30.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.433+0000 7f7491422640 1 --2- 172.21.15.98:0/4277257704 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f748404e790 0x7f74840513c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f748000c3c0 tx=0x7f748000c7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:30.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.433+0000 7f74897fa640 1 -- 172.21.15.98:0/4277257704 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7480011790 con 0x7f748404e790 2024-09-17T05:21:30.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.433+0000 7f7491c23640 1 -- 172.21.15.98:0/4277257704 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f748404b230 con 0x7f748404e790 2024-09-17T05:21:30.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.433+0000 7f7491c23640 1 -- 172.21.15.98:0/4277257704 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7484049180 con 0x7f748404e790 2024-09-17T05:21:30.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.435+0000 7f74897fa640 1 -- 172.21.15.98:0/4277257704 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7480017070 con 0x7f748404e790 2024-09-17T05:21:30.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.435+0000 7f74897fa640 1 -- 172.21.15.98:0/4277257704 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7480011cc0 con 0x7f748404e790 2024-09-17T05:21:30.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.435+0000 7f74897fa640 1 -- 172.21.15.98:0/4277257704 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f748001c460 con 0x7f748404e790 2024-09-17T05:21:30.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.435+0000 7f74897fa640 1 -- 172.21.15.98:0/4277257704 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f74800129a0 con 0x7f748404e790 2024-09-17T05:21:30.439 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.438+0000 7f7476ffd640 1 -- 172.21.15.98:0/4277257704 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f746c005290 con 0x7f748404e790 2024-09-17T05:21:30.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.443+0000 7f74897fa640 1 -- 172.21.15.98:0/4277257704 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f7480012420 con 0x7f748404e790 2024-09-17T05:21:30.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.450+0000 7f7d13047640 1 -- 172.21.15.98:0/1541430199 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7d0c06cb70 msgr2=0x7f7d0c15efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.450+0000 7f7d13047640 1 --2- 172.21.15.98:0/1541430199 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7d0c06cb70 0x7f7d0c15efe0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c06dbf0 tx=0x7f7d0002a3b0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.450+0000 7f899f352640 1 -- 172.21.15.98:0/1462105228 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f897c005580 con 0x7f89980cbe00 2024-09-17T05:21:30.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.450+0000 7f7d13047640 1 -- 172.21.15.98:0/1541430199 shutdown_connections 2024-09-17T05:21:30.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.450+0000 7f7d13047640 1 --2- 172.21.15.98:0/1541430199 >> v2:172.21.15.167:3300/0 conn(0x7f7d0c162440 0x7f7d0c0cf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.450+0000 7f7d13047640 1 --2- 172.21.15.98:0/1541430199 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7d0c06cb70 0x7f7d0c15efe0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.450+0000 7f7d13047640 1 -- 172.21.15.98:0/1541430199 >> 172.21.15.98:0/1541430199 conn(0x7f7d0c0cdde0 msgr2=0x7f7d0c0d0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:30.452 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi098') 2024-09-17T05:21:30.453 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi098') 2024-09-17T05:21:30.456 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.451+0000 7f7d13047640 1 -- 172.21.15.98:0/1541430199 shutdown_connections 2024-09-17T05:21:30.456 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.451+0000 7f7d13047640 1 -- 172.21.15.98:0/1541430199 wait complete. 2024-09-17T05:21:30.456 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.453+0000 7f7d13047640 1 Processor -- start 2024-09-17T05:21:30.456 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.453+0000 7f7d13047640 1 -- start start 2024-09-17T05:21:30.457 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.454+0000 7f7d13047640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d0c06cb70 0x7f7d0c153910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:30.457 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.454+0000 7f7d13047640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7d0c0cbe00 0x7f7d0c0b0f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:30.457 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.454+0000 7f7d13047640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d0c162440 0x7f7d0c215f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:30.457 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.454+0000 7f7d13047640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7d0c0cf9d0 con 0x7f7d0c0cbe00 2024-09-17T05:21:30.457 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.454+0000 7f7d13047640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7d0c0cf850 con 0x7f7d0c162440 2024-09-17T05:21:30.457 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.454+0000 7f7d13047640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f7d0c0cfb50 con 0x7f7d0c06cb70 2024-09-17T05:21:30.457 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.455+0000 7f7d0bfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7d0c0cbe00 0x7f7d0c0b0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:30.457 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.455+0000 7f7d0bfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7d0c0cbe00 0x7f7d0c0b0f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60140/0 (socket says 172.21.15.98:60140) 2024-09-17T05:21:30.457 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.455+0000 7f7d0bfff640 1 -- 172.21.15.98:0/1241405910 learned_addr learned my addr 172.21.15.98:0/1241405910 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:21:30.460 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.459+0000 7f7d0bfff640 1 -- 172.21.15.98:0/1241405910 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d0c06cb70 msgr2=0x7f7d0c153910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.460 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.459+0000 7f7d0bfff640 1 --2- 172.21.15.98:0/1241405910 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d0c06cb70 0x7f7d0c153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.461 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.459+0000 7f7d0bfff640 1 -- 172.21.15.98:0/1241405910 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d0c162440 msgr2=0x7f7d0c215f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.461 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.459+0000 7f7d0bfff640 1 --2- 172.21.15.98:0/1241405910 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d0c162440 0x7f7d0c215f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.461 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.459+0000 7f7d0bfff640 1 -- 172.21.15.98:0/1241405910 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d0c0b4950 con 0x7f7d0c0cbe00 2024-09-17T05:21:30.461 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.459+0000 7f7d0bfff640 1 --2- 172.21.15.98:0/1241405910 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7d0c0cbe00 0x7f7d0c0b0f30 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc00c730 tx=0x7f7cfc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:30.461 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.459+0000 7f7d097fa640 1 -- 172.21.15.98:0/1241405910 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc017070 con 0x7f7d0c0cbe00 2024-09-17T05:21:30.461 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.460+0000 7f7d097fa640 1 -- 172.21.15.98:0/1241405910 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7cfc005360 con 0x7f7d0c0cbe00 2024-09-17T05:21:30.461 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.460+0000 7f7d097fa640 1 -- 172.21.15.98:0/1241405910 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc00a8a0 con 0x7f7d0c0cbe00 2024-09-17T05:21:30.461 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.460+0000 7f7d13047640 1 -- 172.21.15.98:0/1241405910 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d0c0b4110 con 0x7f7d0c0cbe00 2024-09-17T05:21:30.461 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.460+0000 7f7d13047640 1 -- 172.21.15.98:0/1241405910 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d0c215a30 con 0x7f7d0c0cbe00 2024-09-17T05:21:30.462 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.461+0000 7f898dffb640 1 -- 172.21.15.98:0/1462105228 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v11)=0 v11) ==== 122+0+0 (secure 0 0 0) 0x7f8994003a70 con 0x7f89980cbe00 2024-09-17T05:21:30.463 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.461+0000 7f7d13047640 1 -- 172.21.15.98:0/1241405910 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d0c215c30 con 0x7f7d0c0cbe00 2024-09-17T05:21:30.463 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.462+0000 7f573ec6a640 1 -- 172.21.15.98:0/171509651 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57380d1940 msgr2=0x7f5738162660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.463 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.462+0000 7f573ec6a640 1 --2- 172.21.15.98:0/171509651 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57380d1940 0x7f5738162660 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5728005fd0 tx=0x7f572802a560 comp rx=0 tx=0).stop 2024-09-17T05:21:30.463 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.462+0000 7f573ec6a640 1 -- 172.21.15.98:0/171509651 shutdown_connections 2024-09-17T05:21:30.464 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.462+0000 7f573ec6a640 1 --2- 172.21.15.98:0/171509651 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57380d1940 0x7f5738162660 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.464 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.462+0000 7f573ec6a640 1 --2- 172.21.15.98:0/171509651 >> v2:172.21.15.167:3300/0 conn(0x7f57380ce930 0x7f57380ced10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.464 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.462+0000 7f573ec6a640 1 -- 172.21.15.98:0/171509651 >> 172.21.15.98:0/171509651 conn(0x7f57380d1e40 msgr2=0x7f57380d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:30.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.465+0000 7f899f352640 1 -- 172.21.15.98:0/1462105228 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89980cbe00 msgr2=0x7f89982041a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.465+0000 7f899f352640 1 --2- 172.21.15.98:0/1462105228 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89980cbe00 0x7f89982041a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f899400d900 tx=0x7f899400ddc0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.465+0000 7f7d097fa640 1 -- 172.21.15.98:0/1241405910 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7cfc01a070 con 0x7f7d0c0cbe00 2024-09-17T05:21:30.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.465+0000 7f7d097fa640 1 -- 172.21.15.98:0/1241405910 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7cfc01c440 con 0x7f7d0c0cbe00 2024-09-17T05:21:30.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.465+0000 7f7d097fa640 1 -- 172.21.15.98:0/1241405910 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f7d0c215c30 con 0x7f7d0c0cbe00 2024-09-17T05:21:30.470 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.465+0000 7f899f352640 1 -- 172.21.15.98:0/1462105228 shutdown_connections 2024-09-17T05:21:30.470 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.465+0000 7f899f352640 1 --2- 172.21.15.98:0/1462105228 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8998162440 0x7f89980aefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.470 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.465+0000 7f899f352640 1 --2- 172.21.15.98:0/1462105228 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89980cbe00 0x7f89982041a0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.470 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.465+0000 7f899f352640 1 --2- 172.21.15.98:0/1462105228 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f899806cb70 0x7f8998201ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.470 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.465+0000 7f899f352640 1 -- 172.21.15.98:0/1462105228 >> 172.21.15.98:0/1462105228 conn(0x7f89980cdde0 msgr2=0x7f89980d0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:30.470 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.465+0000 7f899f352640 1 -- 172.21.15.98:0/1462105228 shutdown_connections 2024-09-17T05:21:30.470 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.466+0000 7f899f352640 1 -- 172.21.15.98:0/1462105228 wait complete. 2024-09-17T05:21:30.470 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.465+0000 7f573ec6a640 1 -- 172.21.15.98:0/171509651 shutdown_connections 2024-09-17T05:21:30.471 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.465+0000 7f573ec6a640 1 -- 172.21.15.98:0/171509651 wait complete. 2024-09-17T05:21:30.471 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.467+0000 7f573ec6a640 1 Processor -- start 2024-09-17T05:21:30.471 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.467+0000 7f573ec6a640 1 -- start start 2024-09-17T05:21:30.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.472+0000 7f573ec6a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57380b0d30 0x7f5738071f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:30.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.472+0000 7f573ec6a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57380ce930 0x7f57380d0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:30.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.472+0000 7f573ec6a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57380d1940 0x7f57380d1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:30.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.472+0000 7f573ec6a640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f573806ec60 con 0x7f57380b0d30 2024-09-17T05:21:30.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.472+0000 7f573ec6a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f573806eae0 con 0x7f57380ce930 2024-09-17T05:21:30.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.472+0000 7f573ec6a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f573806ede0 con 0x7f57380d1940 2024-09-17T05:21:30.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.472+0000 7f573ca06640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57380b0d30 0x7f5738071f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:30.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.472+0000 7f573ca06640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57380b0d30 0x7f5738071f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60152/0 (socket says 172.21.15.98:60152) 2024-09-17T05:21:30.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.472+0000 7f573ca06640 1 -- 172.21.15.98:0/3419227897 learned_addr learned my addr 172.21.15.98:0/3419227897 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:21:30.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.472+0000 7f573ca06640 1 -- 172.21.15.98:0/3419227897 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57380d1940 msgr2=0x7f57380d1090 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T05:21:30.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.472+0000 7f573ca06640 1 --2- 172.21.15.98:0/3419227897 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57380d1940 0x7f57380d1090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.472+0000 7f573ca06640 1 -- 172.21.15.98:0/3419227897 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57380ce930 msgr2=0x7f57380d0b50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T05:21:30.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.472+0000 7f573ca06640 1 --2- 172.21.15.98:0/3419227897 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57380ce930 0x7f57380d0b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.472+0000 7f573ca06640 1 -- 172.21.15.98:0/3419227897 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5738212770 con 0x7f57380b0d30 2024-09-17T05:21:30.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.473+0000 7f573ca06640 1 --2- 172.21.15.98:0/3419227897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57380b0d30 0x7f5738071f20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f573001cbf0 tx=0x7f573000b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:30.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.473+0000 7f57357fa640 1 -- 172.21.15.98:0/3419227897 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5730013070 con 0x7f57380b0d30 2024-09-17T05:21:30.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.473+0000 7f573ec6a640 1 -- 172.21.15.98:0/3419227897 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57382129f0 con 0x7f57380b0d30 2024-09-17T05:21:30.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.473+0000 7f573ec6a640 1 -- 172.21.15.98:0/3419227897 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5738212fb0 con 0x7f57380b0d30 2024-09-17T05:21:30.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.474+0000 7f57357fa640 1 -- 172.21.15.98:0/3419227897 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f573000f460 con 0x7f57380b0d30 2024-09-17T05:21:30.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.475+0000 7f57357fa640 1 -- 172.21.15.98:0/3419227897 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f573000f870 con 0x7f57380b0d30 2024-09-17T05:21:30.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.475+0000 7f57357fa640 1 -- 172.21.15.98:0/3419227897 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5730016070 con 0x7f57380b0d30 2024-09-17T05:21:30.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.475+0000 7f57357fa640 1 -- 172.21.15.98:0/3419227897 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5730020de0 con 0x7f57380b0d30 2024-09-17T05:21:30.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.477+0000 7f573ec6a640 1 -- 172.21.15.98:0/3419227897 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5718005290 con 0x7f57380b0d30 2024-09-17T05:21:30.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.480+0000 7f57357fa640 1 -- 172.21.15.98:0/3419227897 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f5730025070 con 0x7f57380b0d30 2024-09-17T05:21:30.484 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi098') 2024-09-17T05:21:30.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.497+0000 7f6e96732640 1 -- 172.21.15.98:0/1432967822 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f6e70005580 con 0x7f6e9006cb70 2024-09-17T05:21:30.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.503+0000 7f6e8cff9640 1 -- 172.21.15.98:0/1432967822 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v12)=0 v12) ==== 121+0+0 (secure 0 0 0) 0x7f6e8801e520 con 0x7f6e9006cb70 2024-09-17T05:21:30.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.508+0000 7f6e96732640 1 -- 172.21.15.98:0/1432967822 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e9006cb70 msgr2=0x7f6e900c7e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.508+0000 7f6e96732640 1 --2- 172.21.15.98:0/1432967822 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e9006cb70 0x7f6e900c7e00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6e8800bd60 tx=0x7f6e88009f10 comp rx=0 tx=0).stop 2024-09-17T05:21:30.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.509+0000 7f6e96732640 1 -- 172.21.15.98:0/1432967822 shutdown_connections 2024-09-17T05:21:30.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.509+0000 7f6e96732640 1 --2- 172.21.15.98:0/1432967822 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6e90162440 0x7f6e900b4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.509+0000 7f6e96732640 1 --2- 172.21.15.98:0/1432967822 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6e900cbe00 0x7f6e90156640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.509+0000 7f6e96732640 1 --2- 172.21.15.98:0/1432967822 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e9006cb70 0x7f6e900c7e00 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.509+0000 7f6e96732640 1 -- 172.21.15.98:0/1432967822 >> 172.21.15.98:0/1432967822 conn(0x7f6e900cdde0 msgr2=0x7f6e9015d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:30.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.509+0000 7f6e96732640 1 -- 172.21.15.98:0/1432967822 shutdown_connections 2024-09-17T05:21:30.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.509+0000 7f6e96732640 1 -- 172.21.15.98:0/1432967822 wait complete. 2024-09-17T05:21:30.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.530+0000 7f33867fc640 1 -- 172.21.15.98:0/1975892080 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f33a0157560 con 0x7f33a00cfc00 2024-09-17T05:21:30.538 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.538+0000 7f339cff9640 1 -- 172.21.15.98:0/1975892080 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v13)=0 v13) ==== 121+0+0 (secure 0 0 0) 0x7f339803d420 con 0x7f33a00cfc00 2024-09-17T05:21:30.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.539+0000 7f33867fc640 1 -- 172.21.15.98:0/1975892080 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f33a00cfc00 msgr2=0x7f33a00b5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.539+0000 7f33867fc640 1 --2- 172.21.15.98:0/1975892080 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f33a00cfc00 0x7f33a00b5b20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3398006010 tx=0x7f3398030890 comp rx=0 tx=0).stop 2024-09-17T05:21:30.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.539+0000 7f33867fc640 1 -- 172.21.15.98:0/1975892080 shutdown_connections 2024-09-17T05:21:30.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.539+0000 7f33867fc640 1 --2- 172.21.15.98:0/1975892080 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f33a00cfc00 0x7f33a00b5b20 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.539+0000 7f33867fc640 1 --2- 172.21.15.98:0/1975892080 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33a00cf820 0x7f33a00c9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.539+0000 7f33867fc640 1 --2- 172.21.15.98:0/1975892080 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33a00af430 0x7f33a00b3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.539+0000 7f33867fc640 1 -- 172.21.15.98:0/1975892080 >> 172.21.15.98:0/1975892080 conn(0x7f33a0074240 msgr2=0x7f33a00702e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:30.541 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.540+0000 7f33867fc640 1 -- 172.21.15.98:0/1975892080 shutdown_connections 2024-09-17T05:21:30.541 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.540+0000 7f33867fc640 1 -- 172.21.15.98:0/1975892080 wait complete. 2024-09-17T05:21:30.546 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.545+0000 7f4b5ddc9640 1 -- 172.21.15.98:0/323181567 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f4b38005580 con 0x7f4b580cc430 2024-09-17T05:21:30.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.551+0000 7f4b3ffff640 1 -- 172.21.15.98:0/323181567 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v14)=0 v14) ==== 119+0+0 (secure 0 0 0) 0x7f4b5000acf0 con 0x7f4b580cc430 2024-09-17T05:21:30.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.553+0000 7f4b5ddc9640 1 -- 172.21.15.98:0/323181567 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b580cc430 msgr2=0x7f4b58204b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.554 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.553+0000 7f4b5ddc9640 1 --2- 172.21.15.98:0/323181567 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b580cc430 0x7f4b58204b90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4b5000cad0 tx=0x7f4b5000cf90 comp rx=0 tx=0).stop 2024-09-17T05:21:30.554 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.553+0000 7f4b5ddc9640 1 -- 172.21.15.98:0/323181567 shutdown_connections 2024-09-17T05:21:30.554 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.553+0000 7f4b5ddc9640 1 --2- 172.21.15.98:0/323181567 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b580c6af0 0x7f4b581f0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.554 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.553+0000 7f4b5ddc9640 1 --2- 172.21.15.98:0/323181567 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b580cc430 0x7f4b58204b90 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.554 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.553+0000 7f4b5ddc9640 1 --2- 172.21.15.98:0/323181567 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b5806ffa0 0x7f4b580c9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.554 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.553+0000 7f4b5ddc9640 1 -- 172.21.15.98:0/323181567 >> 172.21.15.98:0/323181567 conn(0x7f4b580b15f0 msgr2=0x7f4b580741d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:30.554 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.554+0000 7fa3fe732640 1 -- 172.21.15.98:0/3092591207 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7fa3d8005580 con 0x7fa3f004eb20 2024-09-17T05:21:30.555 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.554+0000 7f4b5ddc9640 1 -- 172.21.15.98:0/323181567 shutdown_connections 2024-09-17T05:21:30.555 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.554+0000 7f4b5ddc9640 1 -- 172.21.15.98:0/323181567 wait complete. 2024-09-17T05:21:30.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.559+0000 7fa3edffb640 1 -- 172.21.15.98:0/3092591207 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v15)=0 v15) ==== 121+0+0 (secure 0 0 0) 0x7fa3f4018600 con 0x7fa3f004eb20 2024-09-17T05:21:30.561 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.560+0000 7fa3fe732640 1 -- 172.21.15.98:0/3092591207 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa3f004eb20 msgr2=0x7fa3f0186070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.561 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.560+0000 7fa3fe732640 1 --2- 172.21.15.98:0/3092591207 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa3f004eb20 0x7fa3f0186070 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa3f400ea20 tx=0x7fa3f400eee0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.562 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi098') 2024-09-17T05:21:30.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.561+0000 7fa3fe732640 1 -- 172.21.15.98:0/3092591207 shutdown_connections 2024-09-17T05:21:30.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.561+0000 7fa3fe732640 1 --2- 172.21.15.98:0/3092591207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3f00e6d90 0x7fa3f00dee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.561+0000 7fa3fe732640 1 --2- 172.21.15.98:0/3092591207 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3f00e69b0 0x7fa3f00de940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.561+0000 7fa3fe732640 1 --2- 172.21.15.98:0/3092591207 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa3f004eb20 0x7fa3f0186070 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.561+0000 7fa3fe732640 1 -- 172.21.15.98:0/3092591207 >> 172.21.15.98:0/3092591207 conn(0x7fa3f001d770 msgr2=0x7fa3f00501a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:30.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.562+0000 7fa3fe732640 1 -- 172.21.15.98:0/3092591207 shutdown_connections 2024-09-17T05:21:30.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.562+0000 7fa3fe732640 1 -- 172.21.15.98:0/3092591207 wait complete. 2024-09-17T05:21:30.569 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi098') 2024-09-17T05:21:30.569 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi098') 2024-09-17T05:21:30.572 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.572+0000 7f7476ffd640 1 -- 172.21.15.98:0/4277257704 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f746c005580 con 0x7f748404e790 2024-09-17T05:21:30.578 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.577+0000 7f74897fa640 1 -- 172.21.15.98:0/4277257704 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v16)=0 v16) ==== 121+0+0 (secure 0 0 0) 0x7f7480012bf0 con 0x7f748404e790 2024-09-17T05:21:30.578 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.577+0000 7fd89bfff640 1 -- 172.21.15.98:0/202336500 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fd890005580 con 0x7fd8b00af430 2024-09-17T05:21:30.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.578+0000 7f7476ffd640 1 -- 172.21.15.98:0/4277257704 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f748404e790 msgr2=0x7f74840513c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.578+0000 7f7476ffd640 1 --2- 172.21.15.98:0/4277257704 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f748404e790 0x7f74840513c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f748000c3c0 tx=0x7f748000c7c0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.578+0000 7f7476ffd640 1 -- 172.21.15.98:0/4277257704 shutdown_connections 2024-09-17T05:21:30.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.578+0000 7f7476ffd640 1 --2- 172.21.15.98:0/4277257704 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f748404e790 0x7f74840513c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.578+0000 7f7476ffd640 1 --2- 172.21.15.98:0/4277257704 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74840e2240 0x7f74840dcd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.578+0000 7f7476ffd640 1 --2- 172.21.15.98:0/4277257704 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7484005e50 0x7f748404f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.580 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.578+0000 7f7476ffd640 1 -- 172.21.15.98:0/4277257704 >> 172.21.15.98:0/4277257704 conn(0x7f748401dbc0 msgr2=0x7f74840055e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:30.580 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.578+0000 7f7476ffd640 1 -- 172.21.15.98:0/4277257704 shutdown_connections 2024-09-17T05:21:30.580 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.578+0000 7f7476ffd640 1 -- 172.21.15.98:0/4277257704 wait complete. 2024-09-17T05:21:30.583 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.582+0000 7fd8a67fc640 1 -- 172.21.15.98:0/202336500 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v17)=0 v17) ==== 120+0+0 (secure 0 0 0) 0x7fd8a80052b0 con 0x7fd8b00af430 2024-09-17T05:21:30.584 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.583+0000 7fd89bfff640 1 -- 172.21.15.98:0/202336500 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8b00af430 msgr2=0x7fd8b0151c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.583+0000 7fd89bfff640 1 --2- 172.21.15.98:0/202336500 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8b00af430 0x7fd8b0151c40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd8a800c780 tx=0x7fd8a800cc40 comp rx=0 tx=0).stop 2024-09-17T05:21:30.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.583+0000 7fd89bfff640 1 -- 172.21.15.98:0/202336500 shutdown_connections 2024-09-17T05:21:30.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.583+0000 7fd89bfff640 1 --2- 172.21.15.98:0/202336500 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8b0099290 0x7fd8b0158740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.583+0000 7fd89bfff640 1 --2- 172.21.15.98:0/202336500 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8b00cf820 0x7fd8b015d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.583+0000 7fd89bfff640 1 --2- 172.21.15.98:0/202336500 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8b00af430 0x7fd8b0151c40 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.583+0000 7fd89bfff640 1 -- 172.21.15.98:0/202336500 >> 172.21.15.98:0/202336500 conn(0x7fd8b0074240 msgr2=0x7fd8b0157680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:30.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.584+0000 7fd89bfff640 1 -- 172.21.15.98:0/202336500 shutdown_connections 2024-09-17T05:21:30.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.584+0000 7fd89bfff640 1 -- 172.21.15.98:0/202336500 wait complete. 2024-09-17T05:21:30.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.602+0000 7f7d13047640 1 -- 172.21.15.98:0/1241405910 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f7d0c15efe0 con 0x7f7d0c0cbe00 2024-09-17T05:21:30.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.605+0000 7f7d097fa640 1 -- 172.21.15.98:0/1241405910 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v18)=0 v18) ==== 125+0+0 (secure 0 0 0) 0x7f7cfc021020 con 0x7f7d0c0cbe00 2024-09-17T05:21:30.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.606+0000 7f7d13047640 1 -- 172.21.15.98:0/1241405910 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7d0c0cbe00 msgr2=0x7f7d0c0b0f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.606+0000 7f7d13047640 1 --2- 172.21.15.98:0/1241405910 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7d0c0cbe00 0x7f7d0c0b0f30 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc00c730 tx=0x7f7cfc00cbf0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.606+0000 7f7d13047640 1 -- 172.21.15.98:0/1241405910 shutdown_connections 2024-09-17T05:21:30.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.606+0000 7f7d13047640 1 --2- 172.21.15.98:0/1241405910 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d0c162440 0x7f7d0c215f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.606+0000 7f7d13047640 1 --2- 172.21.15.98:0/1241405910 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7d0c0cbe00 0x7f7d0c0b0f30 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.606+0000 7f7d13047640 1 --2- 172.21.15.98:0/1241405910 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d0c06cb70 0x7f7d0c153910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.606+0000 7f7d13047640 1 -- 172.21.15.98:0/1241405910 >> 172.21.15.98:0/1241405910 conn(0x7f7d0c0cdde0 msgr2=0x7f7d0c06f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:30.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.606+0000 7f7d13047640 1 -- 172.21.15.98:0/1241405910 shutdown_connections 2024-09-17T05:21:30.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.606+0000 7f7d13047640 1 -- 172.21.15.98:0/1241405910 wait complete. 2024-09-17T05:21:30.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.609+0000 7f573ec6a640 1 -- 172.21.15.98:0/3419227897 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f5718005580 con 0x7f57380b0d30 2024-09-17T05:21:30.612 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.612+0000 7f57357fa640 1 -- 172.21.15.98:0/3419227897 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v19)=0 v19) ==== 120+0+0 (secure 0 0 0) 0x7f5738212770 con 0x7f57380b0d30 2024-09-17T05:21:30.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.613+0000 7f573ec6a640 1 -- 172.21.15.98:0/3419227897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57380b0d30 msgr2=0x7f5738071f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.613+0000 7f573ec6a640 1 --2- 172.21.15.98:0/3419227897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57380b0d30 0x7f5738071f20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f573001cbf0 tx=0x7f573000b630 comp rx=0 tx=0).stop 2024-09-17T05:21:30.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.613+0000 7f573ec6a640 1 -- 172.21.15.98:0/3419227897 shutdown_connections 2024-09-17T05:21:30.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.613+0000 7f573ec6a640 1 --2- 172.21.15.98:0/3419227897 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57380d1940 0x7f57380d1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.613+0000 7f573ec6a640 1 --2- 172.21.15.98:0/3419227897 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57380ce930 0x7f57380d0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.613+0000 7f573ec6a640 1 --2- 172.21.15.98:0/3419227897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57380b0d30 0x7f5738071f20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.613+0000 7f573ec6a640 1 -- 172.21.15.98:0/3419227897 >> 172.21.15.98:0/3419227897 conn(0x7f57380d1e40 msgr2=0x7f57381610d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:30.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.613+0000 7f573ec6a640 1 -- 172.21.15.98:0/3419227897 shutdown_connections 2024-09-17T05:21:30.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.613+0000 7f573ec6a640 1 -- 172.21.15.98:0/3419227897 wait complete. 2024-09-17T05:21:30.628 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi098') 2024-09-17T05:21:30.628 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi098') 2024-09-17T05:21:30.628 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi098') 2024-09-17T05:21:30.628 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi098') 2024-09-17T05:21:30.628 INFO:tasks.ceph:Setting crush tunables to default 2024-09-17T05:21:30.629 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph osd crush tunables default 2024-09-17T05:21:30.771 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.769+0000 7fe5de36b640 1 -- 172.21.15.98:0/2240929359 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5d80cee50 msgr2=0x7fe5d80cba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.771 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.769+0000 7fe5de36b640 1 --2- 172.21.15.98:0/2240929359 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5d80cee50 0x7fe5d80cba70 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe5d80766a0 tx=0x7fe5d002aa30 comp rx=0 tx=0).stop 2024-09-17T05:21:30.771 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.769+0000 7fe5de36b640 1 -- 172.21.15.98:0/2240929359 shutdown_connections 2024-09-17T05:21:30.771 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.769+0000 7fe5de36b640 1 --2- 172.21.15.98:0/2240929359 >> v2:172.21.15.167:3300/0 conn(0x7fe5d815b1c0 0x7fe5d80ce910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.771 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.769+0000 7fe5de36b640 1 --2- 172.21.15.98:0/2240929359 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5d80cee50 0x7fe5d80cba70 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.771 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.769+0000 7fe5de36b640 1 --2- 172.21.15.98:0/2240929359 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe5d80ccce0 0x7fe5d8073ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.771 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.769+0000 7fe5de36b640 1 -- 172.21.15.98:0/2240929359 >> 172.21.15.98:0/2240929359 conn(0x7fe5d80d0d40 msgr2=0x7fe5d80d1150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:30.771 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.769+0000 7fe5de36b640 1 -- 172.21.15.98:0/2240929359 shutdown_connections 2024-09-17T05:21:30.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.769+0000 7fe5de36b640 1 -- 172.21.15.98:0/2240929359 wait complete. 2024-09-17T05:21:30.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.770+0000 7fe5de36b640 1 Processor -- start 2024-09-17T05:21:30.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.770+0000 7fe5de36b640 1 -- start start 2024-09-17T05:21:30.774 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.771+0000 7fe5de36b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe5d80ccce0 0x7fe5d81530f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:30.774 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.771+0000 7fe5de36b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5d80cee50 0x7fe5d80b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:30.774 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.771+0000 7fe5de36b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe5d815b1c0 0x7fe5d81f8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:30.774 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.771+0000 7fe5de36b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d80cc340 con 0x7fe5d80cee50 2024-09-17T05:21:30.774 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.771+0000 7fe5de36b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d80cc1c0 con 0x7fe5d815b1c0 2024-09-17T05:21:30.774 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.771+0000 7fe5de36b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fe5d80d0160 con 0x7fe5d80ccce0 2024-09-17T05:21:30.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.771+0000 7fe5d77fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5d80cee50 0x7fe5d80b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:30.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.771+0000 7fe5d77fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5d80cee50 0x7fe5d80b4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60178/0 (socket says 172.21.15.98:60178) 2024-09-17T05:21:30.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.771+0000 7fe5d77fe640 1 -- 172.21.15.98:0/3747422903 learned_addr learned my addr 172.21.15.98:0/3747422903 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:21:30.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.771+0000 7fe5dc908640 1 --2- 172.21.15.98:0/3747422903 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe5d815b1c0 0x7fe5d81f8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:30.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.771+0000 7fe5d7fff640 1 --2- 172.21.15.98:0/3747422903 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe5d80ccce0 0x7fe5d81530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:30.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.771+0000 7fe5d77fe640 1 -- 172.21.15.98:0/3747422903 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe5d80ccce0 msgr2=0x7fe5d81530f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.771+0000 7fe5d77fe640 1 --2- 172.21.15.98:0/3747422903 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe5d80ccce0 0x7fe5d81530f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.771+0000 7fe5d77fe640 1 -- 172.21.15.98:0/3747422903 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe5d815b1c0 msgr2=0x7fe5d81f8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.771+0000 7fe5d77fe640 1 --2- 172.21.15.98:0/3747422903 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe5d815b1c0 0x7fe5d81f8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.771+0000 7fe5d77fe640 1 -- 172.21.15.98:0/3747422903 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5d80c9050 con 0x7fe5d80cee50 2024-09-17T05:21:30.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.771+0000 7fe5d77fe640 1 --2- 172.21.15.98:0/3747422903 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5d80cee50 0x7fe5d80b4dd0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe5c800e7c0 tx=0x7fe5c800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:30.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.771+0000 7fe5d4ff9640 1 -- 172.21.15.98:0/3747422903 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c800ccc0 con 0x7fe5d80cee50 2024-09-17T05:21:30.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.771+0000 7fe5d4ff9640 1 -- 172.21.15.98:0/3747422903 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe5c8010430 con 0x7fe5d80cee50 2024-09-17T05:21:30.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.772+0000 7fe5de36b640 1 -- 172.21.15.98:0/3747422903 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5d80c9330 con 0x7fe5d80cee50 2024-09-17T05:21:30.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.772+0000 7fe5d4ff9640 1 -- 172.21.15.98:0/3747422903 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c8010860 con 0x7fe5d80cee50 2024-09-17T05:21:30.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.772+0000 7fe5de36b640 1 -- 172.21.15.98:0/3747422903 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5d81f8320 con 0x7fe5d80cee50 2024-09-17T05:21:30.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.772+0000 7fe5d4ff9640 1 -- 172.21.15.98:0/3747422903 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe5c8010a00 con 0x7fe5d80cee50 2024-09-17T05:21:30.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.772+0000 7fe5d4ff9640 1 -- 172.21.15.98:0/3747422903 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe5c8018d10 con 0x7fe5d80cee50 2024-09-17T05:21:30.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.773+0000 7fe5de36b640 1 -- 172.21.15.98:0/3747422903 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5d81f8760 con 0x7fe5d80cee50 2024-09-17T05:21:30.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.776+0000 7fe5d4ff9640 1 -- 172.21.15.98:0/3747422903 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fe5c8018420 con 0x7fe5d80cee50 2024-09-17T05:21:30.842 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.841+0000 7fe5de36b640 1 -- 172.21.15.98:0/3747422903 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fe5d80b6cc0 con 0x7fe5d80cee50 2024-09-17T05:21:30.843 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.843+0000 7fe5d4ff9640 1 -- 172.21.15.98:0/3747422903 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fe5c8018600 con 0x7fe5d80cee50 2024-09-17T05:21:30.843 INFO:teuthology.orchestra.run.smithi098.stderr:adjusted tunables profile to default 2024-09-17T05:21:30.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.844+0000 7fe5de36b640 1 -- 172.21.15.98:0/3747422903 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5d80cee50 msgr2=0x7fe5d80b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.844+0000 7fe5de36b640 1 --2- 172.21.15.98:0/3747422903 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5d80cee50 0x7fe5d80b4dd0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe5c800e7c0 tx=0x7fe5c800ec80 comp rx=0 tx=0).stop 2024-09-17T05:21:30.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.844+0000 7fe5de36b640 1 -- 172.21.15.98:0/3747422903 shutdown_connections 2024-09-17T05:21:30.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.844+0000 7fe5de36b640 1 --2- 172.21.15.98:0/3747422903 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe5d815b1c0 0x7fe5d81f8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.844+0000 7fe5de36b640 1 --2- 172.21.15.98:0/3747422903 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5d80cee50 0x7fe5d80b4dd0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.844+0000 7fe5de36b640 1 --2- 172.21.15.98:0/3747422903 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe5d80ccce0 0x7fe5d81530f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.844+0000 7fe5de36b640 1 -- 172.21.15.98:0/3747422903 >> 172.21.15.98:0/3747422903 conn(0x7fe5d80d0d40 msgr2=0x7fe5d815c5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:30.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.844+0000 7fe5de36b640 1 -- 172.21.15.98:0/3747422903 shutdown_connections 2024-09-17T05:21:30.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:30.844+0000 7fe5de36b640 1 -- 172.21.15.98:0/3747422903 wait complete. 2024-09-17T05:21:30.855 INFO:tasks.ceph:check_enable_crimson: False 2024-09-17T05:21:30.855 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-17T05:21:30.855 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T05:21:30.856 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-17T05:21:30.880 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T05:21:30.880 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-17T05:21:30.945 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T05:21:30.945 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-17T05:21:31.011 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T05:21:31.011 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-17T05:21:31.075 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-17T05:21:31.075 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-17T05:21:31.101 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-17T05:21:31.101 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-17T05:21:31.166 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-17T05:21:31.166 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-17T05:21:31.231 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-17T05:21:31.231 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-17T05:21:31.295 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new 65ad711a-df74-438b-b0dc-1499d685c958 0 2024-09-17T05:21:31.440 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.439+0000 7f752a5bb640 1 -- 172.21.15.167:0/1640032473 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75240b0cc0 msgr2=0x7f75240ce1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:31.440 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.439+0000 7f752a5bb640 1 --2- 172.21.15.167:0/1640032473 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75240b0cc0 0x7f75240ce1f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f750c005fd0 tx=0x7f750c02a620 comp rx=0 tx=0).stop 2024-09-17T05:21:31.440 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.439+0000 7f752a5bb640 1 -- 172.21.15.167:0/1640032473 shutdown_connections 2024-09-17T05:21:31.440 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.439+0000 7f752a5bb640 1 --2- 172.21.15.167:0/1640032473 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75240b0cc0 0x7f75240ce1f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:31.441 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.439+0000 7f752a5bb640 1 --2- 172.21.15.167:0/1640032473 >> v2:172.21.15.98:3300/0 conn(0x7f752415e2a0 0x7f75240b0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:31.441 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.439+0000 7f752a5bb640 1 -- 172.21.15.167:0/1640032473 >> 172.21.15.167:0/1640032473 conn(0x7f7524074240 msgr2=0x7f7524074650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:31.441 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.439+0000 7f752a5bb640 1 -- 172.21.15.167:0/1640032473 shutdown_connections 2024-09-17T05:21:31.441 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.439+0000 7f752a5bb640 1 -- 172.21.15.167:0/1640032473 wait complete. 2024-09-17T05:21:31.441 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.441+0000 7f752a5bb640 1 Processor -- start 2024-09-17T05:21:31.442 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.441+0000 7f752a5bb640 1 -- start start 2024-09-17T05:21:31.445 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.443+0000 7f752a5bb640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75240b0cc0 0x7f75240c6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:31.445 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.443+0000 7f752a5bb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75240ce730 0x7f75240c74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:31.445 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.443+0000 7f752a5bb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f752415e2a0 0x7f75240c7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:31.445 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.443+0000 7f752a5bb640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f75240ae630 con 0x7f75240ce730 2024-09-17T05:21:31.445 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.443+0000 7f752a5bb640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f752415e890 con 0x7f752415e2a0 2024-09-17T05:21:31.445 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.443+0000 7f752a5bb640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f75240ae7b0 con 0x7f75240b0cc0 2024-09-17T05:21:31.445 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.443+0000 7f7523fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75240b0cc0 0x7f75240c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:31.445 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.443+0000 7f7528b58640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f752415e2a0 0x7f75240c7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:31.445 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.443+0000 7f7528b58640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f752415e2a0 0x7f75240c7a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:43436/0 (socket says 172.21.15.167:43436) 2024-09-17T05:21:31.445 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.443+0000 7f7528b58640 1 -- 172.21.15.167:0/1273474179 learned_addr learned my addr 172.21.15.167:0/1273474179 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-17T05:21:31.446 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.443+0000 7f7523fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75240b0cc0 0x7f75240c6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.167:50852/0 (socket says 172.21.15.167:50852) 2024-09-17T05:21:31.446 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.443+0000 7f75237fe640 1 --2- 172.21.15.167:0/1273474179 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75240ce730 0x7f75240c74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:31.446 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.443+0000 7f7528b58640 1 -- 172.21.15.167:0/1273474179 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75240b0cc0 msgr2=0x7f75240c6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:31.446 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.443+0000 7f7528b58640 1 --2- 172.21.15.167:0/1273474179 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75240b0cc0 0x7f75240c6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:31.446 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.443+0000 7f7528b58640 1 -- 172.21.15.167:0/1273474179 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75240ce730 msgr2=0x7f75240c74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:31.446 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.443+0000 7f7528b58640 1 --2- 172.21.15.167:0/1273474179 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75240ce730 0x7f75240c74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:31.446 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.443+0000 7f7528b58640 1 -- 172.21.15.167:0/1273474179 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f752409dd80 con 0x7f752415e2a0 2024-09-17T05:21:31.446 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.443+0000 7f7528b58640 1 --2- 172.21.15.167:0/1273474179 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f752415e2a0 0x7f75240c7a20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f751c00ea80 tx=0x7f751c00ef40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:31.446 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.443+0000 7f7520ff9640 1 -- 172.21.15.167:0/1273474179 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f751c00ce40 con 0x7f752415e2a0 2024-09-17T05:21:31.446 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.444+0000 7f7520ff9640 1 -- 172.21.15.167:0/1273474179 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f751c003970 con 0x7f752415e2a0 2024-09-17T05:21:31.446 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.444+0000 7f7520ff9640 1 -- 172.21.15.167:0/1273474179 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f751c003d80 con 0x7f752415e2a0 2024-09-17T05:21:31.446 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.444+0000 7f752a5bb640 1 -- 172.21.15.167:0/1273474179 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f752409e060 con 0x7f752415e2a0 2024-09-17T05:21:31.447 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.444+0000 7f752a5bb640 1 -- 172.21.15.167:0/1273474179 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75240c57d0 con 0x7f752415e2a0 2024-09-17T05:21:31.447 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.444+0000 7f7520ff9640 1 -- 172.21.15.167:0/1273474179 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f751c0050d0 con 0x7f752415e2a0 2024-09-17T05:21:31.447 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.444+0000 7f7520ff9640 1 -- 172.21.15.167:0/1273474179 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f751c01a3f0 con 0x7f752415e2a0 2024-09-17T05:21:31.447 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.445+0000 7f752a5bb640 1 -- 172.21.15.167:0/1273474179 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75240af830 con 0x7f752415e2a0 2024-09-17T05:21:31.447 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.447+0000 7f7520ff9640 1 -- 172.21.15.167:0/1273474179 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f75240af830 con 0x7f752415e2a0 2024-09-17T05:21:31.534 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.534+0000 7f752a5bb640 1 -- 172.21.15.167:0/1273474179 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd new", "uuid": "65ad711a-df74-438b-b0dc-1499d685c958", "id": 0} v 0) -- 0x7f75240ce1f0 con 0x7f752415e2a0 2024-09-17T05:21:31.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.537+0000 7f7520ff9640 1 -- 172.21.15.167:0/1273474179 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "65ad711a-df74-438b-b0dc-1499d685c958", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f751c016020 con 0x7f752415e2a0 2024-09-17T05:21:31.538 INFO:teuthology.orchestra.run.smithi167.stdout:0 2024-09-17T05:21:31.539 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.538+0000 7f752a5bb640 1 -- 172.21.15.167:0/1273474179 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f752415e2a0 msgr2=0x7f75240c7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:31.540 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.538+0000 7f752a5bb640 1 --2- 172.21.15.167:0/1273474179 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f752415e2a0 0x7f75240c7a20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f751c00ea80 tx=0x7f751c00ef40 comp rx=0 tx=0).stop 2024-09-17T05:21:31.540 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.538+0000 7f752a5bb640 1 -- 172.21.15.167:0/1273474179 shutdown_connections 2024-09-17T05:21:31.540 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.538+0000 7f752a5bb640 1 --2- 172.21.15.167:0/1273474179 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f752415e2a0 0x7f75240c7a20 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:31.540 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.538+0000 7f752a5bb640 1 --2- 172.21.15.167:0/1273474179 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75240ce730 0x7f75240c74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:31.540 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.538+0000 7f752a5bb640 1 --2- 172.21.15.167:0/1273474179 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75240b0cc0 0x7f75240c6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:31.540 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.538+0000 7f752a5bb640 1 -- 172.21.15.167:0/1273474179 >> 172.21.15.167:0/1273474179 conn(0x7f7524074240 msgr2=0x7f75240cb450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:31.540 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.538+0000 7f752a5bb640 1 -- 172.21.15.167:0/1273474179 shutdown_connections 2024-09-17T05:21:31.540 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.538+0000 7f752a5bb640 1 -- 172.21.15.167:0/1273474179 wait complete. 2024-09-17T05:21:31.549 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new f0ccb08d-4d8d-47b8-9320-8c372a6605b0 1 2024-09-17T05:21:31.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.651+0000 7f44397a1640 1 -- 172.21.15.167:0/3467920889 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f443415bd20 msgr2=0x7f44340cf770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:31.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.651+0000 7f44397a1640 1 --2- 172.21.15.167:0/3467920889 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f443415bd20 0x7f44340cf770 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4424005fd0 tx=0x7f442402a670 comp rx=0 tx=0).stop 2024-09-17T05:21:31.653 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.651+0000 7f44397a1640 1 -- 172.21.15.167:0/3467920889 shutdown_connections 2024-09-17T05:21:31.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.651+0000 7f44397a1640 1 --2- 172.21.15.167:0/3467920889 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f443415bd20 0x7f44340cf770 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:31.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.651+0000 7f44397a1640 1 -- 172.21.15.167:0/3467920889 >> 172.21.15.167:0/3467920889 conn(0x7f443409aa00 msgr2=0x7f443409ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:31.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.651+0000 7f44397a1640 1 -- 172.21.15.167:0/3467920889 shutdown_connections 2024-09-17T05:21:31.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.651+0000 7f44397a1640 1 -- 172.21.15.167:0/3467920889 wait complete. 2024-09-17T05:21:31.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.652+0000 7f44397a1640 1 Processor -- start 2024-09-17T05:21:31.654 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.653+0000 7f44397a1640 1 -- start start 2024-09-17T05:21:31.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.653+0000 7f44397a1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44340b0ce0 0x7f443415d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:31.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.653+0000 7f44397a1640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f44340d0890 0x7f443415ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:31.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.653+0000 7f44397a1640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f443415bd20 0x7f4434157d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:31.659 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.653+0000 7f44397a1640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f44340cd310 con 0x7f44340d0890 2024-09-17T05:21:31.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.653+0000 7f44397a1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f44340cd190 con 0x7f44340b0ce0 2024-09-17T05:21:31.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.653+0000 7f44397a1640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f44340cd490 con 0x7f443415bd20 2024-09-17T05:21:31.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.653+0000 7f4433fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44340b0ce0 0x7f443415d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:31.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.653+0000 7f4433fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44340b0ce0 0x7f443415d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:43448/0 (socket says 172.21.15.167:43448) 2024-09-17T05:21:31.660 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.653+0000 7f4433fff640 1 -- 172.21.15.167:0/2937913369 learned_addr learned my addr 172.21.15.167:0/2937913369 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-17T05:21:31.661 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.653+0000 7f4438fa0640 1 --2- 172.21.15.167:0/2937913369 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f443415bd20 0x7f4434157d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:31.661 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.653+0000 7f44337fe640 1 --2- 172.21.15.167:0/2937913369 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f44340d0890 0x7f443415ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:31.661 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.654+0000 7f4433fff640 1 -- 172.21.15.167:0/2937913369 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f443415bd20 msgr2=0x7f4434157d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:31.661 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.654+0000 7f4433fff640 1 --2- 172.21.15.167:0/2937913369 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f443415bd20 0x7f4434157d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:31.661 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.654+0000 7f4433fff640 1 -- 172.21.15.167:0/2937913369 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f44340d0890 msgr2=0x7f443415ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:31.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.654+0000 7f4433fff640 1 --2- 172.21.15.167:0/2937913369 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f44340d0890 0x7f443415ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:31.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.654+0000 7f4433fff640 1 -- 172.21.15.167:0/2937913369 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f443415dc70 con 0x7f44340b0ce0 2024-09-17T05:21:31.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.654+0000 7f4438fa0640 1 --2- 172.21.15.167:0/2937913369 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f443415bd20 0x7f4434157d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:21:31.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.654+0000 7f4433fff640 1 --2- 172.21.15.167:0/2937913369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44340b0ce0 0x7f443415d690 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4424034040 tx=0x7f44240039e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:31.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.654+0000 7f4430ff9640 1 -- 172.21.15.167:0/2937913369 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f442403e030 con 0x7f44340b0ce0 2024-09-17T05:21:31.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.654+0000 7f4430ff9640 1 -- 172.21.15.167:0/2937913369 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f44240047a0 con 0x7f44340b0ce0 2024-09-17T05:21:31.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.654+0000 7f44397a1640 1 -- 172.21.15.167:0/2937913369 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f443415df50 con 0x7f44340b0ce0 2024-09-17T05:21:31.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.654+0000 7f4430ff9640 1 -- 172.21.15.167:0/2937913369 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4424035040 con 0x7f44340b0ce0 2024-09-17T05:21:31.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.654+0000 7f44397a1640 1 -- 172.21.15.167:0/2937913369 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f443415e510 con 0x7f44340b0ce0 2024-09-17T05:21:31.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.654+0000 7f4430ff9640 1 -- 172.21.15.167:0/2937913369 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4424041030 con 0x7f44340b0ce0 2024-09-17T05:21:31.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.654+0000 7f4430ff9640 1 -- 172.21.15.167:0/2937913369 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f4424043cc0 con 0x7f44340b0ce0 2024-09-17T05:21:31.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.655+0000 7f44397a1640 1 -- 172.21.15.167:0/2937913369 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f443406aaf0 con 0x7f44340b0ce0 2024-09-17T05:21:31.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.659+0000 7f4430ff9640 1 -- 172.21.15.167:0/2937913369 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f443406aaf0 con 0x7f44340b0ce0 2024-09-17T05:21:31.729 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.729+0000 7f44397a1640 1 -- 172.21.15.167:0/2937913369 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f0ccb08d-4d8d-47b8-9320-8c372a6605b0", "id": 1} v 0) -- 0x7f44340d1bb0 con 0x7f44340b0ce0 2024-09-17T05:21:31.733 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.733+0000 7f4430ff9640 1 -- 172.21.15.167:0/2937913369 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f0ccb08d-4d8d-47b8-9320-8c372a6605b0", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f4424043410 con 0x7f44340b0ce0 2024-09-17T05:21:31.733 INFO:teuthology.orchestra.run.smithi167.stdout:1 2024-09-17T05:21:31.734 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.733+0000 7f44397a1640 1 -- 172.21.15.167:0/2937913369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44340b0ce0 msgr2=0x7f443415d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:31.734 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.733+0000 7f44397a1640 1 --2- 172.21.15.167:0/2937913369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44340b0ce0 0x7f443415d690 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4424034040 tx=0x7f44240039e0 comp rx=0 tx=0).stop 2024-09-17T05:21:31.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.734+0000 7f44397a1640 1 -- 172.21.15.167:0/2937913369 shutdown_connections 2024-09-17T05:21:31.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.734+0000 7f44397a1640 1 --2- 172.21.15.167:0/2937913369 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f443415bd20 0x7f4434157d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:31.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.734+0000 7f44397a1640 1 --2- 172.21.15.167:0/2937913369 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f44340d0890 0x7f443415ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:31.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.734+0000 7f44397a1640 1 --2- 172.21.15.167:0/2937913369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44340b0ce0 0x7f443415d690 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:31.735 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.734+0000 7f44397a1640 1 -- 172.21.15.167:0/2937913369 >> 172.21.15.167:0/2937913369 conn(0x7f443409aa00 msgr2=0x7f44340b6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:31.736 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.734+0000 7f44397a1640 1 -- 172.21.15.167:0/2937913369 shutdown_connections 2024-09-17T05:21:31.736 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.734+0000 7f44397a1640 1 -- 172.21.15.167:0/2937913369 wait complete. 2024-09-17T05:21:31.744 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new a0985398-5e5f-494f-8abf-f785f19e94ec 2 2024-09-17T05:21:31.846 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.845+0000 7f33b51c9640 1 -- 172.21.15.167:0/29047939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33b00ce020 msgr2=0x7f33b00aea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:31.846 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.845+0000 7f33b51c9640 1 --2- 172.21.15.167:0/29047939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33b00ce020 0x7f33b00aea80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f33b0160b70 tx=0x7f339802a560 comp rx=0 tx=0).stop 2024-09-17T05:21:31.846 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.846+0000 7f33b51c9640 1 -- 172.21.15.167:0/29047939 shutdown_connections 2024-09-17T05:21:31.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.846+0000 7f33b51c9640 1 --2- 172.21.15.167:0/29047939 >> v2:172.21.15.98:3300/0 conn(0x7f33b00cd800 0x7f33b00cfbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:31.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.846+0000 7f33b51c9640 1 --2- 172.21.15.167:0/29047939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33b00ce020 0x7f33b00aea80 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:31.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.846+0000 7f33b51c9640 1 -- 172.21.15.167:0/29047939 >> 172.21.15.167:0/29047939 conn(0x7f33b00d1dd0 msgr2=0x7f33b00d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:31.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.846+0000 7f33b51c9640 1 -- 172.21.15.167:0/29047939 shutdown_connections 2024-09-17T05:21:31.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.846+0000 7f33b51c9640 1 -- 172.21.15.167:0/29047939 wait complete. 2024-09-17T05:21:31.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.847+0000 7f33b51c9640 1 Processor -- start 2024-09-17T05:21:31.847 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.847+0000 7f33b51c9640 1 -- start start 2024-09-17T05:21:31.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.848+0000 7f33b51c9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33b00cd800 0x7f33b014e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:31.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.848+0000 7f33b51c9640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f33b00ce020 0x7f33b00b5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:31.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.848+0000 7f33b51c9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33b015f4d0 0x7f33b01f5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:31.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.848+0000 7f33b51c9640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f33b00d00f0 con 0x7f33b00cd800 2024-09-17T05:21:31.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.848+0000 7f33b51c9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f33b00cde20 con 0x7f33b015f4d0 2024-09-17T05:21:31.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.848+0000 7f33b51c9640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f33b00d0270 con 0x7f33b00ce020 2024-09-17T05:21:31.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.848+0000 7f33ae59c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f33b00ce020 0x7f33b00b5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:31.850 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.848+0000 7f33af59e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33b015f4d0 0x7f33b01f5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:31.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.848+0000 7f33aed9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33b00cd800 0x7f33b014e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:31.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.848+0000 7f33ae59c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f33b00ce020 0x7f33b00b5c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.167:50860/0 (socket says 172.21.15.167:50860) 2024-09-17T05:21:31.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.848+0000 7f33ae59c640 1 -- 172.21.15.167:0/36386510 learned_addr learned my addr 172.21.15.167:0/36386510 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-17T05:21:31.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.849+0000 7f33af59e640 1 -- 172.21.15.167:0/36386510 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f33b00ce020 msgr2=0x7f33b00b5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:31.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.849+0000 7f33af59e640 1 --2- 172.21.15.167:0/36386510 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f33b00ce020 0x7f33b00b5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:31.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.849+0000 7f33af59e640 1 -- 172.21.15.167:0/36386510 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33b00cd800 msgr2=0x7f33b014e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:31.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.849+0000 7f33af59e640 1 --2- 172.21.15.167:0/36386510 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33b00cd800 0x7f33b014e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:31.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.849+0000 7f33af59e640 1 -- 172.21.15.167:0/36386510 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33b00b6380 con 0x7f33b015f4d0 2024-09-17T05:21:31.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.849+0000 7f33ae59c640 1 --2- 172.21.15.167:0/36386510 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f33b00ce020 0x7f33b00b5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:21:31.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.849+0000 7f33aed9d640 1 --2- 172.21.15.167:0/36386510 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33b00cd800 0x7f33b014e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:21:31.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.849+0000 7f33af59e640 1 --2- 172.21.15.167:0/36386510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33b015f4d0 0x7f33b01f5d50 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f33a800e940 tx=0x7f33a800ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:31.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.849+0000 7f33a77fe640 1 -- 172.21.15.167:0/36386510 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a8004d20 con 0x7f33b015f4d0 2024-09-17T05:21:31.851 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.849+0000 7f33a77fe640 1 -- 172.21.15.167:0/36386510 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f33a800cb20 con 0x7f33b015f4d0 2024-09-17T05:21:31.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.849+0000 7f33b51c9640 1 -- 172.21.15.167:0/36386510 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33b00b6660 con 0x7f33b015f4d0 2024-09-17T05:21:31.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.849+0000 7f33a77fe640 1 -- 172.21.15.167:0/36386510 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a8005020 con 0x7f33b015f4d0 2024-09-17T05:21:31.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.849+0000 7f33b51c9640 1 -- 172.21.15.167:0/36386510 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33b00b6c20 con 0x7f33b015f4d0 2024-09-17T05:21:31.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.849+0000 7f33a77fe640 1 -- 172.21.15.167:0/36386510 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f33a80051c0 con 0x7f33b015f4d0 2024-09-17T05:21:31.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.849+0000 7f33a77fe640 1 -- 172.21.15.167:0/36386510 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f33a801a400 con 0x7f33b015f4d0 2024-09-17T05:21:31.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.850+0000 7f33b51c9640 1 -- 172.21.15.167:0/36386510 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33b00cfbb0 con 0x7f33b015f4d0 2024-09-17T05:21:31.852 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.852+0000 7f33a77fe640 1 -- 172.21.15.167:0/36386510 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f33a8016030 con 0x7f33b015f4d0 2024-09-17T05:21:31.923 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.923+0000 7f33b51c9640 1 -- 172.21.15.167:0/36386510 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a0985398-5e5f-494f-8abf-f785f19e94ec", "id": 2} v 0) -- 0x7f33b0073160 con 0x7f33b015f4d0 2024-09-17T05:21:31.927 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.926+0000 7f33a77fe640 1 -- 172.21.15.167:0/36386510 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a0985398-5e5f-494f-8abf-f785f19e94ec", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f33a80115a0 con 0x7f33b015f4d0 2024-09-17T05:21:31.927 INFO:teuthology.orchestra.run.smithi167.stdout:2 2024-09-17T05:21:31.928 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.927+0000 7f33b51c9640 1 -- 172.21.15.167:0/36386510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33b015f4d0 msgr2=0x7f33b01f5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:31.928 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.927+0000 7f33b51c9640 1 --2- 172.21.15.167:0/36386510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33b015f4d0 0x7f33b01f5d50 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f33a800e940 tx=0x7f33a800ee00 comp rx=0 tx=0).stop 2024-09-17T05:21:31.928 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.928+0000 7f33b51c9640 1 -- 172.21.15.167:0/36386510 shutdown_connections 2024-09-17T05:21:31.928 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.928+0000 7f33b51c9640 1 --2- 172.21.15.167:0/36386510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33b015f4d0 0x7f33b01f5d50 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:31.928 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.928+0000 7f33b51c9640 1 --2- 172.21.15.167:0/36386510 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f33b00ce020 0x7f33b00b5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:31.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.928+0000 7f33b51c9640 1 --2- 172.21.15.167:0/36386510 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33b00cd800 0x7f33b014e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:31.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.928+0000 7f33b51c9640 1 -- 172.21.15.167:0/36386510 >> 172.21.15.167:0/36386510 conn(0x7f33b00d1dd0 msgr2=0x7f33b00af070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:31.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.928+0000 7f33b51c9640 1 -- 172.21.15.167:0/36386510 shutdown_connections 2024-09-17T05:21:31.929 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:31.928+0000 7f33b51c9640 1 -- 172.21.15.167:0/36386510 wait complete. 2024-09-17T05:21:31.938 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new e960be2e-0c3a-426e-9507-d3be5895f9e5 3 2024-09-17T05:21:32.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.039+0000 7fb821616640 1 -- 172.21.15.167:0/3099787394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb81c15aa60 msgr2=0x7fb81c15f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:32.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.039+0000 7fb821616640 1 --2- 172.21.15.167:0/3099787394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb81c15aa60 0x7fb81c15f350 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb81c073070 tx=0x7fb80c02a560 comp rx=0 tx=0).stop 2024-09-17T05:21:32.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.039+0000 7fb821616640 1 -- 172.21.15.167:0/3099787394 shutdown_connections 2024-09-17T05:21:32.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.039+0000 7fb821616640 1 --2- 172.21.15.167:0/3099787394 >> v2:172.21.15.98:3300/0 conn(0x7fb81c0b2e60 0x7fb81c0ce8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:32.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.039+0000 7fb821616640 1 --2- 172.21.15.167:0/3099787394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb81c15aa60 0x7fb81c15f350 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:32.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.039+0000 7fb821616640 1 -- 172.21.15.167:0/3099787394 >> 172.21.15.167:0/3099787394 conn(0x7fb81c0cd750 msgr2=0x7fb81c0cdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:32.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.040+0000 7fb821616640 1 -- 172.21.15.167:0/3099787394 shutdown_connections 2024-09-17T05:21:32.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.040+0000 7fb821616640 1 -- 172.21.15.167:0/3099787394 wait complete. 2024-09-17T05:21:32.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.041+0000 7fb821616640 1 Processor -- start 2024-09-17T05:21:32.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.041+0000 7fb821616640 1 -- start start 2024-09-17T05:21:32.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.043+0000 7fb821616640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb81c0b2e60 0x7fb81c1f59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:32.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.043+0000 7fb821616640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb81c15aa60 0x7fb81c0c4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:32.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.043+0000 7fb821616640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb81c15ae40 0x7fb81c0b5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:32.045 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.043+0000 7fb821616640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb81c0cf500 con 0x7fb81c0b2e60 2024-09-17T05:21:32.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.043+0000 7fb821616640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb81c0cf380 con 0x7fb81c15aa60 2024-09-17T05:21:32.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.043+0000 7fb821616640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fb81c0cf680 con 0x7fb81c15ae40 2024-09-17T05:21:32.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.043+0000 7fb813fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb81c15aa60 0x7fb81c0c4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:32.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.043+0000 7fb813fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb81c15aa60 0x7fb81c0c4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:43490/0 (socket says 172.21.15.167:43490) 2024-09-17T05:21:32.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.043+0000 7fb813fff640 1 -- 172.21.15.167:0/2142976 learned_addr learned my addr 172.21.15.167:0/2142976 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-17T05:21:32.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.043+0000 7fb81b7fe640 1 --2- 172.21.15.167:0/2142976 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb81c15ae40 0x7fb81c0b5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:32.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.043+0000 7fb81affd640 1 --2- 172.21.15.167:0/2142976 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb81c0b2e60 0x7fb81c1f59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:32.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.043+0000 7fb813fff640 1 -- 172.21.15.167:0/2142976 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb81c15ae40 msgr2=0x7fb81c0b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:32.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.043+0000 7fb813fff640 1 --2- 172.21.15.167:0/2142976 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb81c15ae40 0x7fb81c0b5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:32.046 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.043+0000 7fb813fff640 1 -- 172.21.15.167:0/2142976 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb81c0b2e60 msgr2=0x7fb81c1f59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:32.047 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.043+0000 7fb813fff640 1 --2- 172.21.15.167:0/2142976 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb81c0b2e60 0x7fb81c1f59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:32.047 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.043+0000 7fb813fff640 1 -- 172.21.15.167:0/2142976 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb81c0c77e0 con 0x7fb81c15aa60 2024-09-17T05:21:32.047 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.043+0000 7fb813fff640 1 --2- 172.21.15.167:0/2142976 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb81c15aa60 0x7fb81c0c4800 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb80400c3d0 tx=0x7fb80400c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:32.047 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.043+0000 7fb8137fe640 1 -- 172.21.15.167:0/2142976 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb804017070 con 0x7fb81c15aa60 2024-09-17T05:21:32.047 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.043+0000 7fb8137fe640 1 -- 172.21.15.167:0/2142976 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb8040053c0 con 0x7fb81c15aa60 2024-09-17T05:21:32.047 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.043+0000 7fb8137fe640 1 -- 172.21.15.167:0/2142976 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb804003850 con 0x7fb81c15aa60 2024-09-17T05:21:32.047 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.043+0000 7fb821616640 1 -- 172.21.15.167:0/2142976 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb81c0c91e0 con 0x7fb81c15aa60 2024-09-17T05:21:32.047 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.044+0000 7fb821616640 1 -- 172.21.15.167:0/2142976 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb81c0c97a0 con 0x7fb81c15aa60 2024-09-17T05:21:32.047 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.044+0000 7fb8137fe640 1 -- 172.21.15.167:0/2142976 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb80401a070 con 0x7fb81c15aa60 2024-09-17T05:21:32.047 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.044+0000 7fb8137fe640 1 -- 172.21.15.167:0/2142976 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fb804011c20 con 0x7fb81c15aa60 2024-09-17T05:21:32.047 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.044+0000 7fb821616640 1 -- 172.21.15.167:0/2142976 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb81c0ce8a0 con 0x7fb81c15aa60 2024-09-17T05:21:32.048 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.046+0000 7fb8137fe640 1 -- 172.21.15.167:0/2142976 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fb804021070 con 0x7fb81c15aa60 2024-09-17T05:21:32.117 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.117+0000 7fb821616640 1 -- 172.21.15.167:0/2142976 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e960be2e-0c3a-426e-9507-d3be5895f9e5", "id": 3} v 0) -- 0x7fb81c15f130 con 0x7fb81c15aa60 2024-09-17T05:21:32.120 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.120+0000 7fb8137fe640 1 -- 172.21.15.167:0/2142976 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e960be2e-0c3a-426e-9507-d3be5895f9e5", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7fb81c0c77e0 con 0x7fb81c15aa60 2024-09-17T05:21:32.121 INFO:teuthology.orchestra.run.smithi167.stdout:3 2024-09-17T05:21:32.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.121+0000 7fb821616640 1 -- 172.21.15.167:0/2142976 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb81c15aa60 msgr2=0x7fb81c0c4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:32.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.121+0000 7fb821616640 1 --2- 172.21.15.167:0/2142976 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb81c15aa60 0x7fb81c0c4800 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb80400c3d0 tx=0x7fb80400c890 comp rx=0 tx=0).stop 2024-09-17T05:21:32.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.121+0000 7fb821616640 1 -- 172.21.15.167:0/2142976 shutdown_connections 2024-09-17T05:21:32.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.121+0000 7fb821616640 1 --2- 172.21.15.167:0/2142976 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb81c15ae40 0x7fb81c0b5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:32.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.121+0000 7fb821616640 1 --2- 172.21.15.167:0/2142976 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb81c15aa60 0x7fb81c0c4800 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:32.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.121+0000 7fb821616640 1 --2- 172.21.15.167:0/2142976 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb81c0b2e60 0x7fb81c1f59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:32.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.121+0000 7fb821616640 1 -- 172.21.15.167:0/2142976 >> 172.21.15.167:0/2142976 conn(0x7fb81c0cd750 msgr2=0x7fb81c159870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:32.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.121+0000 7fb821616640 1 -- 172.21.15.167:0/2142976 shutdown_connections 2024-09-17T05:21:32.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.121+0000 7fb821616640 1 -- 172.21.15.167:0/2142976 wait complete. 2024-09-17T05:21:32.132 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new 49118c00-3dc1-43ef-8ed4-aca61e56a507 4 2024-09-17T05:21:32.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.233+0000 7f03aaf52640 1 -- 172.21.15.167:0/601884101 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03a40cf940 msgr2=0x7f03a40b4c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:32.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.233+0000 7f03aaf52640 1 --2- 172.21.15.167:0/601884101 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03a40cf940 0x7f03a40b4c50 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f03a40b7e90 tx=0x7f039002a560 comp rx=0 tx=0).stop 2024-09-17T05:21:32.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.233+0000 7f03aaf52640 1 -- 172.21.15.167:0/601884101 shutdown_connections 2024-09-17T05:21:32.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.233+0000 7f03aaf52640 1 --2- 172.21.15.167:0/601884101 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03a40cf940 0x7f03a40b4c50 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:32.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.233+0000 7f03aaf52640 1 --2- 172.21.15.167:0/601884101 >> v2:172.21.15.98:3300/0 conn(0x7f03a415f3e0 0x7f03a40d2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:32.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.233+0000 7f03aaf52640 1 -- 172.21.15.167:0/601884101 >> 172.21.15.167:0/601884101 conn(0x7f03a40d1e00 msgr2=0x7f03a40d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:32.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.234+0000 7f03aaf52640 1 -- 172.21.15.167:0/601884101 shutdown_connections 2024-09-17T05:21:32.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.234+0000 7f03aaf52640 1 -- 172.21.15.167:0/601884101 wait complete. 2024-09-17T05:21:32.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.235+0000 7f03aaf52640 1 Processor -- start 2024-09-17T05:21:32.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.235+0000 7f03aaf52640 1 -- start start 2024-09-17T05:21:32.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.236+0000 7f03aaf52640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03a40cf940 0x7f03a4154fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:32.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.236+0000 7f03aaf52640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03a40d0350 0x7f03a40c4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:32.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.236+0000 7f03aaf52640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03a415f3e0 0x7f03a41f56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:32.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.236+0000 7f03aaf52640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f03a40b0a40 con 0x7f03a40cf940 2024-09-17T05:21:32.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.236+0000 7f03aaf52640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f03a40b08c0 con 0x7f03a40d0350 2024-09-17T05:21:32.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.236+0000 7f03aaf52640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f03a40d07c0 con 0x7f03a415f3e0 2024-09-17T05:21:32.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.236+0000 7f03a3fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03a40d0350 0x7f03a40c4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:32.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.236+0000 7f03a94ef640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03a415f3e0 0x7f03a41f56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:32.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.236+0000 7f03a3fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03a40d0350 0x7f03a40c4ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:43510/0 (socket says 172.21.15.167:43510) 2024-09-17T05:21:32.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.236+0000 7f03a3fff640 1 -- 172.21.15.167:0/1871827126 learned_addr learned my addr 172.21.15.167:0/1871827126 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-17T05:21:32.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.236+0000 7f03a8cee640 1 --2- 172.21.15.167:0/1871827126 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03a40cf940 0x7f03a4154fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:32.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.236+0000 7f03a3fff640 1 -- 172.21.15.167:0/1871827126 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03a415f3e0 msgr2=0x7f03a41f56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:32.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.236+0000 7f03a3fff640 1 --2- 172.21.15.167:0/1871827126 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03a415f3e0 0x7f03a41f56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:32.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.236+0000 7f03a3fff640 1 -- 172.21.15.167:0/1871827126 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03a40cf940 msgr2=0x7f03a4154fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:32.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.236+0000 7f03a3fff640 1 --2- 172.21.15.167:0/1871827126 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03a40cf940 0x7f03a4154fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:32.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.236+0000 7f03a3fff640 1 -- 172.21.15.167:0/1871827126 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03a41f8bf0 con 0x7f03a40d0350 2024-09-17T05:21:32.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.236+0000 7f03a94ef640 1 --2- 172.21.15.167:0/1871827126 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03a415f3e0 0x7f03a41f56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:21:32.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.236+0000 7f03a3fff640 1 --2- 172.21.15.167:0/1871827126 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03a40d0350 0x7f03a40c4ae0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0390000c00 tx=0x7f0390003910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:32.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.236+0000 7f03a17fa640 1 -- 172.21.15.167:0/1871827126 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f039003f070 con 0x7f03a40d0350 2024-09-17T05:21:32.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.237+0000 7f03a17fa640 1 -- 172.21.15.167:0/1871827126 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f03900047a0 con 0x7f03a40d0350 2024-09-17T05:21:32.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.237+0000 7f03a17fa640 1 -- 172.21.15.167:0/1871827126 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0390035030 con 0x7f03a40d0350 2024-09-17T05:21:32.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.237+0000 7f03aaf52640 1 -- 172.21.15.167:0/1871827126 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03a41f8ed0 con 0x7f03a40d0350 2024-09-17T05:21:32.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.237+0000 7f03aaf52640 1 -- 172.21.15.167:0/1871827126 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03a41f9490 con 0x7f03a40d0350 2024-09-17T05:21:32.239 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.237+0000 7f03a17fa640 1 -- 172.21.15.167:0/1871827126 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0390042070 con 0x7f03a40d0350 2024-09-17T05:21:32.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.237+0000 7f03a17fa640 1 -- 172.21.15.167:0/1871827126 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f039003bba0 con 0x7f03a40d0350 2024-09-17T05:21:32.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.237+0000 7f03aaf52640 1 -- 172.21.15.167:0/1871827126 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03a40b7a90 con 0x7f03a40d0350 2024-09-17T05:21:32.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.239+0000 7f03a17fa640 1 -- 172.21.15.167:0/1871827126 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f03a40b7a90 con 0x7f03a40d0350 2024-09-17T05:21:32.310 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.310+0000 7f03aaf52640 1 -- 172.21.15.167:0/1871827126 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd new", "uuid": "49118c00-3dc1-43ef-8ed4-aca61e56a507", "id": 4} v 0) -- 0x7f03a40b4f60 con 0x7f03a40d0350 2024-09-17T05:21:32.314 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.314+0000 7f03a17fa640 1 -- 172.21.15.167:0/1871827126 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "49118c00-3dc1-43ef-8ed4-aca61e56a507", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f03a40b4f60 con 0x7f03a40d0350 2024-09-17T05:21:32.314 INFO:teuthology.orchestra.run.smithi167.stdout:4 2024-09-17T05:21:32.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.315+0000 7f03aaf52640 1 -- 172.21.15.167:0/1871827126 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03a40d0350 msgr2=0x7f03a40c4ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:32.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.315+0000 7f03aaf52640 1 --2- 172.21.15.167:0/1871827126 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03a40d0350 0x7f03a40c4ae0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0390000c00 tx=0x7f0390003910 comp rx=0 tx=0).stop 2024-09-17T05:21:32.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.315+0000 7f03aaf52640 1 -- 172.21.15.167:0/1871827126 shutdown_connections 2024-09-17T05:21:32.316 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.315+0000 7f03aaf52640 1 --2- 172.21.15.167:0/1871827126 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03a415f3e0 0x7f03a41f56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:32.316 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.315+0000 7f03aaf52640 1 --2- 172.21.15.167:0/1871827126 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03a40d0350 0x7f03a40c4ae0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:32.316 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.315+0000 7f03aaf52640 1 --2- 172.21.15.167:0/1871827126 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03a40cf940 0x7f03a4154fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:32.316 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.315+0000 7f03aaf52640 1 -- 172.21.15.167:0/1871827126 >> 172.21.15.167:0/1871827126 conn(0x7f03a40d1e00 msgr2=0x7f03a40b5b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:32.316 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.315+0000 7f03aaf52640 1 -- 172.21.15.167:0/1871827126 shutdown_connections 2024-09-17T05:21:32.316 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.315+0000 7f03aaf52640 1 -- 172.21.15.167:0/1871827126 wait complete. 2024-09-17T05:21:32.325 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new 9f4e0143-2b3d-40e4-bfb5-043d9a9f4ba9 5 2024-09-17T05:21:32.429 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.428+0000 7f8218060640 1 -- 172.21.15.167:0/1605120457 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f82100d4bd0 msgr2=0x7f82100d1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:32.429 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.428+0000 7f8218060640 1 --2- 172.21.15.167:0/1605120457 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f82100d4bd0 0x7f82100d1e20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f820c005fd0 tx=0x7f820c02a5d0 comp rx=0 tx=0).stop 2024-09-17T05:21:32.429 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.428+0000 7f8218060640 1 -- 172.21.15.167:0/1605120457 shutdown_connections 2024-09-17T05:21:32.429 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.428+0000 7f8218060640 1 --2- 172.21.15.167:0/1605120457 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f82100d4bd0 0x7f82100d1e20 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:32.429 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.428+0000 7f8218060640 1 --2- 172.21.15.167:0/1605120457 >> v2:172.21.15.98:3300/0 conn(0x7f82100d0cc0 0x7f82100d10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:32.429 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.428+0000 7f8218060640 1 -- 172.21.15.167:0/1605120457 >> 172.21.15.167:0/1605120457 conn(0x7f82100d4040 msgr2=0x7f82100d4450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:32.429 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.428+0000 7f8218060640 1 -- 172.21.15.167:0/1605120457 shutdown_connections 2024-09-17T05:21:32.429 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.428+0000 7f8218060640 1 -- 172.21.15.167:0/1605120457 wait complete. 2024-09-17T05:21:32.432 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.429+0000 7f8218060640 1 Processor -- start 2024-09-17T05:21:32.432 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.429+0000 7f8218060640 1 -- start start 2024-09-17T05:21:32.432 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.430+0000 7f8218060640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82100b4e90 0x7f8210153460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:32.432 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.430+0000 7f8218060640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f82100d0cc0 0x7f8210161210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:32.432 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.430+0000 7f8218060640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82100d4bd0 0x7f8210161750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:32.432 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.430+0000 7f8218060640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f82100d2bf0 con 0x7f82100b4e90 2024-09-17T05:21:32.432 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.430+0000 7f8218060640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f82100d2a70 con 0x7f82100d4bd0 2024-09-17T05:21:32.432 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.430+0000 7f8218060640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f82100cea30 con 0x7f82100d0cc0 2024-09-17T05:21:32.432 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.430+0000 7f82155fb640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f82100d0cc0 0x7f8210161210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:32.432 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.430+0000 7f82155fb640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f82100d0cc0 0x7f8210161210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.167:50900/0 (socket says 172.21.15.167:50900) 2024-09-17T05:21:32.433 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.430+0000 7f82155fb640 1 -- 172.21.15.167:0/2733480563 learned_addr learned my addr 172.21.15.167:0/2733480563 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-17T05:21:32.433 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.430+0000 7f8215dfc640 1 --2- 172.21.15.167:0/2733480563 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82100b4e90 0x7f8210153460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:32.433 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.430+0000 7f82165fd640 1 --2- 172.21.15.167:0/2733480563 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82100d4bd0 0x7f8210161750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:32.433 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.430+0000 7f8215dfc640 1 -- 172.21.15.167:0/2733480563 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f82100d0cc0 msgr2=0x7f8210161210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:32.433 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.430+0000 7f8215dfc640 1 --2- 172.21.15.167:0/2733480563 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f82100d0cc0 0x7f8210161210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:32.433 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.430+0000 7f8215dfc640 1 -- 172.21.15.167:0/2733480563 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82100d4bd0 msgr2=0x7f8210161750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:32.433 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.430+0000 7f8215dfc640 1 --2- 172.21.15.167:0/2733480563 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82100d4bd0 0x7f8210161750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:32.434 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.430+0000 7f8215dfc640 1 -- 172.21.15.167:0/2733480563 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82100ca380 con 0x7f82100b4e90 2024-09-17T05:21:32.434 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.430+0000 7f82155fb640 1 --2- 172.21.15.167:0/2733480563 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f82100d0cc0 0x7f8210161210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:21:32.434 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.431+0000 7f8215dfc640 1 --2- 172.21.15.167:0/2733480563 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82100b4e90 0x7f8210153460 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f820400e9f0 tx=0x7f820400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:32.434 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.431+0000 7f82027fc640 1 -- 172.21.15.167:0/2733480563 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f820400ccc0 con 0x7f82100b4e90 2024-09-17T05:21:32.434 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.431+0000 7f82027fc640 1 -- 172.21.15.167:0/2733480563 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8204010430 con 0x7f82100b4e90 2024-09-17T05:21:32.434 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.431+0000 7f8218060640 1 -- 172.21.15.167:0/2733480563 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82100ca660 con 0x7f82100b4e90 2024-09-17T05:21:32.434 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.431+0000 7f82027fc640 1 -- 172.21.15.167:0/2733480563 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8204010860 con 0x7f82100b4e90 2024-09-17T05:21:32.434 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.431+0000 7f8218060640 1 -- 172.21.15.167:0/2733480563 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82100cac20 con 0x7f82100b4e90 2024-09-17T05:21:32.434 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.431+0000 7f82027fc640 1 -- 172.21.15.167:0/2733480563 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8204010a00 con 0x7f82100b4e90 2024-09-17T05:21:32.435 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.431+0000 7f82027fc640 1 -- 172.21.15.167:0/2733480563 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f8204018ce0 con 0x7f82100b4e90 2024-09-17T05:21:32.435 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.432+0000 7f8218060640 1 -- 172.21.15.167:0/2733480563 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82100d10a0 con 0x7f82100b4e90 2024-09-17T05:21:32.435 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.434+0000 7f82027fc640 1 -- 172.21.15.167:0/2733480563 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f8204018420 con 0x7f82100b4e90 2024-09-17T05:21:32.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.505+0000 7f8218060640 1 -- 172.21.15.167:0/2733480563 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9f4e0143-2b3d-40e4-bfb5-043d9a9f4ba9", "id": 5} v 0) -- 0x7f82101539a0 con 0x7f82100b4e90 2024-09-17T05:21:32.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.507+0000 7f82027fc640 1 -- 172.21.15.167:0/2733480563 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9f4e0143-2b3d-40e4-bfb5-043d9a9f4ba9", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f8204018600 con 0x7f82100b4e90 2024-09-17T05:21:32.507 INFO:teuthology.orchestra.run.smithi167.stdout:5 2024-09-17T05:21:32.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.508+0000 7f8218060640 1 -- 172.21.15.167:0/2733480563 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82100b4e90 msgr2=0x7f8210153460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:32.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.508+0000 7f8218060640 1 --2- 172.21.15.167:0/2733480563 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82100b4e90 0x7f8210153460 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f820400e9f0 tx=0x7f820400eeb0 comp rx=0 tx=0).stop 2024-09-17T05:21:32.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.508+0000 7f8218060640 1 -- 172.21.15.167:0/2733480563 shutdown_connections 2024-09-17T05:21:32.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.508+0000 7f8218060640 1 --2- 172.21.15.167:0/2733480563 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82100d4bd0 0x7f8210161750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:32.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.508+0000 7f8218060640 1 --2- 172.21.15.167:0/2733480563 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f82100d0cc0 0x7f8210161210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:32.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.508+0000 7f8218060640 1 --2- 172.21.15.167:0/2733480563 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82100b4e90 0x7f8210153460 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:32.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.508+0000 7f8218060640 1 -- 172.21.15.167:0/2733480563 >> 172.21.15.167:0/2733480563 conn(0x7f82100d4040 msgr2=0x7f82100b8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:32.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.508+0000 7f8218060640 1 -- 172.21.15.167:0/2733480563 shutdown_connections 2024-09-17T05:21:32.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.508+0000 7f8218060640 1 -- 172.21.15.167:0/2733480563 wait complete. 2024-09-17T05:21:32.519 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new 28720514-e627-4dea-8f4d-bd311ec31361 6 2024-09-17T05:21:32.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.621+0000 7fa87eae2640 1 -- 172.21.15.167:0/86974636 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8780d09a0 msgr2=0x7fa8780af1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:32.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.621+0000 7fa87eae2640 1 --2- 172.21.15.167:0/86974636 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8780d09a0 0x7fa8780af1d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa870005fd0 tx=0x7fa87002a940 comp rx=0 tx=0).stop 2024-09-17T05:21:32.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.621+0000 7fa87eae2640 1 -- 172.21.15.167:0/86974636 shutdown_connections 2024-09-17T05:21:32.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.621+0000 7fa87eae2640 1 --2- 172.21.15.167:0/86974636 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8780d09a0 0x7fa8780af1d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:32.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.621+0000 7fa87eae2640 1 -- 172.21.15.167:0/86974636 >> 172.21.15.167:0/86974636 conn(0x7fa87809b080 msgr2=0x7fa8780d1e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:32.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.621+0000 7fa87eae2640 1 -- 172.21.15.167:0/86974636 shutdown_connections 2024-09-17T05:21:32.622 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.621+0000 7fa87eae2640 1 -- 172.21.15.167:0/86974636 wait complete. 2024-09-17T05:21:32.623 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.622+0000 7fa87eae2640 1 Processor -- start 2024-09-17T05:21:32.623 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.622+0000 7fa87eae2640 1 -- start start 2024-09-17T05:21:32.625 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.623+0000 7fa87eae2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8780d09a0 0x7fa8780cb200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:32.625 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.623+0000 7fa87eae2640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8781605e0 0x7fa8780aecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:32.625 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.623+0000 7fa87eae2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8781609c0 0x7fa878156e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:32.626 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.623+0000 7fa87eae2640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa8780cfec0 con 0x7fa8780d09a0 2024-09-17T05:21:32.626 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.623+0000 7fa87eae2640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa8780cfd40 con 0x7fa8781609c0 2024-09-17T05:21:32.626 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.623+0000 7fa87eae2640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fa8780d0040 con 0x7fa8781605e0 2024-09-17T05:21:32.626 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.623+0000 7fa87d07f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8781609c0 0x7fa878156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:32.626 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.623+0000 7fa877fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8781605e0 0x7fa8780aecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:32.626 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.623+0000 7fa87d07f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8781609c0 0x7fa878156e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:43526/0 (socket says 172.21.15.167:43526) 2024-09-17T05:21:32.626 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.623+0000 7fa87d07f640 1 -- 172.21.15.167:0/2177294507 learned_addr learned my addr 172.21.15.167:0/2177294507 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-17T05:21:32.626 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.623+0000 7fa87c87e640 1 --2- 172.21.15.167:0/2177294507 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8780d09a0 0x7fa8780cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:32.626 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.624+0000 7fa877fff640 1 -- 172.21.15.167:0/2177294507 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8781609c0 msgr2=0x7fa878156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:32.626 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.624+0000 7fa877fff640 1 --2- 172.21.15.167:0/2177294507 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8781609c0 0x7fa878156e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:32.626 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.624+0000 7fa877fff640 1 -- 172.21.15.167:0/2177294507 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8780d09a0 msgr2=0x7fa8780cb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:32.627 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.624+0000 7fa877fff640 1 --2- 172.21.15.167:0/2177294507 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8780d09a0 0x7fa8780cb200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:32.627 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.624+0000 7fa877fff640 1 -- 172.21.15.167:0/2177294507 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8780cbb10 con 0x7fa8781605e0 2024-09-17T05:21:32.627 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.624+0000 7fa87d07f640 1 --2- 172.21.15.167:0/2177294507 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8781609c0 0x7fa878156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:21:32.627 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.624+0000 7fa87c87e640 1 --2- 172.21.15.167:0/2177294507 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8780d09a0 0x7fa8780cb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:21:32.627 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.624+0000 7fa877fff640 1 --2- 172.21.15.167:0/2177294507 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8781605e0 0x7fa8780aecc0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa864001eb0 tx=0x7fa86400c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:32.627 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.624+0000 7fa8757fa640 1 -- 172.21.15.167:0/2177294507 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa864011790 con 0x7fa8781605e0 2024-09-17T05:21:32.627 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.624+0000 7fa8757fa640 1 -- 172.21.15.167:0/2177294507 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa864017070 con 0x7fa8781605e0 2024-09-17T05:21:32.627 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.624+0000 7fa87eae2640 1 -- 172.21.15.167:0/2177294507 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8781f4bb0 con 0x7fa8781605e0 2024-09-17T05:21:32.627 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.624+0000 7fa8757fa640 1 -- 172.21.15.167:0/2177294507 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa864011ce0 con 0x7fa8781605e0 2024-09-17T05:21:32.627 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.624+0000 7fa87eae2640 1 -- 172.21.15.167:0/2177294507 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8780cb740 con 0x7fa8781605e0 2024-09-17T05:21:32.627 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.624+0000 7fa8757fa640 1 -- 172.21.15.167:0/2177294507 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa86401c460 con 0x7fa8781605e0 2024-09-17T05:21:32.627 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.624+0000 7fa8757fa640 1 -- 172.21.15.167:0/2177294507 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fa86401b3c0 con 0x7fa8781605e0 2024-09-17T05:21:32.627 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.625+0000 7fa87eae2640 1 -- 172.21.15.167:0/2177294507 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa878069b10 con 0x7fa8781605e0 2024-09-17T05:21:32.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.628+0000 7fa8757fa640 1 -- 172.21.15.167:0/2177294507 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fa864012420 con 0x7fa8781605e0 2024-09-17T05:21:32.700 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.699+0000 7fa87eae2640 1 -- 172.21.15.167:0/2177294507 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd new", "uuid": "28720514-e627-4dea-8f4d-bd311ec31361", "id": 6} v 0) -- 0x7fa8780afa90 con 0x7fa8781605e0 2024-09-17T05:21:32.704 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.703+0000 7fa8757fa640 1 -- 172.21.15.167:0/2177294507 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "28720514-e627-4dea-8f4d-bd311ec31361", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fa86401c930 con 0x7fa8781605e0 2024-09-17T05:21:32.704 INFO:teuthology.orchestra.run.smithi167.stdout:6 2024-09-17T05:21:32.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.704+0000 7fa87eae2640 1 -- 172.21.15.167:0/2177294507 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8781605e0 msgr2=0x7fa8780aecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:32.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.704+0000 7fa87eae2640 1 --2- 172.21.15.167:0/2177294507 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8781605e0 0x7fa8780aecc0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa864001eb0 tx=0x7fa86400c820 comp rx=0 tx=0).stop 2024-09-17T05:21:32.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.704+0000 7fa87eae2640 1 -- 172.21.15.167:0/2177294507 shutdown_connections 2024-09-17T05:21:32.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.704+0000 7fa87eae2640 1 --2- 172.21.15.167:0/2177294507 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8781609c0 0x7fa878156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:32.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.704+0000 7fa87eae2640 1 --2- 172.21.15.167:0/2177294507 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8781605e0 0x7fa8780aecc0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:32.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.704+0000 7fa87eae2640 1 --2- 172.21.15.167:0/2177294507 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8780d09a0 0x7fa8780cb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:32.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.704+0000 7fa87eae2640 1 -- 172.21.15.167:0/2177294507 >> 172.21.15.167:0/2177294507 conn(0x7fa87809b080 msgr2=0x7fa87806e2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:32.707 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.704+0000 7fa87eae2640 1 -- 172.21.15.167:0/2177294507 shutdown_connections 2024-09-17T05:21:32.707 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.704+0000 7fa87eae2640 1 -- 172.21.15.167:0/2177294507 wait complete. 2024-09-17T05:21:32.715 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new 01edaf9c-3898-406e-85b0-774cfda60adf 7 2024-09-17T05:21:32.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.815+0000 7f38fc6bd640 1 -- 172.21.15.167:0/2488144353 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38f40cf430 msgr2=0x7f38f40cf8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:32.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.815+0000 7f38fc6bd640 1 --2- 172.21.15.167:0/2488144353 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38f40cf430 0x7f38f40cf8c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f38ec005fd0 tx=0x7f38ec02ab20 comp rx=0 tx=0).stop 2024-09-17T05:21:32.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.815+0000 7f38fc6bd640 1 -- 172.21.15.167:0/2488144353 shutdown_connections 2024-09-17T05:21:32.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.815+0000 7f38fc6bd640 1 --2- 172.21.15.167:0/2488144353 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38f40cf430 0x7f38f40cf8c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:32.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.815+0000 7f38fc6bd640 1 --2- 172.21.15.167:0/2488144353 >> v2:172.21.15.98:3300/0 conn(0x7f38f415ad50 0x7f38f415e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:32.816 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.815+0000 7f38fc6bd640 1 -- 172.21.15.167:0/2488144353 >> 172.21.15.167:0/2488144353 conn(0x7f38f40cd6f0 msgr2=0x7f38f40cdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:32.817 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.815+0000 7f38fc6bd640 1 -- 172.21.15.167:0/2488144353 shutdown_connections 2024-09-17T05:21:32.817 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.815+0000 7f38fc6bd640 1 -- 172.21.15.167:0/2488144353 wait complete. 2024-09-17T05:21:32.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.816+0000 7f38fc6bd640 1 Processor -- start 2024-09-17T05:21:32.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.816+0000 7f38fc6bd640 1 -- start start 2024-09-17T05:21:32.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.817+0000 7f38fc6bd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38f40cbc40 0x7f38f40b6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:32.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.817+0000 7f38fc6bd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f38f40cf430 0x7f38f41f4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:32.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.817+0000 7f38fc6bd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38f415ad50 0x7f38f406cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:32.819 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.817+0000 7f38fc6bd640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f38f415b2c0 con 0x7f38f40cf430 2024-09-17T05:21:32.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.817+0000 7f38fc6bd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f38f415f800 con 0x7f38f415ad50 2024-09-17T05:21:32.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.817+0000 7f38fc6bd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f38f40cfe00 con 0x7f38f40cbc40 2024-09-17T05:21:32.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.817+0000 7f38fa459640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38f40cbc40 0x7f38f40b6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:32.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.817+0000 7f38fa459640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38f40cbc40 0x7f38f40b6370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.167:50936/0 (socket says 172.21.15.167:50936) 2024-09-17T05:21:32.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.817+0000 7f38fac5a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38f415ad50 0x7f38f406cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:32.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.817+0000 7f38fa459640 1 -- 172.21.15.167:0/391352391 learned_addr learned my addr 172.21.15.167:0/391352391 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-17T05:21:32.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.817+0000 7f38f9c58640 1 --2- 172.21.15.167:0/391352391 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f38f40cf430 0x7f38f41f4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:32.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.818+0000 7f38fac5a640 1 -- 172.21.15.167:0/391352391 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38f40cbc40 msgr2=0x7f38f40b6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:32.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.818+0000 7f38fac5a640 1 --2- 172.21.15.167:0/391352391 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38f40cbc40 0x7f38f40b6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:32.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.818+0000 7f38fac5a640 1 -- 172.21.15.167:0/391352391 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f38f40cf430 msgr2=0x7f38f41f4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:32.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.818+0000 7f38fac5a640 1 --2- 172.21.15.167:0/391352391 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f38f40cf430 0x7f38f41f4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:32.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.818+0000 7f38fac5a640 1 -- 172.21.15.167:0/391352391 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38f41f4870 con 0x7f38f415ad50 2024-09-17T05:21:32.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.818+0000 7f38fa459640 1 --2- 172.21.15.167:0/391352391 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38f40cbc40 0x7f38f40b6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:21:32.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.818+0000 7f38fac5a640 1 --2- 172.21.15.167:0/391352391 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38f415ad50 0x7f38f406cb70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f38ec032000 tx=0x7f38ec003ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:32.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.818+0000 7f38e6ffd640 1 -- 172.21.15.167:0/391352391 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ec044070 con 0x7f38f415ad50 2024-09-17T05:21:32.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.818+0000 7f38e6ffd640 1 -- 172.21.15.167:0/391352391 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f38ec004250 con 0x7f38f415ad50 2024-09-17T05:21:32.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.818+0000 7f38fc6bd640 1 -- 172.21.15.167:0/391352391 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38f40b6090 con 0x7f38f415ad50 2024-09-17T05:21:32.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.818+0000 7f38e6ffd640 1 -- 172.21.15.167:0/391352391 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ec0046a0 con 0x7f38f415ad50 2024-09-17T05:21:32.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.818+0000 7f38fc6bd640 1 -- 172.21.15.167:0/391352391 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38f4159780 con 0x7f38f415ad50 2024-09-17T05:21:32.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.818+0000 7f38e6ffd640 1 -- 172.21.15.167:0/391352391 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f38ec02d450 con 0x7f38f415ad50 2024-09-17T05:21:32.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.818+0000 7f38e6ffd640 1 -- 172.21.15.167:0/391352391 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f38ec02c9f0 con 0x7f38f415ad50 2024-09-17T05:21:32.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.819+0000 7f38fc6bd640 1 -- 172.21.15.167:0/391352391 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38f40cf8c0 con 0x7f38f415ad50 2024-09-17T05:21:32.822 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.821+0000 7f38e6ffd640 1 -- 172.21.15.167:0/391352391 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f38ec032030 con 0x7f38f415ad50 2024-09-17T05:21:32.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.892+0000 7f38fc6bd640 1 -- 172.21.15.167:0/391352391 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd new", "uuid": "01edaf9c-3898-406e-85b0-774cfda60adf", "id": 7} v 0) -- 0x7f38f40d0370 con 0x7f38f415ad50 2024-09-17T05:21:32.896 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.895+0000 7f38e6ffd640 1 -- 172.21.15.167:0/391352391 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "01edaf9c-3898-406e-85b0-774cfda60adf", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f38ec02d8d0 con 0x7f38f415ad50 2024-09-17T05:21:32.896 INFO:teuthology.orchestra.run.smithi167.stdout:7 2024-09-17T05:21:32.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.896+0000 7f38fc6bd640 1 -- 172.21.15.167:0/391352391 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38f415ad50 msgr2=0x7f38f406cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:32.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.896+0000 7f38fc6bd640 1 --2- 172.21.15.167:0/391352391 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38f415ad50 0x7f38f406cb70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f38ec032000 tx=0x7f38ec003ce0 comp rx=0 tx=0).stop 2024-09-17T05:21:32.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.896+0000 7f38fc6bd640 1 -- 172.21.15.167:0/391352391 shutdown_connections 2024-09-17T05:21:32.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.896+0000 7f38fc6bd640 1 --2- 172.21.15.167:0/391352391 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38f415ad50 0x7f38f406cb70 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:32.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.896+0000 7f38fc6bd640 1 --2- 172.21.15.167:0/391352391 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f38f40cf430 0x7f38f41f4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:32.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.896+0000 7f38fc6bd640 1 --2- 172.21.15.167:0/391352391 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38f40cbc40 0x7f38f40b6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:32.897 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.896+0000 7f38fc6bd640 1 -- 172.21.15.167:0/391352391 >> 172.21.15.167:0/391352391 conn(0x7f38f40cd6f0 msgr2=0x7f38f406f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:32.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.896+0000 7f38fc6bd640 1 -- 172.21.15.167:0/391352391 shutdown_connections 2024-09-17T05:21:32.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:21:32.896+0000 7f38fc6bd640 1 -- 172.21.15.167:0/391352391 wait complete. 2024-09-17T05:21:32.907 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-17T05:21:32.907 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-17T05:21:32.909 INFO:tasks.ceph.osd.0:Started 2024-09-17T05:21:32.909 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-17T05:21:32.910 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-17T05:21:32.912 INFO:tasks.ceph.osd.1:Started 2024-09-17T05:21:32.912 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-17T05:21:32.913 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-17T05:21:32.915 INFO:tasks.ceph.osd.2:Started 2024-09-17T05:21:32.915 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-17T05:21:32.915 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-17T05:21:32.917 INFO:tasks.ceph.osd.3:Started 2024-09-17T05:21:32.918 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-17T05:21:32.918 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-17T05:21:32.919 INFO:tasks.ceph.osd.4:Started 2024-09-17T05:21:32.920 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-17T05:21:32.920 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-17T05:21:32.922 INFO:tasks.ceph.osd.5:Started 2024-09-17T05:21:32.922 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-17T05:21:32.922 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-17T05:21:32.924 INFO:tasks.ceph.osd.6:Started 2024-09-17T05:21:32.924 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-17T05:21:32.924 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-17T05:21:32.926 INFO:tasks.ceph.osd.7:Started 2024-09-17T05:21:32.927 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:21:33.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:33.051+0000 7f7270a33640 1 -- 172.21.15.98:0/334814043 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f726c1445d0 msgr2=0x7f726c0cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:33.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:33.051+0000 7f7270a33640 1 --2- 172.21.15.98:0/334814043 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f726c1445d0 0x7f726c0cebf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f725c005fd0 tx=0x7f725c02a6c0 comp rx=0 tx=0).stop 2024-09-17T05:21:33.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:33.051+0000 7f7270a33640 1 -- 172.21.15.98:0/334814043 shutdown_connections 2024-09-17T05:21:33.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:33.051+0000 7f7270a33640 1 --2- 172.21.15.98:0/334814043 >> v2:172.21.15.167:3300/0 conn(0x7f726c0ccfd0 0x7f726c0cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:33.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:33.051+0000 7f7270a33640 1 --2- 172.21.15.98:0/334814043 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f726c1445d0 0x7f726c0cebf0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:33.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:33.051+0000 7f7270a33640 1 -- 172.21.15.98:0/334814043 >> 172.21.15.98:0/334814043 conn(0x7f726c0b1950 msgr2=0x7f726c0b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:33.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:33.051+0000 7f7270a33640 1 -- 172.21.15.98:0/334814043 shutdown_connections 2024-09-17T05:21:33.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:33.051+0000 7f7270a33640 1 -- 172.21.15.98:0/334814043 wait complete. 2024-09-17T05:21:33.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:33.053+0000 7f7270a33640 1 Processor -- start 2024-09-17T05:21:33.055 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:33.053+0000 7f7270a33640 1 -- start start 2024-09-17T05:21:33.057 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:33.054+0000 7f7270a33640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f726c0b4ca0 0x7f726c1f3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:33.057 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:33.054+0000 7f7270a33640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f726c0ccfd0 0x7f726c0c5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:33.057 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:33.054+0000 7f7270a33640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f726c1445d0 0x7f726c1f6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:33.057 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:33.054+0000 7f7270a33640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f726c15f080 con 0x7f726c0ccfd0 2024-09-17T05:21:33.057 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:33.054+0000 7f7270a33640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f726c073bc0 con 0x7f726c1445d0 2024-09-17T05:21:33.057 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:33.054+0000 7f7270a33640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f726c15f200 con 0x7f726c0b4ca0 2024-09-17T05:21:33.057 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:33.054+0000 7f7263fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f726c0ccfd0 0x7f726c0c5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:33.057 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:33.054+0000 7f7263fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f726c0ccfd0 0x7f726c0c5ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60222/0 (socket says 172.21.15.98:60222) 2024-09-17T05:21:33.057 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:33.054+0000 7f7263fff640 1 -- 172.21.15.98:0/29136030 learned_addr learned my addr 172.21.15.98:0/29136030 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:21:33.057 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:33.054+0000 7f726ad9d640 1 --2- 172.21.15.98:0/29136030 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f726c1445d0 0x7f726c1f6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:33.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:33.054+0000 7f726a59c640 1 --2- 172.21.15.98:0/29136030 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f726c0b4ca0 0x7f726c1f3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:33.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:33.054+0000 7f7263fff640 1 -- 172.21.15.98:0/29136030 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f726c0b4ca0 msgr2=0x7f726c1f3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:33.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:33.054+0000 7f7263fff640 1 --2- 172.21.15.98:0/29136030 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f726c0b4ca0 0x7f726c1f3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:33.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:33.054+0000 7f7263fff640 1 -- 172.21.15.98:0/29136030 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f726c1445d0 msgr2=0x7f726c1f6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:33.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:33.054+0000 7f7263fff640 1 --2- 172.21.15.98:0/29136030 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f726c1445d0 0x7f726c1f6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:33.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:33.054+0000 7f7263fff640 1 -- 172.21.15.98:0/29136030 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f726c1f6b00 con 0x7f726c0ccfd0 2024-09-17T05:21:33.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:33.054+0000 7f726ad9d640 1 --2- 172.21.15.98:0/29136030 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f726c1445d0 0x7f726c1f6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:21:33.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:33.054+0000 7f7263fff640 1 --2- 172.21.15.98:0/29136030 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f726c0ccfd0 0x7f726c0c5ec0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f725400ea20 tx=0x7f725400eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:33.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:33.054+0000 7f7262ffd640 1 -- 172.21.15.98:0/29136030 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f725400cd80 con 0x7f726c0ccfd0 2024-09-17T05:21:33.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:33.054+0000 7f7262ffd640 1 -- 172.21.15.98:0/29136030 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7254010430 con 0x7f726c0ccfd0 2024-09-17T05:21:33.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:33.054+0000 7f7270a33640 1 -- 172.21.15.98:0/29136030 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f726c1f6de0 con 0x7f726c0ccfd0 2024-09-17T05:21:33.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:33.054+0000 7f7262ffd640 1 -- 172.21.15.98:0/29136030 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7254010840 con 0x7f726c0ccfd0 2024-09-17T05:21:33.059 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:33.055+0000 7f7270a33640 1 -- 172.21.15.98:0/29136030 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f726c1f3060 con 0x7f726c0ccfd0 2024-09-17T05:21:33.059 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:33.055+0000 7f7262ffd640 1 -- 172.21.15.98:0/29136030 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f72540109e0 con 0x7f726c0ccfd0 2024-09-17T05:21:33.059 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:33.055+0000 7f7262ffd640 1 -- 172.21.15.98:0/29136030 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f7254018dd0 con 0x7f726c0ccfd0 2024-09-17T05:21:33.059 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:33.055+0000 7f7270a33640 1 -- 172.21.15.98:0/29136030 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f726c15f720 con 0x7f726c0ccfd0 2024-09-17T05:21:33.059 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:33.057+0000 7f7262ffd640 1 -- 172.21.15.98:0/29136030 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f72540213f0 con 0x7f726c0ccfd0 2024-09-17T05:21:33.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:33.116+0000 7f7270a33640 1 -- 172.21.15.98:0/29136030 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f726c070a20 con 0x7f726c0ccfd0 2024-09-17T05:21:33.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:33.116+0000 7f7262ffd640 1 -- 172.21.15.98:0/29136030 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f7254021b10 con 0x7f726c0ccfd0 2024-09-17T05:21:33.118 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:21:33.118 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":10,"fsid":"fcbf5a43-b3d8-497c-b15d-3cc022477cf0","created":"2024-09-17T05:21:29.852143+0000","modified":"2024-09-17T05:21:32.893880+0000","last_up_change":"0.000000","last_in_change":"2024-09-17T05:21:32.893880+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"65ad711a-df74-438b-b0dc-1499d685c958","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f0ccb08d-4d8d-47b8-9320-8c372a6605b0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a0985398-5e5f-494f-8abf-f785f19e94ec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e960be2e-0c3a-426e-9507-d3be5895f9e5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"49118c00-3dc1-43ef-8ed4-aca61e56a507","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9f4e0143-2b3d-40e4-bfb5-043d9a9f4ba9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"28720514-e627-4dea-8f4d-bd311ec31361","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"01edaf9c-3898-406e-85b0-774cfda60adf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:21:33.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:33.117+0000 7f7270a33640 1 -- 172.21.15.98:0/29136030 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f726c0ccfd0 msgr2=0x7f726c0c5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:33.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:33.117+0000 7f7270a33640 1 --2- 172.21.15.98:0/29136030 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f726c0ccfd0 0x7f726c0c5ec0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f725400ea20 tx=0x7f725400eee0 comp rx=0 tx=0).stop 2024-09-17T05:21:33.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:33.117+0000 7f7270a33640 1 -- 172.21.15.98:0/29136030 shutdown_connections 2024-09-17T05:21:33.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:33.117+0000 7f7270a33640 1 --2- 172.21.15.98:0/29136030 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f726c1445d0 0x7f726c1f6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:33.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:33.117+0000 7f7270a33640 1 --2- 172.21.15.98:0/29136030 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f726c0ccfd0 0x7f726c0c5ec0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:33.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:33.117+0000 7f7270a33640 1 --2- 172.21.15.98:0/29136030 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f726c0b4ca0 0x7f726c1f3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:33.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:33.117+0000 7f7270a33640 1 -- 172.21.15.98:0/29136030 >> 172.21.15.98:0/29136030 conn(0x7f726c0b1950 msgr2=0x7f726c0acd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:33.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:33.117+0000 7f7270a33640 1 -- 172.21.15.98:0/29136030 shutdown_connections 2024-09-17T05:21:33.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:33.117+0000 7f7270a33640 1 -- 172.21.15.98:0/29136030 wait complete. 2024-09-17T05:21:33.129 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-17T05:21:33.129 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-17T05:21:33.938 DEBUG:teuthology.orchestra.run.smithi098:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T05:21:34.031 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:34.029+0000 7fc85e7c9640 1 -- 172.21.15.98:0/2729323973 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc840004d40 msgr2=0x7fc8400051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:34.031 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:34.029+0000 7fc85e7c9640 1 --2- 172.21.15.98:0/2729323973 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc840004d40 0x7fc8400051c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc85000c640 tx=0x7fc840005830 comp rx=0 tx=0).stop 2024-09-17T05:21:34.032 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:34.029+0000 7fc85cd66640 1 -- 172.21.15.98:0/2729323973 reap_dead start 2024-09-17T05:21:34.032 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:34.029+0000 7fc85e7c9640 1 -- 172.21.15.98:0/2729323973 shutdown_connections 2024-09-17T05:21:34.032 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:34.029+0000 7fc85e7c9640 1 -- 172.21.15.98:0/2729323973 >> 172.21.15.98:0/2729323973 conn(0x7fc8580d1f30 msgr2=0x7fc8580d2340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:34.032 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:34.029+0000 7fc85e7c9640 1 -- 172.21.15.98:0/2729323973 shutdown_connections 2024-09-17T05:21:34.032 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:34.029+0000 7fc85e7c9640 1 -- 172.21.15.98:0/2729323973 wait complete. 2024-09-17T05:21:34.032 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:34.030+0000 7fc85e7c9640 1 Processor -- start 2024-09-17T05:21:34.033 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:34.031+0000 7fc85e7c9640 1 -- start start 2024-09-17T05:21:34.035 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:34.031+0000 7fc85e7c9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc840004d40 0x7fc85809f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:34.035 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:34.031+0000 7fc85e7c9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8580c7fd0 0x7fc8580c8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:34.035 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:34.031+0000 7fc85e7c9640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc85806dd60 0x7fc85806e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:34.035 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:34.031+0000 7fc85e7c9640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc8580b6340 con 0x7fc8580c7fd0 2024-09-17T05:21:34.035 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:34.031+0000 7fc85e7c9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc8580b61c0 con 0x7fc840004d40 2024-09-17T05:21:34.035 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:34.031+0000 7fc85e7c9640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fc8580b64c0 con 0x7fc85806dd60 2024-09-17T05:21:34.035 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:34.031+0000 7fc8577fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8580c7fd0 0x7fc8580c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:34.035 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:34.031+0000 7fc8577fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8580c7fd0 0x7fc8580c8450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60238/0 (socket says 172.21.15.98:60238) 2024-09-17T05:21:34.036 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:34.031+0000 7fc8577fe640 1 -- 172.21.15.98:0/3038299943 learned_addr learned my addr 172.21.15.98:0/3038299943 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:21:34.036 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:34.031+0000 7fc857fff640 1 --2- 172.21.15.98:0/3038299943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc840004d40 0x7fc85809f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:34.036 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:34.031+0000 7fc85cd66640 1 --2- 172.21.15.98:0/3038299943 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc85806dd60 0x7fc85806e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:34.036 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:34.032+0000 7fc8577fe640 1 -- 172.21.15.98:0/3038299943 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc85806dd60 msgr2=0x7fc85806e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:34.036 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:34.032+0000 7fc8577fe640 1 --2- 172.21.15.98:0/3038299943 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc85806dd60 0x7fc85806e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:34.036 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:34.032+0000 7fc8577fe640 1 -- 172.21.15.98:0/3038299943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc840004d40 msgr2=0x7fc85809f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:34.036 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:34.032+0000 7fc8577fe640 1 --2- 172.21.15.98:0/3038299943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc840004d40 0x7fc85809f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:34.036 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:34.032+0000 7fc8577fe640 1 -- 172.21.15.98:0/3038299943 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8580c8990 con 0x7fc8580c7fd0 2024-09-17T05:21:34.036 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:34.032+0000 7fc8577fe640 1 --2- 172.21.15.98:0/3038299943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8580c7fd0 0x7fc8580c8450 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc84c011b10 tx=0x7fc84c011f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:34.036 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:34.032+0000 7fc854ff9640 1 -- 172.21.15.98:0/3038299943 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc84c01e070 con 0x7fc8580c7fd0 2024-09-17T05:21:34.036 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:34.032+0000 7fc854ff9640 1 -- 172.21.15.98:0/3038299943 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc84c004460 con 0x7fc8580c7fd0 2024-09-17T05:21:34.036 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:34.032+0000 7fc85e7c9640 1 -- 172.21.15.98:0/3038299943 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc85806ead0 con 0x7fc8580c7fd0 2024-09-17T05:21:34.036 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:34.032+0000 7fc854ff9640 1 -- 172.21.15.98:0/3038299943 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc84c00fb20 con 0x7fc8580c7fd0 2024-09-17T05:21:34.037 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:34.032+0000 7fc85e7c9640 1 -- 172.21.15.98:0/3038299943 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc85806f090 con 0x7fc8580c7fd0 2024-09-17T05:21:34.037 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:34.032+0000 7fc854ff9640 1 -- 172.21.15.98:0/3038299943 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc84c021070 con 0x7fc8580c7fd0 2024-09-17T05:21:34.037 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:34.032+0000 7fc854ff9640 1 -- 172.21.15.98:0/3038299943 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fc84c023b60 con 0x7fc8580c7fd0 2024-09-17T05:21:34.037 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:34.033+0000 7fc85e7c9640 1 -- 172.21.15.98:0/3038299943 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8580b6a50 con 0x7fc8580c7fd0 2024-09-17T05:21:34.037 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:34.035+0000 7fc854ff9640 1 -- 172.21.15.98:0/3038299943 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fc84c023490 con 0x7fc8580c7fd0 2024-09-17T05:21:34.097 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:34.095+0000 7fc85e7c9640 1 -- 172.21.15.98:0/3038299943 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc8580ce720 con 0x7fc8580c7fd0 2024-09-17T05:21:34.097 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:34.095+0000 7fc854ff9640 1 -- 172.21.15.98:0/3038299943 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fc84c023670 con 0x7fc8580c7fd0 2024-09-17T05:21:34.097 INFO:teuthology.misc.health.smithi098.stdout: 2024-09-17T05:21:34.097 INFO:teuthology.misc.health.smithi098.stdout:{"epoch":10,"fsid":"fcbf5a43-b3d8-497c-b15d-3cc022477cf0","created":"2024-09-17T05:21:29.852143+0000","modified":"2024-09-17T05:21:32.893880+0000","last_up_change":"0.000000","last_in_change":"2024-09-17T05:21:32.893880+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"65ad711a-df74-438b-b0dc-1499d685c958","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f0ccb08d-4d8d-47b8-9320-8c372a6605b0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a0985398-5e5f-494f-8abf-f785f19e94ec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e960be2e-0c3a-426e-9507-d3be5895f9e5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"49118c00-3dc1-43ef-8ed4-aca61e56a507","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9f4e0143-2b3d-40e4-bfb5-043d9a9f4ba9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"28720514-e627-4dea-8f4d-bd311ec31361","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"01edaf9c-3898-406e-85b0-774cfda60adf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:21:34.098 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:34.096+0000 7fc85e7c9640 1 -- 172.21.15.98:0/3038299943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8580c7fd0 msgr2=0x7fc8580c8450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:34.098 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:34.096+0000 7fc85e7c9640 1 --2- 172.21.15.98:0/3038299943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8580c7fd0 0x7fc8580c8450 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc84c011b10 tx=0x7fc84c011f10 comp rx=0 tx=0).stop 2024-09-17T05:21:34.099 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:34.096+0000 7fc85e7c9640 1 -- 172.21.15.98:0/3038299943 shutdown_connections 2024-09-17T05:21:34.099 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:34.096+0000 7fc85e7c9640 1 --2- 172.21.15.98:0/3038299943 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc85806dd60 0x7fc85806e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:34.099 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:34.096+0000 7fc85e7c9640 1 --2- 172.21.15.98:0/3038299943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8580c7fd0 0x7fc8580c8450 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:34.099 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:34.096+0000 7fc85e7c9640 1 --2- 172.21.15.98:0/3038299943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc840004d40 0x7fc85809f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:34.099 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:34.096+0000 7fc85e7c9640 1 -- 172.21.15.98:0/3038299943 >> 172.21.15.98:0/3038299943 conn(0x7fc8580d1f30 msgr2=0x7fc85815cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:34.099 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:34.096+0000 7fc85e7c9640 1 -- 172.21.15.98:0/3038299943 shutdown_connections 2024-09-17T05:21:34.099 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:34.096+0000 7fc85e7c9640 1 -- 172.21.15.98:0/3038299943 wait complete. 2024-09-17T05:21:34.107 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-17T05:21:34.137 INFO:tasks.ceph.osd.2.smithi098.stderr:2024-09-17T05:21:34.135+0000 7f859effd640 -1 Falling back to public interface 2024-09-17T05:21:34.147 INFO:tasks.ceph.osd.3.smithi098.stderr:2024-09-17T05:21:34.145+0000 7ff8f042f640 -1 Falling back to public interface 2024-09-17T05:21:34.396 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-17T05:21:34.395+0000 7f4ccc302640 -1 Falling back to public interface 2024-09-17T05:21:34.406 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T05:21:34.404+0000 7f25b6bdd640 -1 Falling back to public interface 2024-09-17T05:21:34.434 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-17T05:21:34.433+0000 7f6355f58640 -1 Falling back to public interface 2024-09-17T05:21:34.642 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-17T05:21:34.641+0000 7f218cc18640 -1 Falling back to public interface 2024-09-17T05:21:34.646 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-17T05:21:34.645+0000 7f5bcef45640 -1 Falling back to public interface 2024-09-17T05:21:34.838 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-09-17T05:21:34.836+0000 7fc2908a5640 -1 Falling back to public interface 2024-09-17T05:21:35.256 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-17T05:21:35.254+0000 7fdb1a8a0640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-17T05:21:35.256 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-17T05:21:35.256+0000 7fdb1a8a0640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-17T05:21:38.198 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-17T05:21:38.198+0000 7f4ccc302640 -1 osd.5 0 log_to_monitors true 2024-09-17T05:21:38.217 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T05:21:38.215+0000 7f25b6bdd640 -1 osd.1 0 log_to_monitors true 2024-09-17T05:21:38.242 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-17T05:21:38.242+0000 7f5bcef45640 -1 osd.7 0 log_to_monitors true 2024-09-17T05:21:38.397 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-17T05:21:38.397+0000 7f218cc18640 -1 osd.6 0 log_to_monitors true 2024-09-17T05:21:38.422 INFO:tasks.ceph.osd.3.smithi098.stderr:2024-09-17T05:21:38.420+0000 7ff8f042f640 -1 osd.3 0 log_to_monitors true 2024-09-17T05:21:38.486 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-17T05:21:38.486+0000 7f6355f58640 -1 osd.4 0 log_to_monitors true 2024-09-17T05:21:38.707 INFO:tasks.ceph.osd.2.smithi098.stderr:2024-09-17T05:21:38.705+0000 7f859effd640 -1 osd.2 0 log_to_monitors true 2024-09-17T05:21:39.078 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-09-17T05:21:39.076+0000 7fc2908a5640 -1 osd.0 0 log_to_monitors true 2024-09-17T05:21:40.086 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T05:21:40.084+0000 7f25b2b6c640 -1 osd.1 0 waiting for initial osdmap 2024-09-17T05:21:40.101 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T05:21:40.100+0000 7f25aa98b640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T05:21:40.650 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-17T05:21:40.649+0000 7f5bcaed4640 -1 osd.7 0 waiting for initial osdmap 2024-09-17T05:21:40.748 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-17T05:21:40.748+0000 7f4cc8aa5640 -1 osd.5 0 waiting for initial osdmap 2024-09-17T05:21:40.776 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-17T05:21:40.776+0000 7f4cc00b0640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T05:21:40.776 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-17T05:21:40.776+0000 7f5bc2cf3640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T05:21:40.914 DEBUG:teuthology.orchestra.run.smithi098:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T05:21:41.017 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:41.015+0000 7eff9c99f640 1 -- 172.21.15.98:0/685702653 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff9815f230 msgr2=0x7eff980cfff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:41.017 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:41.015+0000 7eff9c99f640 1 --2- 172.21.15.98:0/685702653 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff9815f230 0x7eff980cfff0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7eff88005fd0 tx=0x7eff8802a5d0 comp rx=0 tx=0).stop 2024-09-17T05:21:41.017 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:41.015+0000 7eff9c99f640 1 -- 172.21.15.98:0/685702653 shutdown_connections 2024-09-17T05:21:41.017 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:41.015+0000 7eff9c99f640 1 --2- 172.21.15.98:0/685702653 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff980cd110 0x7eff980c5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:41.018 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:41.015+0000 7eff9c99f640 1 --2- 172.21.15.98:0/685702653 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff9815f230 0x7eff980cfff0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:41.018 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:41.015+0000 7eff9c99f640 1 -- 172.21.15.98:0/685702653 >> 172.21.15.98:0/685702653 conn(0x7eff9809aa60 msgr2=0x7eff9809ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:41.018 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:41.015+0000 7eff9c99f640 1 -- 172.21.15.98:0/685702653 shutdown_connections 2024-09-17T05:21:41.018 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:41.015+0000 7eff9c99f640 1 -- 172.21.15.98:0/685702653 wait complete. 2024-09-17T05:21:41.018 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:41.016+0000 7eff9c99f640 1 Processor -- start 2024-09-17T05:21:41.018 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:41.016+0000 7eff9c99f640 1 -- start start 2024-09-17T05:21:41.020 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:41.017+0000 7eff9c99f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff980cd110 0x7eff980b6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:41.020 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:41.017+0000 7eff9c99f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff980d0530 0x7eff981f7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:41.021 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:41.017+0000 7eff9c99f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff9815f230 0x7eff9815bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:41.021 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:41.017+0000 7eff9c99f640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7eff980c6470 con 0x7eff980cd110 2024-09-17T05:21:41.021 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:41.017+0000 7eff9c99f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7eff980c62f0 con 0x7eff980d0530 2024-09-17T05:21:41.021 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:41.017+0000 7eff9c99f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7eff980c65f0 con 0x7eff9815f230 2024-09-17T05:21:41.021 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:41.017+0000 7eff977fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff980cd110 0x7eff980b6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:41.021 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:41.017+0000 7eff96ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff980d0530 0x7eff981f7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:41.021 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:41.017+0000 7eff97fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff9815f230 0x7eff9815bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:41.021 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:41.017+0000 7eff977fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff980cd110 0x7eff980b6e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46274/0 (socket says 172.21.15.98:46274) 2024-09-17T05:21:41.021 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:41.017+0000 7eff977fe640 1 -- 172.21.15.98:0/3160193049 learned_addr learned my addr 172.21.15.98:0/3160193049 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:21:41.021 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:41.017+0000 7eff97fff640 1 --2- 172.21.15.98:0/3160193049 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff9815f230 0x7eff9815bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.98:55922/0 (socket says 172.21.15.98:55922) 2024-09-17T05:21:41.021 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:41.018+0000 7eff977fe640 1 -- 172.21.15.98:0/3160193049 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff9815f230 msgr2=0x7eff9815bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:41.021 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:41.018+0000 7eff977fe640 1 --2- 172.21.15.98:0/3160193049 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff9815f230 0x7eff9815bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:41.021 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:41.018+0000 7eff977fe640 1 -- 172.21.15.98:0/3160193049 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff980d0530 msgr2=0x7eff981f7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:41.022 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:41.018+0000 7eff977fe640 1 --2- 172.21.15.98:0/3160193049 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff980d0530 0x7eff981f7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:41.022 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:41.018+0000 7eff977fe640 1 -- 172.21.15.98:0/3160193049 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff980b5d90 con 0x7eff980cd110 2024-09-17T05:21:41.022 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:41.018+0000 7eff977fe640 1 --2- 172.21.15.98:0/3160193049 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff980cd110 0x7eff980b6e30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7eff88034040 tx=0x7eff880038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:41.022 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:41.018+0000 7eff7ffff640 1 -- 172.21.15.98:0/3160193049 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff8803e030 con 0x7eff980cd110 2024-09-17T05:21:41.022 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:41.018+0000 7eff7ffff640 1 -- 172.21.15.98:0/3160193049 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7eff88003ca0 con 0x7eff980cd110 2024-09-17T05:21:41.022 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:41.018+0000 7eff9c99f640 1 -- 172.21.15.98:0/3160193049 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff980b6070 con 0x7eff980cd110 2024-09-17T05:21:41.022 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:41.018+0000 7eff7ffff640 1 -- 172.21.15.98:0/3160193049 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff88035040 con 0x7eff980cd110 2024-09-17T05:21:41.022 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:41.018+0000 7eff9c99f640 1 -- 172.21.15.98:0/3160193049 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff980b6910 con 0x7eff980cd110 2024-09-17T05:21:41.023 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:41.019+0000 7eff9c99f640 1 -- 172.21.15.98:0/3160193049 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff980b6460 con 0x7eff980cd110 2024-09-17T05:21:41.023 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:41.020+0000 7eff7ffff640 1 -- 172.21.15.98:0/3160193049 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) ==== 101385+0+0 (secure 0 0 0) 0x7eff88041030 con 0x7eff980cd110 2024-09-17T05:21:41.023 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:41.021+0000 7eff7ffff640 1 --2- 172.21.15.98:0/3160193049 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7eff84078b30 0x7eff8407aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:41.023 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:41.021+0000 7eff7ffff640 1 -- 172.21.15.98:0/3160193049 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2511+0+0 (secure 0 0 0) 0x7eff880ba390 con 0x7eff980cd110 2024-09-17T05:21:41.023 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:41.021+0000 7eff96ffd640 1 --2- 172.21.15.98:0/3160193049 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7eff84078b30 0x7eff8407aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:41.023 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:41.021+0000 7eff96ffd640 1 --2- 172.21.15.98:0/3160193049 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7eff84078b30 0x7eff8407aff0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7eff98071490 tx=0x7eff8c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:41.027 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:41.026+0000 7eff7ffff640 1 -- 172.21.15.98:0/3160193049 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7eff88082f70 con 0x7eff980cd110 2024-09-17T05:21:41.237 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:41.236+0000 7eff9c99f640 1 -- 172.21.15.98:0/3160193049 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7eff980c7c90 con 0x7eff980cd110 2024-09-17T05:21:41.238 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:41.236+0000 7eff7ffff640 1 -- 172.21.15.98:0/3160193049 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+7555 (secure 0 0 0) 0x7eff880879a0 con 0x7eff980cd110 2024-09-17T05:21:41.238 INFO:teuthology.misc.health.smithi098.stdout: 2024-09-17T05:21:41.238 INFO:teuthology.misc.health.smithi098.stdout:{"epoch":13,"fsid":"fcbf5a43-b3d8-497c-b15d-3cc022477cf0","created":"2024-09-17T05:21:29.852143+0000","modified":"2024-09-17T05:21:40.258793+0000","last_up_change":"2024-09-17T05:21:40.258793+0000","last_in_change":"2024-09-17T05:21:32.893880+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"65ad711a-df74-438b-b0dc-1499d685c958","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f0ccb08d-4d8d-47b8-9320-8c372a6605b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6817","nonce":3902180920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6819","nonce":3902180920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6823","nonce":3902180920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6821","nonce":3902180920}]},"public_addr":"172.21.15.98:6817/3902180920","cluster_addr":"172.21.15.98:6819/3902180920","heartbeat_back_addr":"172.21.15.98:6823/3902180920","heartbeat_front_addr":"172.21.15.98:6821/3902180920","state":["exists","up"]},{"osd":2,"uuid":"a0985398-5e5f-494f-8abf-f785f19e94ec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e960be2e-0c3a-426e-9507-d3be5895f9e5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"49118c00-3dc1-43ef-8ed4-aca61e56a507","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9f4e0143-2b3d-40e4-bfb5-043d9a9f4ba9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"28720514-e627-4dea-8f4d-bd311ec31361","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"01edaf9c-3898-406e-85b0-774cfda60adf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:21:41.241 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:41.238+0000 7eff9c99f640 1 -- 172.21.15.98:0/3160193049 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7eff84078b30 msgr2=0x7eff8407aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:41.241 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:41.238+0000 7eff9c99f640 1 --2- 172.21.15.98:0/3160193049 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7eff84078b30 0x7eff8407aff0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7eff98071490 tx=0x7eff8c009040 comp rx=0 tx=0).stop 2024-09-17T05:21:41.241 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:41.239+0000 7eff9c99f640 1 -- 172.21.15.98:0/3160193049 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff980cd110 msgr2=0x7eff980b6e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:41.241 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:41.239+0000 7eff9c99f640 1 --2- 172.21.15.98:0/3160193049 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff980cd110 0x7eff980b6e30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7eff88034040 tx=0x7eff880038a0 comp rx=0 tx=0).stop 2024-09-17T05:21:41.241 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:41.239+0000 7eff9c99f640 1 -- 172.21.15.98:0/3160193049 shutdown_connections 2024-09-17T05:21:41.241 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:41.239+0000 7eff9c99f640 1 --2- 172.21.15.98:0/3160193049 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7eff84078b30 0x7eff8407aff0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:41.241 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:41.239+0000 7eff9c99f640 1 --2- 172.21.15.98:0/3160193049 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff9815f230 0x7eff9815bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:41.241 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:41.239+0000 7eff9c99f640 1 --2- 172.21.15.98:0/3160193049 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff980d0530 0x7eff981f7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:41.241 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:41.239+0000 7eff9c99f640 1 --2- 172.21.15.98:0/3160193049 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff980cd110 0x7eff980b6e30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:41.241 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:41.239+0000 7eff9c99f640 1 -- 172.21.15.98:0/3160193049 >> 172.21.15.98:0/3160193049 conn(0x7eff9809aa60 msgr2=0x7eff980cc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:41.241 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:41.239+0000 7eff9c99f640 1 -- 172.21.15.98:0/3160193049 shutdown_connections 2024-09-17T05:21:41.241 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:41.239+0000 7eff9c99f640 1 -- 172.21.15.98:0/3160193049 wait complete. 2024-09-17T05:21:41.252 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-09-17T05:21:41.549 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-17T05:21:41.549+0000 7f218857a640 -1 osd.6 0 waiting for initial osdmap 2024-09-17T05:21:41.559 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-17T05:21:41.559+0000 7f2180399640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T05:21:41.570 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-17T05:21:41.570+0000 7f6351ee7640 -1 osd.4 0 waiting for initial osdmap 2024-09-17T05:21:41.585 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-17T05:21:41.585+0000 7f6349d06640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T05:21:41.919 INFO:tasks.ceph.osd.2.smithi098.stderr:2024-09-17T05:21:41.917+0000 7f859af8c640 -1 osd.2 0 waiting for initial osdmap 2024-09-17T05:21:41.922 INFO:tasks.ceph.osd.3.smithi098.stderr:2024-09-17T05:21:41.920+0000 7ff8eb985640 -1 osd.3 0 waiting for initial osdmap 2024-09-17T05:21:41.930 INFO:tasks.ceph.osd.2.smithi098.stderr:2024-09-17T05:21:41.929+0000 7f8592dab640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T05:21:41.942 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-09-17T05:21:41.940+0000 7fc28c834640 -1 osd.0 0 waiting for initial osdmap 2024-09-17T05:21:41.944 INFO:tasks.ceph.osd.3.smithi098.stderr:2024-09-17T05:21:41.943+0000 7ff8e37a4640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T05:21:41.952 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-09-17T05:21:41.951+0000 7fc284653640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T05:21:48.061 DEBUG:teuthology.orchestra.run.smithi098:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T05:21:48.171 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:48.164+0000 7f031ab7c640 1 -- 172.21.15.98:0/2502361879 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03140aec70 msgr2=0x7f031415b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:48.171 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:48.164+0000 7f031ab7c640 1 --2- 172.21.15.98:0/2502361879 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03140aec70 0x7f031415b0e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0314070470 tx=0x7f030802a4d0 comp rx=0 tx=0).stop 2024-09-17T05:21:48.171 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:48.165+0000 7f031ab7c640 1 -- 172.21.15.98:0/2502361879 shutdown_connections 2024-09-17T05:21:48.171 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:48.165+0000 7f031ab7c640 1 --2- 172.21.15.98:0/2502361879 >> v2:172.21.15.167:3300/0 conn(0x7f03140cf4f0 0x7f03140ca1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:48.172 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:48.165+0000 7f031ab7c640 1 --2- 172.21.15.98:0/2502361879 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03140af050 0x7f03140ca710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:48.172 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:48.165+0000 7f031ab7c640 1 --2- 172.21.15.98:0/2502361879 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03140aec70 0x7f031415b0e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:48.172 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:48.165+0000 7f031ab7c640 1 -- 172.21.15.98:0/2502361879 >> 172.21.15.98:0/2502361879 conn(0x7f03140cfb80 msgr2=0x7f03140cff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:48.172 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:48.165+0000 7f031ab7c640 1 -- 172.21.15.98:0/2502361879 shutdown_connections 2024-09-17T05:21:48.172 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:48.165+0000 7f031ab7c640 1 -- 172.21.15.98:0/2502361879 wait complete. 2024-09-17T05:21:48.172 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:48.166+0000 7f031ab7c640 1 Processor -- start 2024-09-17T05:21:48.172 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:48.166+0000 7f031ab7c640 1 -- start start 2024-09-17T05:21:48.172 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:48.167+0000 7f031ab7c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03140aec70 0x7f03141f5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:48.172 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:48.167+0000 7f031ab7c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03140af050 0x7f03141e40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:48.173 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:48.167+0000 7f031ab7c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03140cf4f0 0x7f03141f8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:48.173 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:48.167+0000 7f031ab7c640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0314159950 con 0x7f03140aec70 2024-09-17T05:21:48.173 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:48.167+0000 7f031ab7c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f03141597d0 con 0x7f03140cf4f0 2024-09-17T05:21:48.173 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:48.167+0000 7f031ab7c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f0314159ad0 con 0x7f03140af050 2024-09-17T05:21:48.173 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:48.167+0000 7f0318918640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03140aec70 0x7f03141f5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:48.173 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:48.167+0000 7f0318918640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03140aec70 0x7f03141f5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:49914/0 (socket says 172.21.15.98:49914) 2024-09-17T05:21:48.173 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:48.167+0000 7f0318918640 1 -- 172.21.15.98:0/2688411686 learned_addr learned my addr 172.21.15.98:0/2688411686 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:21:48.173 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:48.167+0000 7f0319119640 1 --2- 172.21.15.98:0/2688411686 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03140cf4f0 0x7f03141f8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:48.173 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:48.167+0000 7f0313fff640 1 --2- 172.21.15.98:0/2688411686 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03140af050 0x7f03141e40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:48.173 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:48.167+0000 7f0318918640 1 -- 172.21.15.98:0/2688411686 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03140af050 msgr2=0x7f03141e40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:48.173 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:48.167+0000 7f0318918640 1 --2- 172.21.15.98:0/2688411686 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03140af050 0x7f03141e40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:48.173 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:48.167+0000 7f0318918640 1 -- 172.21.15.98:0/2688411686 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03140cf4f0 msgr2=0x7f03141f8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:48.174 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:48.167+0000 7f0318918640 1 --2- 172.21.15.98:0/2688411686 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03140cf4f0 0x7f03141f8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:48.174 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:48.167+0000 7f0318918640 1 -- 172.21.15.98:0/2688411686 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03141f8de0 con 0x7f03140aec70 2024-09-17T05:21:48.174 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:48.167+0000 7f0313fff640 1 --2- 172.21.15.98:0/2688411686 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03140af050 0x7f03141e40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:21:48.174 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:48.167+0000 7f0318918640 1 --2- 172.21.15.98:0/2688411686 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03140aec70 0x7f03141f5820 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0308009340 tx=0x7f0308005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:48.174 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:48.167+0000 7f03117fa640 1 -- 172.21.15.98:0/2688411686 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0308035070 con 0x7f03140aec70 2024-09-17T05:21:48.174 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:48.167+0000 7f03117fa640 1 -- 172.21.15.98:0/2688411686 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0308041070 con 0x7f03140aec70 2024-09-17T05:21:48.174 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:48.168+0000 7f03117fa640 1 -- 172.21.15.98:0/2688411686 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0308003850 con 0x7f03140aec70 2024-09-17T05:21:48.174 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:48.168+0000 7f031ab7c640 1 -- 172.21.15.98:0/2688411686 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03141f90c0 con 0x7f03140aec70 2024-09-17T05:21:48.174 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:48.168+0000 7f031ab7c640 1 -- 172.21.15.98:0/2688411686 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03141f5020 con 0x7f03140aec70 2024-09-17T05:21:48.174 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:48.169+0000 7f031ab7c640 1 -- 172.21.15.98:0/2688411686 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f031415b0e0 con 0x7f03140aec70 2024-09-17T05:21:48.174 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:48.169+0000 7f03117fa640 1 -- 172.21.15.98:0/2688411686 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f03080039f0 con 0x7f03140aec70 2024-09-17T05:21:48.174 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:48.170+0000 7f03117fa640 1 --2- 172.21.15.98:0/2688411686 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f02f8078b90 0x7f02f807b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:48.175 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:48.170+0000 7f03117fa640 1 -- 172.21.15.98:0/2688411686 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f03080bba20 con 0x7f03140aec70 2024-09-17T05:21:48.175 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:48.170+0000 7f0313fff640 1 --2- 172.21.15.98:0/2688411686 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f02f8078b90 0x7f02f807b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:48.175 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:48.171+0000 7f0313fff640 1 --2- 172.21.15.98:0/2688411686 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f02f8078b90 0x7f02f807b050 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0300005fd0 tx=0x7f0300005d10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:48.175 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:48.174+0000 7f03117fa640 1 -- 172.21.15.98:0/2688411686 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f0308084240 con 0x7f03140aec70 2024-09-17T05:21:48.354 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:48.354+0000 7f031ab7c640 1 -- 172.21.15.98:0/2688411686 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f03140b5790 con 0x7f03140aec70 2024-09-17T05:21:48.355 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:48.355+0000 7f03117fa640 1 -- 172.21.15.98:0/2688411686 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12884 (secure 0 0 0) 0x7f0308083b40 con 0x7f03140aec70 2024-09-17T05:21:48.355 INFO:teuthology.misc.health.smithi098.stdout: 2024-09-17T05:21:48.356 INFO:teuthology.misc.health.smithi098.stdout:{"epoch":17,"fsid":"fcbf5a43-b3d8-497c-b15d-3cc022477cf0","created":"2024-09-17T05:21:29.852143+0000","modified":"2024-09-17T05:21:44.929327+0000","last_up_change":"2024-09-17T05:21:42.925756+0000","last_in_change":"2024-09-17T05:21:32.893880+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:21:42.263011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ad711a-df74-438b-b0dc-1499d685c958","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6825","nonce":3644101529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6827","nonce":3644101529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6831","nonce":3644101529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6829","nonce":3644101529}]},"public_addr":"172.21.15.98:6825/3644101529","cluster_addr":"172.21.15.98:6827/3644101529","heartbeat_back_addr":"172.21.15.98:6831/3644101529","heartbeat_front_addr":"172.21.15.98:6829/3644101529","state":["exists","up"]},{"osd":1,"uuid":"f0ccb08d-4d8d-47b8-9320-8c372a6605b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6817","nonce":3902180920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6819","nonce":3902180920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6823","nonce":3902180920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6821","nonce":3902180920}]},"public_addr":"172.21.15.98:6817/3902180920","cluster_addr":"172.21.15.98:6819/3902180920","heartbeat_back_addr":"172.21.15.98:6823/3902180920","heartbeat_front_addr":"172.21.15.98:6821/3902180920","state":["exists","up"]},{"osd":2,"uuid":"a0985398-5e5f-494f-8abf-f785f19e94ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6801","nonce":1518887101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6803","nonce":1518887101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6807","nonce":1518887101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6805","nonce":1518887101}]},"public_addr":"172.21.15.98:6801/1518887101","cluster_addr":"172.21.15.98:6803/1518887101","heartbeat_back_addr":"172.21.15.98:6807/1518887101","heartbeat_front_addr":"172.21.15.98:6805/1518887101","state":["exists","up"]},{"osd":3,"uuid":"e960be2e-0c3a-426e-9507-d3be5895f9e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6809","nonce":4125246091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6811","nonce":4125246091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6815","nonce":4125246091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6813","nonce":4125246091}]},"public_addr":"172.21.15.98:6809/4125246091","cluster_addr":"172.21.15.98:6811/4125246091","heartbeat_back_addr":"172.21.15.98:6815/4125246091","heartbeat_front_addr":"172.21.15.98:6813/4125246091","state":["exists","up"]},{"osd":4,"uuid":"49118c00-3dc1-43ef-8ed4-aca61e56a507","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6811","nonce":765789888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6813","nonce":765789888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6817","nonce":765789888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6815","nonce":765789888}]},"public_addr":"172.21.15.167:6811/765789888","cluster_addr":"172.21.15.167:6813/765789888","heartbeat_back_addr":"172.21.15.167:6817/765789888","heartbeat_front_addr":"172.21.15.167:6815/765789888","state":["exists","up"]},{"osd":5,"uuid":"9f4e0143-2b3d-40e4-bfb5-043d9a9f4ba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6803","nonce":2567019914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6805","nonce":2567019914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6809","nonce":2567019914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6807","nonce":2567019914}]},"public_addr":"172.21.15.167:6803/2567019914","cluster_addr":"172.21.15.167:6805/2567019914","heartbeat_back_addr":"172.21.15.167:6809/2567019914","heartbeat_front_addr":"172.21.15.167:6807/2567019914","state":["exists","up"]},{"osd":6,"uuid":"28720514-e627-4dea-8f4d-bd311ec31361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6819","nonce":96262631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6821","nonce":96262631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6825","nonce":96262631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6823","nonce":96262631}]},"public_addr":"172.21.15.167:6819/96262631","cluster_addr":"172.21.15.167:6821/96262631","heartbeat_back_addr":"172.21.15.167:6825/96262631","heartbeat_front_addr":"172.21.15.167:6823/96262631","state":["exists","up"]},{"osd":7,"uuid":"01edaf9c-3898-406e-85b0-774cfda60adf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6827","nonce":4169560909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6829","nonce":4169560909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6833","nonce":4169560909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6831","nonce":4169560909}]},"public_addr":"172.21.15.167:6827/4169560909","cluster_addr":"172.21.15.167:6829/4169560909","heartbeat_back_addr":"172.21.15.167:6833/4169560909","heartbeat_front_addr":"172.21.15.167:6831/4169560909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:40.054920+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.177110+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.749278+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.400155+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.503576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.196417+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.371063+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.212852+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:21:48.358 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:48.357+0000 7f031ab7c640 1 -- 172.21.15.98:0/2688411686 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f02f8078b90 msgr2=0x7f02f807b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:48.358 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:48.357+0000 7f031ab7c640 1 --2- 172.21.15.98:0/2688411686 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f02f8078b90 0x7f02f807b050 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0300005fd0 tx=0x7f0300005d10 comp rx=0 tx=0).stop 2024-09-17T05:21:48.358 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:48.357+0000 7f031ab7c640 1 -- 172.21.15.98:0/2688411686 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03140aec70 msgr2=0x7f03141f5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:48.358 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:48.357+0000 7f031ab7c640 1 --2- 172.21.15.98:0/2688411686 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03140aec70 0x7f03141f5820 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0308009340 tx=0x7f0308005770 comp rx=0 tx=0).stop 2024-09-17T05:21:48.358 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:48.357+0000 7f031ab7c640 1 -- 172.21.15.98:0/2688411686 shutdown_connections 2024-09-17T05:21:48.358 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:48.357+0000 7f031ab7c640 1 --2- 172.21.15.98:0/2688411686 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f02f8078b90 0x7f02f807b050 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:48.358 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:48.357+0000 7f031ab7c640 1 --2- 172.21.15.98:0/2688411686 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03140cf4f0 0x7f03141f8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:48.358 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:48.357+0000 7f031ab7c640 1 --2- 172.21.15.98:0/2688411686 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03140af050 0x7f03141e40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:48.358 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:48.357+0000 7f031ab7c640 1 --2- 172.21.15.98:0/2688411686 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03140aec70 0x7f03141f5820 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:48.359 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:48.357+0000 7f031ab7c640 1 -- 172.21.15.98:0/2688411686 >> 172.21.15.98:0/2688411686 conn(0x7f03140cfb80 msgr2=0x7f03140b1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:48.359 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:48.357+0000 7f031ab7c640 1 -- 172.21.15.98:0/2688411686 shutdown_connections 2024-09-17T05:21:48.359 INFO:teuthology.misc.health.smithi098.stderr:2024-09-17T05:21:48.357+0000 7f031ab7c640 1 -- 172.21.15.98:0/2688411686 wait complete. 2024-09-17T05:21:48.367 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-17T05:21:48.367 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-17T05:21:48.367 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T05:21:48.368 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T05:21:48.373 INFO:tasks.ceph.mds.a:Started 2024-09-17T05:21:48.373 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T05:21:48.373 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T05:21:48.375 INFO:tasks.ceph.mds.c:Started 2024-09-17T05:21:48.375 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T05:21:48.375 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T05:21:48.378 INFO:tasks.ceph.mds.b:Started 2024-09-17T05:21:48.378 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T05:21:48.379 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T05:21:48.381 INFO:tasks.ceph.mds.d:Started 2024-09-17T05:21:48.381 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-17T05:21:48.381 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:21:48.443 INFO:tasks.ceph.mds.a.smithi098.stdout:starting mds.a at 2024-09-17T05:21:48.450 INFO:tasks.ceph.mds.c.smithi098.stdout:starting mds.c at 2024-09-17T05:21:48.463 INFO:tasks.ceph.mds.b.smithi167.stdout:starting mds.b at 2024-09-17T05:21:48.464 INFO:tasks.ceph.mds.d.smithi167.stdout:starting mds.d at 2024-09-17T05:21:48.464 INFO:tasks.ceph.mds.b.smithi167.stderr:2024-09-17T05:21:48.463+0000 7f02fb54e640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-09-17T05:21:48.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:48.485+0000 7f92cb22a640 1 -- 172.21.15.98:0/550577690 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f92b4004800 msgr2=0x7f92b4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:48.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:48.485+0000 7f92cb22a640 1 --2- 172.21.15.98:0/550577690 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f92b4004800 0x7f92b4004c80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f92b000c2e0 tx=0x7f92b4005830 comp rx=0 tx=0).stop 2024-09-17T05:21:48.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:48.485+0000 7f92cb22a640 1 -- 172.21.15.98:0/550577690 shutdown_connections 2024-09-17T05:21:48.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:48.485+0000 7f92cb22a640 1 --2- 172.21.15.98:0/550577690 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f92b4004800 0x7f92b4004c80 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:48.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:48.485+0000 7f92cb22a640 1 -- 172.21.15.98:0/550577690 >> 172.21.15.98:0/550577690 conn(0x7f92c40d3fe0 msgr2=0x7f92c40d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:48.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:48.485+0000 7f92cb22a640 1 -- 172.21.15.98:0/550577690 shutdown_connections 2024-09-17T05:21:48.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:48.485+0000 7f92cb22a640 1 -- 172.21.15.98:0/550577690 wait complete. 2024-09-17T05:21:48.489 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:48.486+0000 7f92cb22a640 1 Processor -- start 2024-09-17T05:21:48.489 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:48.486+0000 7f92cb22a640 1 -- start start 2024-09-17T05:21:48.489 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:48.487+0000 7f92cb22a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f92b4004800 0x7f92c40ca640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:48.489 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:48.487+0000 7f92cb22a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92c41e8680 0x7f92c41f4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:48.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:48.487+0000 7f92cb22a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f92c415ae30 0x7f92c40b8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:48.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:48.487+0000 7f92cb22a640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f92c40cf050 con 0x7f92c415ae30 2024-09-17T05:21:48.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:48.487+0000 7f92cb22a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f92c40ceed0 con 0x7f92c41e8680 2024-09-17T05:21:48.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:48.487+0000 7f92cb22a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f92c40cf1d0 con 0x7f92b4004800 2024-09-17T05:21:48.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:48.487+0000 7f92c97c7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f92c415ae30 0x7f92c40b8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:48.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:48.487+0000 7f92c97c7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f92c415ae30 0x7f92c40b8980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:49976/0 (socket says 172.21.15.98:49976) 2024-09-17T05:21:48.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:48.487+0000 7f92c97c7640 1 -- 172.21.15.98:0/574178327 learned_addr learned my addr 172.21.15.98:0/574178327 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:21:48.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:48.487+0000 7f92c8fc6640 1 --2- 172.21.15.98:0/574178327 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f92b4004800 0x7f92c40ca640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:48.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:48.487+0000 7f92c3fff640 1 --2- 172.21.15.98:0/574178327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92c41e8680 0x7f92c41f4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:48.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:48.487+0000 7f92c97c7640 1 -- 172.21.15.98:0/574178327 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f92b4004800 msgr2=0x7f92c40ca640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:48.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:48.487+0000 7f92c97c7640 1 --2- 172.21.15.98:0/574178327 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f92b4004800 0x7f92c40ca640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:48.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:48.487+0000 7f92c97c7640 1 -- 172.21.15.98:0/574178327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92c41e8680 msgr2=0x7f92c41f4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:48.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:48.487+0000 7f92c97c7640 1 --2- 172.21.15.98:0/574178327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92c41e8680 0x7f92c41f4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:48.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:48.488+0000 7f92c97c7640 1 -- 172.21.15.98:0/574178327 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92c41f5520 con 0x7f92c415ae30 2024-09-17T05:21:48.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:48.488+0000 7f92c97c7640 1 --2- 172.21.15.98:0/574178327 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f92c415ae30 0x7f92c40b8980 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f92c40d0160 tx=0x7f92bc00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:48.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:48.488+0000 7f92c17fa640 1 -- 172.21.15.98:0/574178327 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92bc003d80 con 0x7f92c415ae30 2024-09-17T05:21:48.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:48.488+0000 7f92c17fa640 1 -- 172.21.15.98:0/574178327 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f92bc004b20 con 0x7f92c415ae30 2024-09-17T05:21:48.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:48.488+0000 7f92c17fa640 1 -- 172.21.15.98:0/574178327 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92bc004030 con 0x7f92c415ae30 2024-09-17T05:21:48.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:48.488+0000 7f92cb22a640 1 -- 172.21.15.98:0/574178327 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92c40cac70 con 0x7f92c415ae30 2024-09-17T05:21:48.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:48.488+0000 7f92cb22a640 1 -- 172.21.15.98:0/574178327 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92c41e7e80 con 0x7f92c415ae30 2024-09-17T05:21:48.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:48.489+0000 7f92cb22a640 1 -- 172.21.15.98:0/574178327 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92c41e7990 con 0x7f92c415ae30 2024-09-17T05:21:48.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:48.489+0000 7f92c17fa640 1 -- 172.21.15.98:0/574178327 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f92bc0041d0 con 0x7f92c415ae30 2024-09-17T05:21:48.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:48.490+0000 7f92c17fa640 1 --2- 172.21.15.98:0/574178327 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f92a8078b90 0x7f92a807b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:48.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:48.490+0000 7f92c17fa640 1 -- 172.21.15.98:0/574178327 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f92bc09b690 con 0x7f92c415ae30 2024-09-17T05:21:48.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:48.490+0000 7f92c8fc6640 1 --2- 172.21.15.98:0/574178327 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f92a8078b90 0x7f92a807b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:48.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:48.490+0000 7f92c8fc6640 1 --2- 172.21.15.98:0/574178327 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f92a8078b90 0x7f92a807b050 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f92b8006fd0 tx=0x7f92b8006b10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:48.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:48.494+0000 7f92c17fa640 1 -- 172.21.15.98:0/574178327 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f92bc020020 con 0x7f92c415ae30 2024-09-17T05:21:48.704 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:48.703+0000 7f92cb22a640 1 -- 172.21.15.98:0/574178327 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f92c40cf730 con 0x7f92c415ae30 2024-09-17T05:21:48.704 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:48.703+0000 7f92c17fa640 1 -- 172.21.15.98:0/574178327 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1431 (secure 0 0 0) 0x7f92bc0638f0 con 0x7f92c415ae30 2024-09-17T05:21:48.705 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:21:48.705 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":2,"btime":"2024-09-17T05:21:48:448142+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4368,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/237112225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":237112225},{"type":"v1","addr":"172.21.15.98:6833","nonce":237112225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-17T05:21:48.705 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 2 2024-09-17T05:21:48.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:48.706+0000 7f92cb22a640 1 -- 172.21.15.98:0/574178327 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f92a8078b90 msgr2=0x7f92a807b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:48.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:48.706+0000 7f92cb22a640 1 --2- 172.21.15.98:0/574178327 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f92a8078b90 0x7f92a807b050 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f92b8006fd0 tx=0x7f92b8006b10 comp rx=0 tx=0).stop 2024-09-17T05:21:48.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:48.706+0000 7f92cb22a640 1 -- 172.21.15.98:0/574178327 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f92c415ae30 msgr2=0x7f92c40b8980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:48.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:48.706+0000 7f92cb22a640 1 --2- 172.21.15.98:0/574178327 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f92c415ae30 0x7f92c40b8980 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f92c40d0160 tx=0x7f92bc00f790 comp rx=0 tx=0).stop 2024-09-17T05:21:48.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:48.706+0000 7f92cb22a640 1 -- 172.21.15.98:0/574178327 shutdown_connections 2024-09-17T05:21:48.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:48.706+0000 7f92cb22a640 1 --2- 172.21.15.98:0/574178327 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f92a8078b90 0x7f92a807b050 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:48.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:48.706+0000 7f92cb22a640 1 --2- 172.21.15.98:0/574178327 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f92c415ae30 0x7f92c40b8980 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:48.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:48.706+0000 7f92cb22a640 1 --2- 172.21.15.98:0/574178327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92c41e8680 0x7f92c41f4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:48.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:48.706+0000 7f92cb22a640 1 --2- 172.21.15.98:0/574178327 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f92b4004800 0x7f92c40ca640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:48.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:48.706+0000 7f92cb22a640 1 -- 172.21.15.98:0/574178327 >> 172.21.15.98:0/574178327 conn(0x7f92c40d3fe0 msgr2=0x7f92c406d560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:48.708 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:48.706+0000 7f92cb22a640 1 -- 172.21.15.98:0/574178327 shutdown_connections 2024-09-17T05:21:48.708 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:48.706+0000 7f92cb22a640 1 -- 172.21.15.98:0/574178327 wait complete. 2024-09-17T05:21:50.718 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:21:50.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:50.831+0000 7f07d4c52640 1 -- 172.21.15.98:0/2778151138 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07d015e0d0 msgr2=0x7f07d00d09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:50.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:50.831+0000 7f07d4c52640 1 --2- 172.21.15.98:0/2778151138 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07d015e0d0 0x7f07d00d09c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f07c0005fd0 tx=0x7f07c002a8b0 comp rx=0 tx=0).stop 2024-09-17T05:21:50.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:50.831+0000 7f07d4c52640 1 -- 172.21.15.98:0/2778151138 shutdown_connections 2024-09-17T05:21:50.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:50.831+0000 7f07d4c52640 1 --2- 172.21.15.98:0/2778151138 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f07d00d2050 0x7f07d00d0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:50.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:50.831+0000 7f07d4c52640 1 --2- 172.21.15.98:0/2778151138 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07d015e0d0 0x7f07d00d09c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:50.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:50.831+0000 7f07d4c52640 1 -- 172.21.15.98:0/2778151138 >> 172.21.15.98:0/2778151138 conn(0x7f07d00d3fe0 msgr2=0x7f07d00d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:50.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:50.831+0000 7f07d4c52640 1 -- 172.21.15.98:0/2778151138 shutdown_connections 2024-09-17T05:21:50.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:50.831+0000 7f07d4c52640 1 -- 172.21.15.98:0/2778151138 wait complete. 2024-09-17T05:21:50.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:50.832+0000 7f07d4c52640 1 Processor -- start 2024-09-17T05:21:50.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:50.832+0000 7f07d4c52640 1 -- start start 2024-09-17T05:21:50.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:50.833+0000 7f07d4c52640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f07d00d1440 0x7f07d014cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:50.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:50.833+0000 7f07d4c52640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f07d00d2050 0x7f07d014fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:50.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:50.833+0000 7f07d4c52640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07d015e0d0 0x7f07d00cd880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:50.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:50.833+0000 7f07d4c52640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f07d015ebc0 con 0x7f07d00d1440 2024-09-17T05:21:50.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:50.833+0000 7f07d4c52640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f07d00cfee0 con 0x7f07d015e0d0 2024-09-17T05:21:50.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:50.833+0000 7f07d4c52640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f07d015ed40 con 0x7f07d00d2050 2024-09-17T05:21:50.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:50.833+0000 7f07ce59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f07d00d1440 0x7f07d014cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:50.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:50.833+0000 7f07ce59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f07d00d1440 0x7f07d014cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:49988/0 (socket says 172.21.15.98:49988) 2024-09-17T05:21:50.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:50.833+0000 7f07ce59c640 1 -- 172.21.15.98:0/1433927128 learned_addr learned my addr 172.21.15.98:0/1433927128 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:21:50.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:50.833+0000 7f07cdd9b640 1 --2- 172.21.15.98:0/1433927128 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f07d00d2050 0x7f07d014fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:50.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:50.833+0000 7f07ced9d640 1 --2- 172.21.15.98:0/1433927128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07d015e0d0 0x7f07d00cd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:50.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:50.834+0000 7f07ce59c640 1 -- 172.21.15.98:0/1433927128 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f07d00d2050 msgr2=0x7f07d014fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:50.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:50.834+0000 7f07ce59c640 1 --2- 172.21.15.98:0/1433927128 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f07d00d2050 0x7f07d014fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:50.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:50.834+0000 7f07ce59c640 1 -- 172.21.15.98:0/1433927128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07d015e0d0 msgr2=0x7f07d00cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:50.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:50.834+0000 7f07ce59c640 1 --2- 172.21.15.98:0/1433927128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07d015e0d0 0x7f07d00cd880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:50.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:50.834+0000 7f07ce59c640 1 -- 172.21.15.98:0/1433927128 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07d0153520 con 0x7f07d00d1440 2024-09-17T05:21:50.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:50.834+0000 7f07ce59c640 1 --2- 172.21.15.98:0/1433927128 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f07d00d1440 0x7f07d014cd90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f07c0009cd0 tx=0x7f07c00316f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:50.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:50.834+0000 7f07c6ffd640 1 -- 172.21.15.98:0/1433927128 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07c0031990 con 0x7f07d00d1440 2024-09-17T05:21:50.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:50.834+0000 7f07c6ffd640 1 -- 172.21.15.98:0/1433927128 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f07c0031c20 con 0x7f07d00d1440 2024-09-17T05:21:50.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:50.834+0000 7f07c6ffd640 1 -- 172.21.15.98:0/1433927128 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07c00330d0 con 0x7f07d00d1440 2024-09-17T05:21:50.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:50.834+0000 7f07d4c52640 1 -- 172.21.15.98:0/1433927128 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07d00a1830 con 0x7f07d00d1440 2024-09-17T05:21:50.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:50.834+0000 7f07d4c52640 1 -- 172.21.15.98:0/1433927128 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07d014d8c0 con 0x7f07d00d1440 2024-09-17T05:21:50.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:50.835+0000 7f07d4c52640 1 -- 172.21.15.98:0/1433927128 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07d015f260 con 0x7f07d00d1440 2024-09-17T05:21:50.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:50.835+0000 7f07c6ffd640 1 -- 172.21.15.98:0/1433927128 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f07c0033270 con 0x7f07d00d1440 2024-09-17T05:21:50.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:50.836+0000 7f07c6ffd640 1 --2- 172.21.15.98:0/1433927128 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f07b0078b90 0x7f07b007b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:50.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:50.836+0000 7f07c6ffd640 1 -- 172.21.15.98:0/1433927128 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f07c00bbbb0 con 0x7f07d00d1440 2024-09-17T05:21:50.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:50.836+0000 7f07cdd9b640 1 --2- 172.21.15.98:0/1433927128 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f07b0078b90 0x7f07b007b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:50.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:50.837+0000 7f07cdd9b640 1 --2- 172.21.15.98:0/1433927128 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f07b0078b90 0x7f07b007b050 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f07b80095f0 tx=0x7f07b8005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:50.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:50.840+0000 7f07c6ffd640 1 -- 172.21.15.98:0/1433927128 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f07c003f030 con 0x7f07d00d1440 2024-09-17T05:21:51.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.052+0000 7f07d4c52640 1 -- 172.21.15.98:0/1433927128 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f07d014d670 con 0x7f07d00d1440 2024-09-17T05:21:51.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.053+0000 7f07c6ffd640 1 -- 172.21.15.98:0/1433927128 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3906 (secure 0 0 0) 0x7f07c0083d90 con 0x7f07d00d1440 2024-09-17T05:21:51.054 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:21:51.054 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":3,"btime":"2024-09-17T05:21:49:449310+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4368,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/237112225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":237112225},{"type":"v1","addr":"172.21.15.98:6833","nonce":237112225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4377,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/4042308128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":4042308128},{"type":"v1","addr":"172.21.15.98:6835","nonce":4042308128}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4378,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/313781530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":313781530},{"type":"v1","addr":"172.21.15.167:6836","nonce":313781530}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4386,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/4171766128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":4171766128},{"type":"v1","addr":"172.21.15.167:6837","nonce":4171766128}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-17T05:21:51.054 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 3 2024-09-17T05:21:51.056 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.055+0000 7f07d4c52640 1 -- 172.21.15.98:0/1433927128 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f07b0078b90 msgr2=0x7f07b007b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:51.056 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.055+0000 7f07d4c52640 1 --2- 172.21.15.98:0/1433927128 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f07b0078b90 0x7f07b007b050 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f07b80095f0 tx=0x7f07b8005f90 comp rx=0 tx=0).stop 2024-09-17T05:21:51.056 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.055+0000 7f07d4c52640 1 -- 172.21.15.98:0/1433927128 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f07d00d1440 msgr2=0x7f07d014cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:51.056 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.055+0000 7f07d4c52640 1 --2- 172.21.15.98:0/1433927128 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f07d00d1440 0x7f07d014cd90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f07c0009cd0 tx=0x7f07c00316f0 comp rx=0 tx=0).stop 2024-09-17T05:21:51.056 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.055+0000 7f07d4c52640 1 -- 172.21.15.98:0/1433927128 shutdown_connections 2024-09-17T05:21:51.056 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.055+0000 7f07d4c52640 1 --2- 172.21.15.98:0/1433927128 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f07b0078b90 0x7f07b007b050 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:51.056 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.055+0000 7f07d4c52640 1 --2- 172.21.15.98:0/1433927128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07d015e0d0 0x7f07d00cd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:51.057 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.055+0000 7f07d4c52640 1 --2- 172.21.15.98:0/1433927128 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f07d00d2050 0x7f07d014fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:51.057 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.055+0000 7f07d4c52640 1 --2- 172.21.15.98:0/1433927128 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f07d00d1440 0x7f07d014cd90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:51.057 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.055+0000 7f07d4c52640 1 -- 172.21.15.98:0/1433927128 >> 172.21.15.98:0/1433927128 conn(0x7f07d00d3fe0 msgr2=0x7f07d00b62d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:51.057 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.055+0000 7f07d4c52640 1 -- 172.21.15.98:0/1433927128 shutdown_connections 2024-09-17T05:21:51.057 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.055+0000 7f07d4c52640 1 -- 172.21.15.98:0/1433927128 wait complete. 2024-09-17T05:21:51.066 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T05:21:51.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.166+0000 7f5bb61ca640 1 -- 172.21.15.98:0/35471160 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5bb0073fb0 msgr2=0x7f5bb0074460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:51.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.166+0000 7f5bb61ca640 1 --2- 172.21.15.98:0/35471160 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5bb0073fb0 0x7f5bb0074460 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8005fd0 tx=0x7f5ba802a820 comp rx=0 tx=0).stop 2024-09-17T05:21:51.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.166+0000 7f5bb61ca640 1 -- 172.21.15.98:0/35471160 shutdown_connections 2024-09-17T05:21:51.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.166+0000 7f5bb61ca640 1 --2- 172.21.15.98:0/35471160 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5bb0073fb0 0x7f5bb0074460 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:51.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.166+0000 7f5bb61ca640 1 --2- 172.21.15.98:0/35471160 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5bb015f5a0 0x7f5bb00b2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:51.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.166+0000 7f5bb61ca640 1 -- 172.21.15.98:0/35471160 >> 172.21.15.98:0/35471160 conn(0x7f5bb00b1950 msgr2=0x7f5bb00b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:51.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.166+0000 7f5bb61ca640 1 -- 172.21.15.98:0/35471160 shutdown_connections 2024-09-17T05:21:51.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.166+0000 7f5bb61ca640 1 -- 172.21.15.98:0/35471160 wait complete. 2024-09-17T05:21:51.168 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.167+0000 7f5bb61ca640 1 Processor -- start 2024-09-17T05:21:51.168 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.167+0000 7f5bb61ca640 1 -- start start 2024-09-17T05:21:51.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.168+0000 7f5bb61ca640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5bb0073fb0 0x7f5bb014cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:51.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.168+0000 7f5bb61ca640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5bb00ccf00 0x7f5bb0150bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:51.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.168+0000 7f5bb61ca640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5bb015f5a0 0x7f5bb014ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:51.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.168+0000 7f5bb61ca640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb006f2e0 con 0x7f5bb015f5a0 2024-09-17T05:21:51.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.168+0000 7f5bb61ca640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb006f160 con 0x7f5bb00ccf00 2024-09-17T05:21:51.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.168+0000 7f5bb61ca640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f5bb006f460 con 0x7f5bb0073fb0 2024-09-17T05:21:51.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.168+0000 7f5baffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5bb015f5a0 0x7f5bb014ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:51.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.168+0000 7f5baffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5bb015f5a0 0x7f5bb014ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:50016/0 (socket says 172.21.15.98:50016) 2024-09-17T05:21:51.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.168+0000 7f5baffff640 1 -- 172.21.15.98:0/3274539453 learned_addr learned my addr 172.21.15.98:0/3274539453 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:21:51.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.168+0000 7f5baffff640 1 -- 172.21.15.98:0/3274539453 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5bb0073fb0 msgr2=0x7f5bb014cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:51.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.168+0000 7f5baffff640 1 --2- 172.21.15.98:0/3274539453 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5bb0073fb0 0x7f5bb014cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:51.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.168+0000 7f5baffff640 1 -- 172.21.15.98:0/3274539453 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5bb00ccf00 msgr2=0x7f5bb0150bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:51.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.168+0000 7f5baeffd640 1 --2- 172.21.15.98:0/3274539453 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5bb00ccf00 0x7f5bb0150bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:51.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.168+0000 7f5baffff640 1 --2- 172.21.15.98:0/3274539453 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5bb00ccf00 0x7f5bb0150bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:51.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.168+0000 7f5baffff640 1 -- 172.21.15.98:0/3274539453 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bb014d6f0 con 0x7f5bb015f5a0 2024-09-17T05:21:51.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.168+0000 7f5baffff640 1 --2- 172.21.15.98:0/3274539453 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5bb015f5a0 0x7f5bb014ee70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8006010 tx=0x7f5ba8032c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:51.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.168+0000 7f5b97fff640 1 -- 172.21.15.98:0/3274539453 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba8037040 con 0x7f5bb015f5a0 2024-09-17T05:21:51.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.168+0000 7f5b97fff640 1 -- 172.21.15.98:0/3274539453 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5ba8042070 con 0x7f5bb015f5a0 2024-09-17T05:21:51.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.168+0000 7f5bb61ca640 1 -- 172.21.15.98:0/3274539453 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bb0153a70 con 0x7f5bb015f5a0 2024-09-17T05:21:51.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.168+0000 7f5b97fff640 1 -- 172.21.15.98:0/3274539453 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba80042a0 con 0x7f5bb015f5a0 2024-09-17T05:21:51.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.169+0000 7f5bb61ca640 1 -- 172.21.15.98:0/3274539453 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bb014dc70 con 0x7f5bb015f5a0 2024-09-17T05:21:51.172 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.170+0000 7f5bb61ca640 1 -- 172.21.15.98:0/3274539453 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bb0154910 con 0x7f5bb015f5a0 2024-09-17T05:21:51.172 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.170+0000 7f5b97fff640 1 -- 172.21.15.98:0/3274539453 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5ba8004440 con 0x7f5bb015f5a0 2024-09-17T05:21:51.172 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.171+0000 7f5b97fff640 1 --2- 172.21.15.98:0/3274539453 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f5b9c078b90 0x7f5b9c07b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:51.173 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.171+0000 7f5b97fff640 1 -- 172.21.15.98:0/3274539453 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f5ba80bb690 con 0x7f5bb015f5a0 2024-09-17T05:21:51.173 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.171+0000 7f5baf7fe640 1 --2- 172.21.15.98:0/3274539453 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f5b9c078b90 0x7f5b9c07b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:51.173 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.171+0000 7f5baf7fe640 1 --2- 172.21.15.98:0/3274539453 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f5b9c078b90 0x7f5b9c07b050 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5ba000a860 tx=0x7f5ba0005b50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:51.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.175+0000 7f5b97fff640 1 -- 172.21.15.98:0/3274539453 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f5bb0154910 con 0x7f5bb015f5a0 2024-09-17T05:21:51.358 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.357+0000 7f5bb61ca640 1 -- 172.21.15.98:0/3274539453 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f5bb006f990 con 0x7f5bb015f5a0 2024-09-17T05:21:51.358 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.357+0000 7f5b97fff640 1 -- 172.21.15.98:0/3274539453 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7f5ba8083f40 con 0x7f5bb015f5a0 2024-09-17T05:21:51.358 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:21:51.358 INFO:teuthology.orchestra.run.smithi098.stdout:[ 2024-09-17T05:21:51.358 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:21:51.358 INFO:teuthology.orchestra.run.smithi098.stdout: "poolnum": 1, 2024-09-17T05:21:51.358 INFO:teuthology.orchestra.run.smithi098.stdout: "poolname": ".mgr" 2024-09-17T05:21:51.358 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:21:51.358 INFO:teuthology.orchestra.run.smithi098.stdout:] 2024-09-17T05:21:51.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.359+0000 7f5bb61ca640 1 -- 172.21.15.98:0/3274539453 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f5b9c078b90 msgr2=0x7f5b9c07b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:51.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.359+0000 7f5bb61ca640 1 --2- 172.21.15.98:0/3274539453 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f5b9c078b90 0x7f5b9c07b050 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5ba000a860 tx=0x7f5ba0005b50 comp rx=0 tx=0).stop 2024-09-17T05:21:51.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.359+0000 7f5bb61ca640 1 -- 172.21.15.98:0/3274539453 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5bb015f5a0 msgr2=0x7f5bb014ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:51.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.359+0000 7f5bb61ca640 1 --2- 172.21.15.98:0/3274539453 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5bb015f5a0 0x7f5bb014ee70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8006010 tx=0x7f5ba8032c90 comp rx=0 tx=0).stop 2024-09-17T05:21:51.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.359+0000 7f5bb61ca640 1 -- 172.21.15.98:0/3274539453 shutdown_connections 2024-09-17T05:21:51.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.359+0000 7f5bb61ca640 1 --2- 172.21.15.98:0/3274539453 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f5b9c078b90 0x7f5b9c07b050 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:51.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.359+0000 7f5bb61ca640 1 --2- 172.21.15.98:0/3274539453 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5bb015f5a0 0x7f5bb014ee70 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:51.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.359+0000 7f5bb61ca640 1 --2- 172.21.15.98:0/3274539453 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5bb00ccf00 0x7f5bb0150bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:51.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.359+0000 7f5bb61ca640 1 --2- 172.21.15.98:0/3274539453 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5bb0073fb0 0x7f5bb014cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:51.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.359+0000 7f5bb61ca640 1 -- 172.21.15.98:0/3274539453 >> 172.21.15.98:0/3274539453 conn(0x7f5bb00b1950 msgr2=0x7f5bb009bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:51.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.359+0000 7f5bb61ca640 1 -- 172.21.15.98:0/3274539453 shutdown_connections 2024-09-17T05:21:51.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.359+0000 7f5bb61ca640 1 -- 172.21.15.98:0/3274539453 wait complete. 2024-09-17T05:21:51.371 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T05:21:51.371 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T05:21:51.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.477+0000 7fa671f75640 1 -- 172.21.15.98:0/4171907260 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa66c0aea80 msgr2=0x7fa66c0aef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:51.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.477+0000 7fa671f75640 1 --2- 172.21.15.98:0/4171907260 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa66c0aea80 0x7fa66c0aef10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa664005fd0 tx=0x7fa66402a8b0 comp rx=0 tx=0).stop 2024-09-17T05:21:51.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.477+0000 7fa671f75640 1 -- 172.21.15.98:0/4171907260 shutdown_connections 2024-09-17T05:21:51.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.477+0000 7fa671f75640 1 --2- 172.21.15.98:0/4171907260 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa66c0aea80 0x7fa66c0aef10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:51.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.477+0000 7fa671f75640 1 --2- 172.21.15.98:0/4171907260 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa66c0d0410 0x7fa66c0d2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:51.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.477+0000 7fa671f75640 1 -- 172.21.15.98:0/4171907260 >> 172.21.15.98:0/4171907260 conn(0x7fa66c0d1e30 msgr2=0x7fa66c0d2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:51.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.477+0000 7fa671f75640 1 -- 172.21.15.98:0/4171907260 shutdown_connections 2024-09-17T05:21:51.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.477+0000 7fa671f75640 1 -- 172.21.15.98:0/4171907260 wait complete. 2024-09-17T05:21:51.479 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.478+0000 7fa671f75640 1 Processor -- start 2024-09-17T05:21:51.479 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.478+0000 7fa671f75640 1 -- start start 2024-09-17T05:21:51.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.479+0000 7fa671f75640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa66c0aea80 0x7fa66c0c7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:51.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.479+0000 7fa671f75640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa66c0b0ef0 0x7fa66c1544b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:51.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.479+0000 7fa671f75640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa66c0d0410 0x7fa66c0d2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:51.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.479+0000 7fa671f75640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa66c0af5d0 con 0x7fa66c0aea80 2024-09-17T05:21:51.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.479+0000 7fa671f75640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa66c0af450 con 0x7fa66c0b0ef0 2024-09-17T05:21:51.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.479+0000 7fa671f75640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fa66c0af750 con 0x7fa66c0d0410 2024-09-17T05:21:51.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.479+0000 7fa66b7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa66c0aea80 0x7fa66c0c7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:51.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.479+0000 7fa66b7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa66c0aea80 0x7fa66c0c7b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:50032/0 (socket says 172.21.15.98:50032) 2024-09-17T05:21:51.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.479+0000 7fa66b7fe640 1 -- 172.21.15.98:0/2824490077 learned_addr learned my addr 172.21.15.98:0/2824490077 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:21:51.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.479+0000 7fa66b7fe640 1 -- 172.21.15.98:0/2824490077 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa66c0d0410 msgr2=0x7fa66c0d2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:51.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.479+0000 7fa66b7fe640 1 --2- 172.21.15.98:0/2824490077 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa66c0d0410 0x7fa66c0d2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:51.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.479+0000 7fa66b7fe640 1 -- 172.21.15.98:0/2824490077 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa66c0b0ef0 msgr2=0x7fa66c1544b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:51.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.479+0000 7fa66b7fe640 1 --2- 172.21.15.98:0/2824490077 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa66c0b0ef0 0x7fa66c1544b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:51.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.479+0000 7fa66b7fe640 1 -- 172.21.15.98:0/2824490077 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa66c0c8110 con 0x7fa66c0aea80 2024-09-17T05:21:51.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.479+0000 7fa66b7fe640 1 --2- 172.21.15.98:0/2824490077 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa66c0aea80 0x7fa66c0c7b30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa65c00b410 tx=0x7fa65c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:51.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.479+0000 7fa668ff9640 1 -- 172.21.15.98:0/2824490077 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa65c015020 con 0x7fa66c0aea80 2024-09-17T05:21:51.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.479+0000 7fa668ff9640 1 -- 172.21.15.98:0/2824490077 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa65c011940 con 0x7fa66c0aea80 2024-09-17T05:21:51.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.479+0000 7fa671f75640 1 -- 172.21.15.98:0/2824490077 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa66c0c83f0 con 0x7fa66c0aea80 2024-09-17T05:21:51.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.479+0000 7fa668ff9640 1 -- 172.21.15.98:0/2824490077 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa65c011d90 con 0x7fa66c0aea80 2024-09-17T05:21:51.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.480+0000 7fa671f75640 1 -- 172.21.15.98:0/2824490077 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa66c153f90 con 0x7fa66c0aea80 2024-09-17T05:21:51.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.480+0000 7fa671f75640 1 -- 172.21.15.98:0/2824490077 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa66c0afc80 con 0x7fa66c0aea80 2024-09-17T05:21:51.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.481+0000 7fa668ff9640 1 -- 172.21.15.98:0/2824490077 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa65c018020 con 0x7fa66c0aea80 2024-09-17T05:21:51.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.481+0000 7fa668ff9640 1 --2- 172.21.15.98:0/2824490077 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fa64c078b90 0x7fa64c07b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:51.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.482+0000 7fa668ff9640 1 -- 172.21.15.98:0/2824490077 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fa65c09a8f0 con 0x7fa66c0aea80 2024-09-17T05:21:51.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.482+0000 7fa662ffd640 1 --2- 172.21.15.98:0/2824490077 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fa64c078b90 0x7fa64c07b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:51.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.482+0000 7fa662ffd640 1 --2- 172.21.15.98:0/2824490077 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fa64c078b90 0x7fa64c07b050 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa66c06cff0 tx=0x7fa654007a30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:51.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.486+0000 7fa668ff9640 1 -- 172.21.15.98:0/2824490077 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fa65c01f020 con 0x7fa66c0aea80 2024-09-17T05:21:51.662 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:51.661+0000 7fa671f75640 1 -- 172.21.15.98:0/2824490077 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fa66c0c85c0 con 0x7fa66c0aea80 2024-09-17T05:21:51.863 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:21:51.865 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:21:52.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:52.466+0000 7fa668ff9640 1 -- 172.21.15.98:0/2824490077 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7fa65c0631a0 con 0x7fa66c0aea80 2024-09-17T05:21:52.467 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_metadata' created 2024-09-17T05:21:52.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:52.468+0000 7fa671f75640 1 -- 172.21.15.98:0/2824490077 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fa64c078b90 msgr2=0x7fa64c07b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:52.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:52.468+0000 7fa671f75640 1 --2- 172.21.15.98:0/2824490077 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fa64c078b90 0x7fa64c07b050 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa66c06cff0 tx=0x7fa654007a30 comp rx=0 tx=0).stop 2024-09-17T05:21:52.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:52.468+0000 7fa671f75640 1 -- 172.21.15.98:0/2824490077 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa66c0aea80 msgr2=0x7fa66c0c7b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:52.470 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:52.468+0000 7fa671f75640 1 --2- 172.21.15.98:0/2824490077 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa66c0aea80 0x7fa66c0c7b30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa65c00b410 tx=0x7fa65c00b8d0 comp rx=0 tx=0).stop 2024-09-17T05:21:52.470 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:52.468+0000 7fa671f75640 1 -- 172.21.15.98:0/2824490077 shutdown_connections 2024-09-17T05:21:52.470 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:52.468+0000 7fa671f75640 1 --2- 172.21.15.98:0/2824490077 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fa64c078b90 0x7fa64c07b050 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:52.470 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:52.468+0000 7fa671f75640 1 --2- 172.21.15.98:0/2824490077 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa66c0d0410 0x7fa66c0d2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:52.470 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:52.468+0000 7fa671f75640 1 --2- 172.21.15.98:0/2824490077 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa66c0b0ef0 0x7fa66c1544b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:52.470 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:52.468+0000 7fa671f75640 1 --2- 172.21.15.98:0/2824490077 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa66c0aea80 0x7fa66c0c7b30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:52.470 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:52.468+0000 7fa671f75640 1 -- 172.21.15.98:0/2824490077 >> 172.21.15.98:0/2824490077 conn(0x7fa66c0d1e30 msgr2=0x7fa66c0709b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:52.470 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:52.468+0000 7fa671f75640 1 -- 172.21.15.98:0/2824490077 shutdown_connections 2024-09-17T05:21:52.470 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:52.468+0000 7fa671f75640 1 -- 172.21.15.98:0/2824490077 wait complete. 2024-09-17T05:21:52.484 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T05:21:52.593 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:52.592+0000 7f732e9a3640 1 -- 172.21.15.98:0/2631278251 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7328161590 msgr2=0x7f73280b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:52.594 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:52.592+0000 7f732e9a3640 1 --2- 172.21.15.98:0/2631278251 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7328161590 0x7f73280b6e00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7318005fd0 tx=0x7f731802a530 comp rx=0 tx=0).stop 2024-09-17T05:21:52.594 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:52.592+0000 7f732e9a3640 1 -- 172.21.15.98:0/2631278251 shutdown_connections 2024-09-17T05:21:52.594 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:52.592+0000 7f732e9a3640 1 --2- 172.21.15.98:0/2631278251 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f73280b7340 0x7f73280d2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:52.594 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:52.592+0000 7f732e9a3640 1 --2- 172.21.15.98:0/2631278251 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7328161590 0x7f73280b6e00 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:52.594 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:52.592+0000 7f732e9a3640 1 -- 172.21.15.98:0/2631278251 >> 172.21.15.98:0/2631278251 conn(0x7f73280d3fb0 msgr2=0x7f73280d43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:52.594 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:52.592+0000 7f732e9a3640 1 -- 172.21.15.98:0/2631278251 shutdown_connections 2024-09-17T05:21:52.594 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:52.592+0000 7f732e9a3640 1 -- 172.21.15.98:0/2631278251 wait complete. 2024-09-17T05:21:52.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:52.593+0000 7f732e9a3640 1 Processor -- start 2024-09-17T05:21:52.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:52.594+0000 7f732e9a3640 1 -- start start 2024-09-17T05:21:52.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:52.594+0000 7f732e9a3640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f73280b5630 0x7f732815da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:52.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:52.594+0000 7f732e9a3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73280b7340 0x7f73280c7780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:52.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:52.594+0000 7f732e9a3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7328161590 0x7f7328154320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:52.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:52.594+0000 7f732e9a3640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f73280d2570 con 0x7f7328161590 2024-09-17T05:21:52.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:52.594+0000 7f732e9a3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f73280cfed0 con 0x7f73280b7340 2024-09-17T05:21:52.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:52.594+0000 7f732e9a3640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f73280d26f0 con 0x7f73280b5630 2024-09-17T05:21:52.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:52.594+0000 7f732cf40640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7328161590 0x7f7328154320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:52.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:52.594+0000 7f732cf40640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7328161590 0x7f7328154320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:50048/0 (socket says 172.21.15.98:50048) 2024-09-17T05:21:52.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:52.594+0000 7f732cf40640 1 -- 172.21.15.98:0/3359468978 learned_addr learned my addr 172.21.15.98:0/3359468978 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:21:52.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:52.594+0000 7f7327fff640 1 --2- 172.21.15.98:0/3359468978 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f73280b5630 0x7f732815da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:52.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:52.594+0000 7f73277fe640 1 --2- 172.21.15.98:0/3359468978 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73280b7340 0x7f73280c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:52.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:52.595+0000 7f732cf40640 1 -- 172.21.15.98:0/3359468978 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f73280b5630 msgr2=0x7f732815da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:52.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:52.595+0000 7f732cf40640 1 --2- 172.21.15.98:0/3359468978 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f73280b5630 0x7f732815da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:52.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:52.595+0000 7f732cf40640 1 -- 172.21.15.98:0/3359468978 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73280b7340 msgr2=0x7f73280c7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:52.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:52.595+0000 7f732cf40640 1 --2- 172.21.15.98:0/3359468978 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73280b7340 0x7f73280c7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:52.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:52.595+0000 7f732cf40640 1 -- 172.21.15.98:0/3359468978 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73280c7e10 con 0x7f7328161590 2024-09-17T05:21:52.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:52.595+0000 7f732cf40640 1 --2- 172.21.15.98:0/3359468978 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7328161590 0x7f7328154320 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f732000ea00 tx=0x7f732000eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:52.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:52.595+0000 7f7324ff9640 1 -- 172.21.15.98:0/3359468978 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f732000cd80 con 0x7f7328161590 2024-09-17T05:21:52.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:52.595+0000 7f7324ff9640 1 -- 172.21.15.98:0/3359468978 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7320004c30 con 0x7f7328161590 2024-09-17T05:21:52.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:52.595+0000 7f732e9a3640 1 -- 172.21.15.98:0/3359468978 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73280c80f0 con 0x7f7328161590 2024-09-17T05:21:52.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:52.595+0000 7f7324ff9640 1 -- 172.21.15.98:0/3359468978 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7320005280 con 0x7f7328161590 2024-09-17T05:21:52.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:52.595+0000 7f732e9a3640 1 -- 172.21.15.98:0/3359468978 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73280c86b0 con 0x7f7328161590 2024-09-17T05:21:52.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:52.596+0000 7f732e9a3640 1 -- 172.21.15.98:0/3359468978 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73280d2030 con 0x7f7328161590 2024-09-17T05:21:52.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:52.597+0000 7f7324ff9640 1 -- 172.21.15.98:0/3359468978 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7320005420 con 0x7f7328161590 2024-09-17T05:21:52.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:52.597+0000 7f7324ff9640 1 --2- 172.21.15.98:0/3359468978 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f7314078b90 0x7f731407b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:52.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:52.597+0000 7f7324ff9640 1 -- 172.21.15.98:0/3359468978 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7f732009b400 con 0x7f7328161590 2024-09-17T05:21:52.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:52.597+0000 7f7327fff640 1 --2- 172.21.15.98:0/3359468978 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f7314078b90 0x7f731407b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:52.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:52.598+0000 7f7327fff640 1 --2- 172.21.15.98:0/3359468978 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f7314078b90 0x7f731407b050 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7318033000 tx=0x7f7318004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:52.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:52.601+0000 7f7324ff9640 1 -- 172.21.15.98:0/3359468978 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f7320016030 con 0x7f7328161590 2024-09-17T05:21:52.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:52.776+0000 7f732e9a3640 1 -- 172.21.15.98:0/3359468978 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f73280a0a60 con 0x7f7328161590 2024-09-17T05:21:53.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:53.468+0000 7f7324ff9640 1 -- 172.21.15.98:0/3359468978 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) ==== 170+0+0 (secure 0 0 0) 0x7f7320063460 con 0x7f7328161590 2024-09-17T05:21:53.469 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_data' created 2024-09-17T05:21:53.471 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:53.470+0000 7f732e9a3640 1 -- 172.21.15.98:0/3359468978 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f7314078b90 msgr2=0x7f731407b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:53.471 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:53.470+0000 7f732e9a3640 1 --2- 172.21.15.98:0/3359468978 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f7314078b90 0x7f731407b050 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7318033000 tx=0x7f7318004730 comp rx=0 tx=0).stop 2024-09-17T05:21:53.471 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:53.470+0000 7f732e9a3640 1 -- 172.21.15.98:0/3359468978 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7328161590 msgr2=0x7f7328154320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:53.471 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:53.470+0000 7f732e9a3640 1 --2- 172.21.15.98:0/3359468978 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7328161590 0x7f7328154320 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f732000ea00 tx=0x7f732000eec0 comp rx=0 tx=0).stop 2024-09-17T05:21:53.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:53.470+0000 7f732e9a3640 1 -- 172.21.15.98:0/3359468978 shutdown_connections 2024-09-17T05:21:53.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:53.470+0000 7f732e9a3640 1 --2- 172.21.15.98:0/3359468978 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f7314078b90 0x7f731407b050 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:53.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:53.470+0000 7f732e9a3640 1 --2- 172.21.15.98:0/3359468978 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7328161590 0x7f7328154320 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:53.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:53.470+0000 7f732e9a3640 1 --2- 172.21.15.98:0/3359468978 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73280b7340 0x7f73280c7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:53.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:53.470+0000 7f732e9a3640 1 --2- 172.21.15.98:0/3359468978 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f73280b5630 0x7f732815da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:53.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:53.470+0000 7f732e9a3640 1 -- 172.21.15.98:0/3359468978 >> 172.21.15.98:0/3359468978 conn(0x7f73280d3fb0 msgr2=0x7f73280b97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:53.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:53.470+0000 7f732e9a3640 1 -- 172.21.15.98:0/3359468978 shutdown_connections 2024-09-17T05:21:53.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:53.471+0000 7f732e9a3640 1 -- 172.21.15.98:0/3359468978 wait complete. 2024-09-17T05:21:53.497 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T05:21:53.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:53.602+0000 7fac7f5a3640 1 -- 172.21.15.98:0/284988221 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fac60004800 msgr2=0x7fac60004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:53.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:53.602+0000 7fac7f5a3640 1 --2- 172.21.15.98:0/284988221 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fac60004800 0x7fac60004c80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fac6c009b50 tx=0x7fac60005830 comp rx=0 tx=0).stop 2024-09-17T05:21:53.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:53.602+0000 7fac7f5a3640 1 -- 172.21.15.98:0/284988221 shutdown_connections 2024-09-17T05:21:53.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:53.602+0000 7fac7f5a3640 1 --2- 172.21.15.98:0/284988221 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fac60004800 0x7fac60004c80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:53.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:53.602+0000 7fac7f5a3640 1 -- 172.21.15.98:0/284988221 >> 172.21.15.98:0/284988221 conn(0x7fac780b2130 msgr2=0x7fac780b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:53.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:53.602+0000 7fac7f5a3640 1 -- 172.21.15.98:0/284988221 shutdown_connections 2024-09-17T05:21:53.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:53.602+0000 7fac7f5a3640 1 -- 172.21.15.98:0/284988221 wait complete. 2024-09-17T05:21:53.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:53.604+0000 7fac7f5a3640 1 Processor -- start 2024-09-17T05:21:53.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:53.604+0000 7fac7f5a3640 1 -- start start 2024-09-17T05:21:53.606 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:53.604+0000 7fac7f5a3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fac60004800 0x7fac78156d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:53.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:53.604+0000 7fac7f5a3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac7815b470 0x7fac78150bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:53.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:53.604+0000 7fac7f5a3640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac7815b8f0 0x7fac78151100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:53.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:53.604+0000 7fac7f5a3640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fac780b35b0 con 0x7fac60004800 2024-09-17T05:21:53.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:53.604+0000 7fac7f5a3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fac780b3430 con 0x7fac7815b470 2024-09-17T05:21:53.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:53.604+0000 7fac7f5a3640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fac780b3730 con 0x7fac7815b8f0 2024-09-17T05:21:53.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:53.604+0000 7fac7d33f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fac60004800 0x7fac78156d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:53.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:53.604+0000 7fac7d33f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fac60004800 0x7fac78156d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:50064/0 (socket says 172.21.15.98:50064) 2024-09-17T05:21:53.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:53.604+0000 7fac7d33f640 1 -- 172.21.15.98:0/1658861817 learned_addr learned my addr 172.21.15.98:0/1658861817 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:21:53.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:53.605+0000 7fac7db40640 1 --2- 172.21.15.98:0/1658861817 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac7815b8f0 0x7fac78151100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:53.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:53.605+0000 7fac7cb3e640 1 --2- 172.21.15.98:0/1658861817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac7815b470 0x7fac78150bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:53.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:53.605+0000 7fac7d33f640 1 -- 172.21.15.98:0/1658861817 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac7815b8f0 msgr2=0x7fac78151100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:53.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:53.605+0000 7fac7d33f640 1 --2- 172.21.15.98:0/1658861817 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac7815b8f0 0x7fac78151100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:53.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:53.605+0000 7fac7d33f640 1 -- 172.21.15.98:0/1658861817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac7815b470 msgr2=0x7fac78150bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:53.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:53.605+0000 7fac7d33f640 1 --2- 172.21.15.98:0/1658861817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac7815b470 0x7fac78150bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:53.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:53.605+0000 7fac7d33f640 1 -- 172.21.15.98:0/1658861817 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac781f4a60 con 0x7fac60004800 2024-09-17T05:21:53.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:53.605+0000 7fac7d33f640 1 --2- 172.21.15.98:0/1658861817 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fac60004800 0x7fac78156d40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fac6800e900 tx=0x7fac6800edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:53.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:53.605+0000 7fac75ffb640 1 -- 172.21.15.98:0/1658861817 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac68015070 con 0x7fac60004800 2024-09-17T05:21:53.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:53.605+0000 7fac75ffb640 1 -- 172.21.15.98:0/1658861817 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fac6800cd10 con 0x7fac60004800 2024-09-17T05:21:53.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:53.605+0000 7fac75ffb640 1 -- 172.21.15.98:0/1658861817 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac680116c0 con 0x7fac60004800 2024-09-17T05:21:53.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:53.605+0000 7fac7f5a3640 1 -- 172.21.15.98:0/1658861817 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac781f4d40 con 0x7fac60004800 2024-09-17T05:21:53.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:53.605+0000 7fac7f5a3640 1 -- 172.21.15.98:0/1658861817 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac781f5300 con 0x7fac60004800 2024-09-17T05:21:53.609 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:53.606+0000 7fac7f5a3640 1 -- 172.21.15.98:0/1658861817 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac78070a70 con 0x7fac60004800 2024-09-17T05:21:53.609 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:53.607+0000 7fac75ffb640 1 -- 172.21.15.98:0/1658861817 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fac68018070 con 0x7fac60004800 2024-09-17T05:21:53.609 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:53.607+0000 7fac75ffb640 1 --2- 172.21.15.98:0/1658861817 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fac64078b90 0x7fac6407b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:53.609 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:53.607+0000 7fac75ffb640 1 -- 172.21.15.98:0/1658861817 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7fac6809b2a0 con 0x7fac60004800 2024-09-17T05:21:53.609 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:53.607+0000 7fac7cb3e640 1 --2- 172.21.15.98:0/1658861817 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fac64078b90 0x7fac6407b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:53.609 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:53.608+0000 7fac7cb3e640 1 --2- 172.21.15.98:0/1658861817 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fac64078b90 0x7fac6407b050 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fac6c035000 tx=0x7fac6c0046c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:53.612 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:53.612+0000 7fac75ffb640 1 -- 172.21.15.98:0/1658861817 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fac68063210 con 0x7fac60004800 2024-09-17T05:21:53.825 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:53.825+0000 7fac7f5a3640 1 -- 172.21.15.98:0/1658861817 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fac78161380 con 0x7fac60004800 2024-09-17T05:21:54.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.491+0000 7fac75ffb640 1 -- 172.21.15.98:0/1658861817 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fac68067c40 con 0x7fac60004800 2024-09-17T05:21:54.492 INFO:teuthology.orchestra.run.smithi098.stderr:new fs with metadata pool 2 and data pool 3 2024-09-17T05:21:54.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.498+0000 7fac7f5a3640 1 -- 172.21.15.98:0/1658861817 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fac64078b90 msgr2=0x7fac6407b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:54.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.498+0000 7fac7f5a3640 1 --2- 172.21.15.98:0/1658861817 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fac64078b90 0x7fac6407b050 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fac6c035000 tx=0x7fac6c0046c0 comp rx=0 tx=0).stop 2024-09-17T05:21:54.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.498+0000 7fac7f5a3640 1 -- 172.21.15.98:0/1658861817 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fac60004800 msgr2=0x7fac78156d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:54.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.498+0000 7fac7f5a3640 1 --2- 172.21.15.98:0/1658861817 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fac60004800 0x7fac78156d40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fac6800e900 tx=0x7fac6800edc0 comp rx=0 tx=0).stop 2024-09-17T05:21:54.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.502+0000 7fac7f5a3640 1 -- 172.21.15.98:0/1658861817 shutdown_connections 2024-09-17T05:21:54.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.502+0000 7fac7f5a3640 1 --2- 172.21.15.98:0/1658861817 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fac64078b90 0x7fac6407b050 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:54.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.502+0000 7fac7f5a3640 1 --2- 172.21.15.98:0/1658861817 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac7815b8f0 0x7fac78151100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:54.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.502+0000 7fac7f5a3640 1 --2- 172.21.15.98:0/1658861817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac7815b470 0x7fac78150bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:54.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.502+0000 7fac7f5a3640 1 --2- 172.21.15.98:0/1658861817 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fac60004800 0x7fac78156d40 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:54.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.502+0000 7fac7f5a3640 1 -- 172.21.15.98:0/1658861817 >> 172.21.15.98:0/1658861817 conn(0x7fac780b2130 msgr2=0x7fac7806f050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:54.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.503+0000 7fac7f5a3640 1 -- 172.21.15.98:0/1658861817 shutdown_connections 2024-09-17T05:21:54.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.503+0000 7fac7f5a3640 1 -- 172.21.15.98:0/1658861817 wait complete. 2024-09-17T05:21:54.523 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:21:54.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.627+0000 7f1dd71df640 1 -- 172.21.15.98:0/977725838 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1dd015ac00 msgr2=0x7f1dd00cf830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:54.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.627+0000 7f1dd71df640 1 --2- 172.21.15.98:0/977725838 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1dd015ac00 0x7f1dd00cf830 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1dd0074bc0 tx=0x7f1dc002a560 comp rx=0 tx=0).stop 2024-09-17T05:21:54.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.627+0000 7f1dd71df640 1 -- 172.21.15.98:0/977725838 shutdown_connections 2024-09-17T05:21:54.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.627+0000 7f1dd71df640 1 --2- 172.21.15.98:0/977725838 >> v2:172.21.15.167:3300/0 conn(0x7f1dd00ce910 0x7f1dd0073790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:54.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.627+0000 7f1dd71df640 1 --2- 172.21.15.98:0/977725838 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1dd015ac00 0x7f1dd00cf830 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:54.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.627+0000 7f1dd71df640 1 -- 172.21.15.98:0/977725838 >> 172.21.15.98:0/977725838 conn(0x7f1dd00d0d40 msgr2=0x7f1dd00d1120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:54.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.627+0000 7f1dd71df640 1 -- 172.21.15.98:0/977725838 shutdown_connections 2024-09-17T05:21:54.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.627+0000 7f1dd71df640 1 -- 172.21.15.98:0/977725838 wait complete. 2024-09-17T05:21:54.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.628+0000 7f1dd71df640 1 Processor -- start 2024-09-17T05:21:54.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.628+0000 7f1dd71df640 1 -- start start 2024-09-17T05:21:54.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.629+0000 7f1dd71df640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1dd0073cd0 0x7f1dd00cba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:54.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.629+0000 7f1dd71df640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1dd00ce910 0x7f1dd0158f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:54.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.629+0000 7f1dd71df640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1dd015ac00 0x7f1dd015d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:54.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.629+0000 7f1dd71df640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd00719e0 con 0x7f1dd00ce910 2024-09-17T05:21:54.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.629+0000 7f1dd71df640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd0071860 con 0x7f1dd0073cd0 2024-09-17T05:21:54.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.629+0000 7f1dd71df640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f1dd015eeb0 con 0x7f1dd015ac00 2024-09-17T05:21:54.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.629+0000 7f1dcffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1dd00ce910 0x7f1dd0158f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:54.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.629+0000 7f1dcffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1dd00ce910 0x7f1dd0158f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:50088/0 (socket says 172.21.15.98:50088) 2024-09-17T05:21:54.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.629+0000 7f1dcffff640 1 -- 172.21.15.98:0/133943390 learned_addr learned my addr 172.21.15.98:0/133943390 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:21:54.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.629+0000 7f1dd4f7b640 1 --2- 172.21.15.98:0/133943390 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1dd0073cd0 0x7f1dd00cba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:54.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.630+0000 7f1dd577c640 1 --2- 172.21.15.98:0/133943390 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1dd015ac00 0x7f1dd015d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:54.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.630+0000 7f1dcffff640 1 -- 172.21.15.98:0/133943390 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1dd015ac00 msgr2=0x7f1dd015d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:54.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.630+0000 7f1dcffff640 1 --2- 172.21.15.98:0/133943390 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1dd015ac00 0x7f1dd015d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:54.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.630+0000 7f1dcffff640 1 -- 172.21.15.98:0/133943390 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1dd0073cd0 msgr2=0x7f1dd00cba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:54.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.630+0000 7f1dcffff640 1 --2- 172.21.15.98:0/133943390 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1dd0073cd0 0x7f1dd00cba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:54.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.630+0000 7f1dcffff640 1 -- 172.21.15.98:0/133943390 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dd00c9d00 con 0x7f1dd00ce910 2024-09-17T05:21:54.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.630+0000 7f1dcffff640 1 --2- 172.21.15.98:0/133943390 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1dd00ce910 0x7f1dd0158f30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1db800ea80 tx=0x7f1db800ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:54.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.630+0000 7f1dcd7fa640 1 -- 172.21.15.98:0/133943390 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db800cde0 con 0x7f1dd00ce910 2024-09-17T05:21:54.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.630+0000 7f1dcd7fa640 1 -- 172.21.15.98:0/133943390 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1db8004c10 con 0x7f1dd00ce910 2024-09-17T05:21:54.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.630+0000 7f1dcd7fa640 1 -- 172.21.15.98:0/133943390 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db8005020 con 0x7f1dd00ce910 2024-09-17T05:21:54.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.630+0000 7f1dd71df640 1 -- 172.21.15.98:0/133943390 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dd00cc1d0 con 0x7f1dd00ce910 2024-09-17T05:21:54.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.630+0000 7f1dd71df640 1 -- 172.21.15.98:0/133943390 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dd01f6930 con 0x7f1dd00ce910 2024-09-17T05:21:54.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.631+0000 7f1dd71df640 1 -- 172.21.15.98:0/133943390 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dd015f370 con 0x7f1dd00ce910 2024-09-17T05:21:54.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.631+0000 7f1dcd7fa640 1 -- 172.21.15.98:0/133943390 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1db80051c0 con 0x7f1dd00ce910 2024-09-17T05:21:54.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.632+0000 7f1dcd7fa640 1 --2- 172.21.15.98:0/133943390 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f1db0078b90 0x7f1db007b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:54.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.632+0000 7f1dcd7fa640 1 -- 172.21.15.98:0/133943390 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1db809b5e0 con 0x7f1dd00ce910 2024-09-17T05:21:54.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.632+0000 7f1dd4f7b640 1 --2- 172.21.15.98:0/133943390 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f1db0078b90 0x7f1db007b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:54.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.633+0000 7f1dd4f7b640 1 --2- 172.21.15.98:0/133943390 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f1db0078b90 0x7f1db007b050 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1dc0033000 tx=0x7f1dc0004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:54.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.636+0000 7f1dcd7fa640 1 -- 172.21.15.98:0/133943390 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f1db8016030 con 0x7f1dd00ce910 2024-09-17T05:21:54.814 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.814+0000 7f1dd71df640 1 -- 172.21.15.98:0/133943390 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1dd00b6cc0 con 0x7f1dd00ce910 2024-09-17T05:21:54.815 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.815+0000 7f1dcd7fa640 1 -- 172.21.15.98:0/133943390 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16666 (secure 0 0 0) 0x7f1db80634f0 con 0x7f1dd00ce910 2024-09-17T05:21:54.816 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:21:54.816 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":20,"fsid":"fcbf5a43-b3d8-497c-b15d-3cc022477cf0","created":"2024-09-17T05:21:29.852143+0000","modified":"2024-09-17T05:21:53.826283+0000","last_up_change":"2024-09-17T05:21:42.925756+0000","last_in_change":"2024-09-17T05:21:32.893880+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:21:42.263011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:21:51.665719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T05:21:52.780673+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ad711a-df74-438b-b0dc-1499d685c958","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6825","nonce":3644101529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6827","nonce":3644101529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6831","nonce":3644101529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6829","nonce":3644101529}]},"public_addr":"172.21.15.98:6825/3644101529","cluster_addr":"172.21.15.98:6827/3644101529","heartbeat_back_addr":"172.21.15.98:6831/3644101529","heartbeat_front_addr":"172.21.15.98:6829/3644101529","state":["exists","up"]},{"osd":1,"uuid":"f0ccb08d-4d8d-47b8-9320-8c372a6605b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6817","nonce":3902180920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6819","nonce":3902180920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6823","nonce":3902180920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6821","nonce":3902180920}]},"public_addr":"172.21.15.98:6817/3902180920","cluster_addr":"172.21.15.98:6819/3902180920","heartbeat_back_addr":"172.21.15.98:6823/3902180920","heartbeat_front_addr":"172.21.15.98:6821/3902180920","state":["exists","up"]},{"osd":2,"uuid":"a0985398-5e5f-494f-8abf-f785f19e94ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6801","nonce":1518887101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6803","nonce":1518887101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6807","nonce":1518887101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6805","nonce":1518887101}]},"public_addr":"172.21.15.98:6801/1518887101","cluster_addr":"172.21.15.98:6803/1518887101","heartbeat_back_addr":"172.21.15.98:6807/1518887101","heartbeat_front_addr":"172.21.15.98:6805/1518887101","state":["exists","up"]},{"osd":3,"uuid":"e960be2e-0c3a-426e-9507-d3be5895f9e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6809","nonce":4125246091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6811","nonce":4125246091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6815","nonce":4125246091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6813","nonce":4125246091}]},"public_addr":"172.21.15.98:6809/4125246091","cluster_addr":"172.21.15.98:6811/4125246091","heartbeat_back_addr":"172.21.15.98:6815/4125246091","heartbeat_front_addr":"172.21.15.98:6813/4125246091","state":["exists","up"]},{"osd":4,"uuid":"49118c00-3dc1-43ef-8ed4-aca61e56a507","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6811","nonce":765789888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6813","nonce":765789888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6817","nonce":765789888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6815","nonce":765789888}]},"public_addr":"172.21.15.167:6811/765789888","cluster_addr":"172.21.15.167:6813/765789888","heartbeat_back_addr":"172.21.15.167:6817/765789888","heartbeat_front_addr":"172.21.15.167:6815/765789888","state":["exists","up"]},{"osd":5,"uuid":"9f4e0143-2b3d-40e4-bfb5-043d9a9f4ba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6803","nonce":2567019914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6805","nonce":2567019914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6809","nonce":2567019914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6807","nonce":2567019914}]},"public_addr":"172.21.15.167:6803/2567019914","cluster_addr":"172.21.15.167:6805/2567019914","heartbeat_back_addr":"172.21.15.167:6809/2567019914","heartbeat_front_addr":"172.21.15.167:6807/2567019914","state":["exists","up"]},{"osd":6,"uuid":"28720514-e627-4dea-8f4d-bd311ec31361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6819","nonce":96262631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6821","nonce":96262631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6825","nonce":96262631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6823","nonce":96262631}]},"public_addr":"172.21.15.167:6819/96262631","cluster_addr":"172.21.15.167:6821/96262631","heartbeat_back_addr":"172.21.15.167:6825/96262631","heartbeat_front_addr":"172.21.15.167:6823/96262631","state":["exists","up"]},{"osd":7,"uuid":"01edaf9c-3898-406e-85b0-774cfda60adf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6827","nonce":4169560909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6829","nonce":4169560909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6833","nonce":4169560909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6831","nonce":4169560909}]},"public_addr":"172.21.15.167:6827/4169560909","cluster_addr":"172.21.15.167:6829/4169560909","heartbeat_back_addr":"172.21.15.167:6833/4169560909","heartbeat_front_addr":"172.21.15.167:6831/4169560909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:40.054920+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.177110+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.749278+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.400155+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.503576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.196417+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.371063+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.212852+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:21:54.818 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.817+0000 7f1dd71df640 1 -- 172.21.15.98:0/133943390 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f1db0078b90 msgr2=0x7f1db007b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:54.818 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.817+0000 7f1dd71df640 1 --2- 172.21.15.98:0/133943390 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f1db0078b90 0x7f1db007b050 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1dc0033000 tx=0x7f1dc0004730 comp rx=0 tx=0).stop 2024-09-17T05:21:54.818 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.817+0000 7f1dd71df640 1 -- 172.21.15.98:0/133943390 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1dd00ce910 msgr2=0x7f1dd0158f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:54.818 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.817+0000 7f1dd71df640 1 --2- 172.21.15.98:0/133943390 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1dd00ce910 0x7f1dd0158f30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1db800ea80 tx=0x7f1db800ef40 comp rx=0 tx=0).stop 2024-09-17T05:21:54.818 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.817+0000 7f1dd71df640 1 -- 172.21.15.98:0/133943390 shutdown_connections 2024-09-17T05:21:54.818 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.817+0000 7f1dd71df640 1 --2- 172.21.15.98:0/133943390 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f1db0078b90 0x7f1db007b050 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:54.818 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.817+0000 7f1dd71df640 1 --2- 172.21.15.98:0/133943390 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1dd015ac00 0x7f1dd015d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:54.818 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.817+0000 7f1dd71df640 1 --2- 172.21.15.98:0/133943390 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1dd00ce910 0x7f1dd0158f30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:54.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.817+0000 7f1dd71df640 1 --2- 172.21.15.98:0/133943390 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1dd0073cd0 0x7f1dd00cba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:54.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.817+0000 7f1dd71df640 1 -- 172.21.15.98:0/133943390 >> 172.21.15.98:0/133943390 conn(0x7f1dd00d0d40 msgr2=0x7f1dd00d1120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:54.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.817+0000 7f1dd71df640 1 -- 172.21.15.98:0/133943390 shutdown_connections 2024-09-17T05:21:54.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.817+0000 7f1dd71df640 1 -- 172.21.15.98:0/133943390 wait complete. 2024-09-17T05:21:54.829 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:21:54.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.929+0000 7f8135bad640 1 -- 172.21.15.98:0/3683991083 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81300ccfd0 msgr2=0x7f81300cf130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:54.931 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.929+0000 7f8135bad640 1 --2- 172.21.15.98:0/3683991083 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81300ccfd0 0x7f81300cf130 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8124005fd0 tx=0x7f812402a6c0 comp rx=0 tx=0).stop 2024-09-17T05:21:54.931 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.929+0000 7f8135bad640 1 -- 172.21.15.98:0/3683991083 shutdown_connections 2024-09-17T05:21:54.931 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.929+0000 7f8135bad640 1 --2- 172.21.15.98:0/3683991083 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81300ccfd0 0x7f81300cf130 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:54.931 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.929+0000 7f8135bad640 1 --2- 172.21.15.98:0/3683991083 >> v2:172.21.15.167:3300/0 conn(0x7f81301445d0 0x7f81300cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:54.931 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.929+0000 7f8135bad640 1 -- 172.21.15.98:0/3683991083 >> 172.21.15.98:0/3683991083 conn(0x7f81300b1950 msgr2=0x7f81300b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:54.931 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.929+0000 7f8135bad640 1 -- 172.21.15.98:0/3683991083 shutdown_connections 2024-09-17T05:21:54.931 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.929+0000 7f8135bad640 1 -- 172.21.15.98:0/3683991083 wait complete. 2024-09-17T05:21:54.931 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.930+0000 7f8135bad640 1 Processor -- start 2024-09-17T05:21:54.931 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.930+0000 7f8135bad640 1 -- start start 2024-09-17T05:21:54.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.931+0000 7f8135bad640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81300b4ca0 0x7f813015e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:54.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.931+0000 7f8135bad640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81300ccfd0 0x7f813009d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:54.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.931+0000 7f8135bad640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81301445d0 0x7f8130140940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:54.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.931+0000 7f8135bad640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f813015f080 con 0x7f81301445d0 2024-09-17T05:21:54.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.931+0000 7f8135bad640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8130073bc0 con 0x7f81300ccfd0 2024-09-17T05:21:54.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.931+0000 7f8135bad640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f813015f200 con 0x7f81300b4ca0 2024-09-17T05:21:54.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.931+0000 7f812ffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81301445d0 0x7f8130140940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:54.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.931+0000 7f812ffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81301445d0 0x7f8130140940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:50102/0 (socket says 172.21.15.98:50102) 2024-09-17T05:21:54.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.931+0000 7f812ffff640 1 -- 172.21.15.98:0/3651178467 learned_addr learned my addr 172.21.15.98:0/3651178467 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:21:54.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.931+0000 7f812ffff640 1 -- 172.21.15.98:0/3651178467 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81300b4ca0 msgr2=0x7f813015e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:54.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.931+0000 7f812ffff640 1 --2- 172.21.15.98:0/3651178467 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81300b4ca0 0x7f813015e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:54.935 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.931+0000 7f812ffff640 1 -- 172.21.15.98:0/3651178467 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81300ccfd0 msgr2=0x7f813009d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:54.935 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.931+0000 7f812ffff640 1 --2- 172.21.15.98:0/3651178467 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81300ccfd0 0x7f813009d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:54.935 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.931+0000 7f812ffff640 1 -- 172.21.15.98:0/3651178467 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8130140460 con 0x7f81301445d0 2024-09-17T05:21:54.935 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.931+0000 7f812ffff640 1 --2- 172.21.15.98:0/3651178467 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81301445d0 0x7f8130140940 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f812800c7a0 tx=0x7f812800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:54.935 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.931+0000 7f8117fff640 1 -- 172.21.15.98:0/3651178467 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8128003b70 con 0x7f81301445d0 2024-09-17T05:21:54.935 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.931+0000 7f8117fff640 1 -- 172.21.15.98:0/3651178467 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8128003d30 con 0x7f81301445d0 2024-09-17T05:21:54.935 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.931+0000 7f8135bad640 1 -- 172.21.15.98:0/3651178467 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81300cb9f0 con 0x7f81301445d0 2024-09-17T05:21:54.935 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.931+0000 7f8117fff640 1 -- 172.21.15.98:0/3651178467 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812800aab0 con 0x7f81301445d0 2024-09-17T05:21:54.935 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.932+0000 7f8135bad640 1 -- 172.21.15.98:0/3651178467 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81300cbfb0 con 0x7f81301445d0 2024-09-17T05:21:54.935 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.932+0000 7f8135bad640 1 -- 172.21.15.98:0/3651178467 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8130140630 con 0x7f81301445d0 2024-09-17T05:21:54.935 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.933+0000 7f8117fff640 1 -- 172.21.15.98:0/3651178467 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f812800ac50 con 0x7f81301445d0 2024-09-17T05:21:54.936 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.933+0000 7f8117fff640 1 --2- 172.21.15.98:0/3651178467 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f811c078b90 0x7f811c07b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:54.936 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.934+0000 7f8117fff640 1 -- 172.21.15.98:0/3651178467 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f812809ac00 con 0x7f81301445d0 2024-09-17T05:21:54.936 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.934+0000 7f812f7fe640 1 --2- 172.21.15.98:0/3651178467 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f811c078b90 0x7f811c07b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:54.936 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.934+0000 7f812f7fe640 1 --2- 172.21.15.98:0/3651178467 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f811c078b90 0x7f811c07b050 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f81200058c0 tx=0x7f8120005850 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:54.938 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:54.938+0000 7f8117fff640 1 -- 172.21.15.98:0/3651178467 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f81280a1080 con 0x7f81301445d0 2024-09-17T05:21:55.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.114+0000 7f8135bad640 1 -- 172.21.15.98:0/3651178467 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8130070a20 con 0x7f81301445d0 2024-09-17T05:21:55.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.115+0000 7f8117fff640 1 -- 172.21.15.98:0/3651178467 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16666 (secure 0 0 0) 0x7f8128063050 con 0x7f81301445d0 2024-09-17T05:21:55.116 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:21:55.117 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":20,"fsid":"fcbf5a43-b3d8-497c-b15d-3cc022477cf0","created":"2024-09-17T05:21:29.852143+0000","modified":"2024-09-17T05:21:53.826283+0000","last_up_change":"2024-09-17T05:21:42.925756+0000","last_in_change":"2024-09-17T05:21:32.893880+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:21:42.263011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:21:51.665719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T05:21:52.780673+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ad711a-df74-438b-b0dc-1499d685c958","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6825","nonce":3644101529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6827","nonce":3644101529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6831","nonce":3644101529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6829","nonce":3644101529}]},"public_addr":"172.21.15.98:6825/3644101529","cluster_addr":"172.21.15.98:6827/3644101529","heartbeat_back_addr":"172.21.15.98:6831/3644101529","heartbeat_front_addr":"172.21.15.98:6829/3644101529","state":["exists","up"]},{"osd":1,"uuid":"f0ccb08d-4d8d-47b8-9320-8c372a6605b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6817","nonce":3902180920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6819","nonce":3902180920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6823","nonce":3902180920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6821","nonce":3902180920}]},"public_addr":"172.21.15.98:6817/3902180920","cluster_addr":"172.21.15.98:6819/3902180920","heartbeat_back_addr":"172.21.15.98:6823/3902180920","heartbeat_front_addr":"172.21.15.98:6821/3902180920","state":["exists","up"]},{"osd":2,"uuid":"a0985398-5e5f-494f-8abf-f785f19e94ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6801","nonce":1518887101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6803","nonce":1518887101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6807","nonce":1518887101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6805","nonce":1518887101}]},"public_addr":"172.21.15.98:6801/1518887101","cluster_addr":"172.21.15.98:6803/1518887101","heartbeat_back_addr":"172.21.15.98:6807/1518887101","heartbeat_front_addr":"172.21.15.98:6805/1518887101","state":["exists","up"]},{"osd":3,"uuid":"e960be2e-0c3a-426e-9507-d3be5895f9e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6809","nonce":4125246091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6811","nonce":4125246091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6815","nonce":4125246091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6813","nonce":4125246091}]},"public_addr":"172.21.15.98:6809/4125246091","cluster_addr":"172.21.15.98:6811/4125246091","heartbeat_back_addr":"172.21.15.98:6815/4125246091","heartbeat_front_addr":"172.21.15.98:6813/4125246091","state":["exists","up"]},{"osd":4,"uuid":"49118c00-3dc1-43ef-8ed4-aca61e56a507","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6811","nonce":765789888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6813","nonce":765789888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6817","nonce":765789888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6815","nonce":765789888}]},"public_addr":"172.21.15.167:6811/765789888","cluster_addr":"172.21.15.167:6813/765789888","heartbeat_back_addr":"172.21.15.167:6817/765789888","heartbeat_front_addr":"172.21.15.167:6815/765789888","state":["exists","up"]},{"osd":5,"uuid":"9f4e0143-2b3d-40e4-bfb5-043d9a9f4ba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6803","nonce":2567019914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6805","nonce":2567019914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6809","nonce":2567019914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6807","nonce":2567019914}]},"public_addr":"172.21.15.167:6803/2567019914","cluster_addr":"172.21.15.167:6805/2567019914","heartbeat_back_addr":"172.21.15.167:6809/2567019914","heartbeat_front_addr":"172.21.15.167:6807/2567019914","state":["exists","up"]},{"osd":6,"uuid":"28720514-e627-4dea-8f4d-bd311ec31361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6819","nonce":96262631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6821","nonce":96262631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6825","nonce":96262631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6823","nonce":96262631}]},"public_addr":"172.21.15.167:6819/96262631","cluster_addr":"172.21.15.167:6821/96262631","heartbeat_back_addr":"172.21.15.167:6825/96262631","heartbeat_front_addr":"172.21.15.167:6823/96262631","state":["exists","up"]},{"osd":7,"uuid":"01edaf9c-3898-406e-85b0-774cfda60adf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6827","nonce":4169560909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6829","nonce":4169560909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6833","nonce":4169560909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6831","nonce":4169560909}]},"public_addr":"172.21.15.167:6827/4169560909","cluster_addr":"172.21.15.167:6829/4169560909","heartbeat_back_addr":"172.21.15.167:6833/4169560909","heartbeat_front_addr":"172.21.15.167:6831/4169560909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:40.054920+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.177110+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.749278+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.400155+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.503576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.196417+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.371063+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.212852+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:21:55.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.117+0000 7f8135bad640 1 -- 172.21.15.98:0/3651178467 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f811c078b90 msgr2=0x7f811c07b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:55.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.117+0000 7f8135bad640 1 --2- 172.21.15.98:0/3651178467 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f811c078b90 0x7f811c07b050 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f81200058c0 tx=0x7f8120005850 comp rx=0 tx=0).stop 2024-09-17T05:21:55.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.117+0000 7f8135bad640 1 -- 172.21.15.98:0/3651178467 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81301445d0 msgr2=0x7f8130140940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:55.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.117+0000 7f8135bad640 1 --2- 172.21.15.98:0/3651178467 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81301445d0 0x7f8130140940 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f812800c7a0 tx=0x7f812800cc60 comp rx=0 tx=0).stop 2024-09-17T05:21:55.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.117+0000 7f8135bad640 1 -- 172.21.15.98:0/3651178467 shutdown_connections 2024-09-17T05:21:55.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.117+0000 7f8135bad640 1 --2- 172.21.15.98:0/3651178467 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f811c078b90 0x7f811c07b050 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:55.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.117+0000 7f8135bad640 1 --2- 172.21.15.98:0/3651178467 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81301445d0 0x7f8130140940 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:55.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.117+0000 7f8135bad640 1 --2- 172.21.15.98:0/3651178467 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81300ccfd0 0x7f813009d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:55.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.117+0000 7f8135bad640 1 --2- 172.21.15.98:0/3651178467 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81300b4ca0 0x7f813015e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:55.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.117+0000 7f8135bad640 1 -- 172.21.15.98:0/3651178467 >> 172.21.15.98:0/3651178467 conn(0x7f81300b1950 msgr2=0x7f81300b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:55.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.118+0000 7f8135bad640 1 -- 172.21.15.98:0/3651178467 shutdown_connections 2024-09-17T05:21:55.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.118+0000 7f8135bad640 1 -- 172.21.15.98:0/3651178467 wait complete. 2024-09-17T05:21:55.129 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T05:21:55.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.233+0000 7f330dc16640 1 -- 172.21.15.98:0/1389819532 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32f4004800 msgr2=0x7f32f4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:55.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.233+0000 7f330dc16640 1 --2- 172.21.15.98:0/1389819532 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32f4004800 0x7f32f4004c80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f32f00016c0 tx=0x7f32f4005830 comp rx=0 tx=0).stop 2024-09-17T05:21:55.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.233+0000 7f330dc16640 1 -- 172.21.15.98:0/1389819532 shutdown_connections 2024-09-17T05:21:55.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.233+0000 7f330dc16640 1 --2- 172.21.15.98:0/1389819532 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32f4004800 0x7f32f4004c80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:55.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.233+0000 7f330dc16640 1 -- 172.21.15.98:0/1389819532 >> 172.21.15.98:0/1389819532 conn(0x7f33080b2130 msgr2=0x7f33080b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:55.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.233+0000 7f330dc16640 1 -- 172.21.15.98:0/1389819532 shutdown_connections 2024-09-17T05:21:55.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.233+0000 7f330dc16640 1 -- 172.21.15.98:0/1389819532 wait complete. 2024-09-17T05:21:55.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.234+0000 7f330dc16640 1 Processor -- start 2024-09-17T05:21:55.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.235+0000 7f330dc16640 1 -- start start 2024-09-17T05:21:55.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.235+0000 7f330dc16640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32f4004800 0x7f3308155770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:55.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.235+0000 7f330dc16640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f330814f540 0x7f330814c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:55.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.235+0000 7f330dc16640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f330814f9a0 0x7f330814cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:55.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.235+0000 7f330dc16640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f33080cd240 con 0x7f330814f540 2024-09-17T05:21:55.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.235+0000 7f330dc16640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f33080cd0c0 con 0x7f32f4004800 2024-09-17T05:21:55.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.235+0000 7f330dc16640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f33080cd3c0 con 0x7f330814f9a0 2024-09-17T05:21:55.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.235+0000 7f32fffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f330814f540 0x7f330814c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:55.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.235+0000 7f32fffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f330814f540 0x7f330814c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:50130/0 (socket says 172.21.15.98:50130) 2024-09-17T05:21:55.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.235+0000 7f32fffff640 1 -- 172.21.15.98:0/2009465862 learned_addr learned my addr 172.21.15.98:0/2009465862 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:21:55.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.235+0000 7f33077fe640 1 --2- 172.21.15.98:0/2009465862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32f4004800 0x7f3308155770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:55.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.235+0000 7f3307fff640 1 --2- 172.21.15.98:0/2009465862 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f330814f9a0 0x7f330814cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:55.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.236+0000 7f32fffff640 1 -- 172.21.15.98:0/2009465862 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f330814f9a0 msgr2=0x7f330814cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:55.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.236+0000 7f32fffff640 1 --2- 172.21.15.98:0/2009465862 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f330814f9a0 0x7f330814cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:55.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.236+0000 7f32fffff640 1 -- 172.21.15.98:0/2009465862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32f4004800 msgr2=0x7f3308155770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:55.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.236+0000 7f32fffff640 1 --2- 172.21.15.98:0/2009465862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32f4004800 0x7f3308155770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:55.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.236+0000 7f32fffff640 1 -- 172.21.15.98:0/2009465862 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3308142870 con 0x7f330814f540 2024-09-17T05:21:55.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.236+0000 7f32fffff640 1 --2- 172.21.15.98:0/2009465862 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f330814f540 0x7f330814c830 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f32f00017e0 tx=0x7f32f00063a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:55.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.236+0000 7f3304ff9640 1 -- 172.21.15.98:0/2009465862 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f0042070 con 0x7f330814f540 2024-09-17T05:21:55.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.236+0000 7f3304ff9640 1 -- 172.21.15.98:0/2009465862 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f32f0039070 con 0x7f330814f540 2024-09-17T05:21:55.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.236+0000 7f330dc16640 1 -- 172.21.15.98:0/2009465862 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f330814ea60 con 0x7f330814f540 2024-09-17T05:21:55.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.236+0000 7f3304ff9640 1 -- 172.21.15.98:0/2009465862 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f0003d70 con 0x7f330814f540 2024-09-17T05:21:55.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.236+0000 7f330dc16640 1 -- 172.21.15.98:0/2009465862 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f330814f020 con 0x7f330814f540 2024-09-17T05:21:55.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.237+0000 7f330dc16640 1 -- 172.21.15.98:0/2009465862 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33080733b0 con 0x7f330814f540 2024-09-17T05:21:55.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.237+0000 7f3304ff9640 1 -- 172.21.15.98:0/2009465862 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f32f003b070 con 0x7f330814f540 2024-09-17T05:21:55.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.238+0000 7f3304ff9640 1 --2- 172.21.15.98:0/2009465862 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f32e8078bc0 0x7f32e807b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:55.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.238+0000 7f3304ff9640 1 -- 172.21.15.98:0/2009465862 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f32f00b9ee0 con 0x7f330814f540 2024-09-17T05:21:55.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.238+0000 7f33077fe640 1 --2- 172.21.15.98:0/2009465862 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f32e8078bc0 0x7f32e807b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:55.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.238+0000 7f33077fe640 1 --2- 172.21.15.98:0/2009465862 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f32e8078bc0 0x7f32e807b080 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f32f80037e0 tx=0x7f32f800b260 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:55.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.242+0000 7f3304ff9640 1 -- 172.21.15.98:0/2009465862 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f32f0081e20 con 0x7f330814f540 2024-09-17T05:21:55.457 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.456+0000 7f330dc16640 1 -- 172.21.15.98:0/2009465862 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f3308155cb0 con 0x7f330814f540 2024-09-17T05:21:55.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.642+0000 7f3304ff9640 1 -- 172.21.15.98:0/2009465862 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) ==== 118+0+0 (secure 0 0 0) 0x7f32f0086850 con 0x7f330814f540 2024-09-17T05:21:55.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.645+0000 7f330dc16640 1 -- 172.21.15.98:0/2009465862 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f32e8078bc0 msgr2=0x7f32e807b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:55.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.645+0000 7f330dc16640 1 --2- 172.21.15.98:0/2009465862 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f32e8078bc0 0x7f32e807b080 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f32f80037e0 tx=0x7f32f800b260 comp rx=0 tx=0).stop 2024-09-17T05:21:55.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.645+0000 7f330dc16640 1 -- 172.21.15.98:0/2009465862 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f330814f540 msgr2=0x7f330814c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:55.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.645+0000 7f330dc16640 1 --2- 172.21.15.98:0/2009465862 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f330814f540 0x7f330814c830 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f32f00017e0 tx=0x7f32f00063a0 comp rx=0 tx=0).stop 2024-09-17T05:21:55.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.645+0000 7f330dc16640 1 -- 172.21.15.98:0/2009465862 shutdown_connections 2024-09-17T05:21:55.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.645+0000 7f330dc16640 1 --2- 172.21.15.98:0/2009465862 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f32e8078bc0 0x7f32e807b080 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:55.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.645+0000 7f330dc16640 1 --2- 172.21.15.98:0/2009465862 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f330814f9a0 0x7f330814cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:55.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.645+0000 7f330dc16640 1 --2- 172.21.15.98:0/2009465862 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f330814f540 0x7f330814c830 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:55.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.645+0000 7f330dc16640 1 --2- 172.21.15.98:0/2009465862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32f4004800 0x7f3308155770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:55.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.645+0000 7f330dc16640 1 -- 172.21.15.98:0/2009465862 >> 172.21.15.98:0/2009465862 conn(0x7f33080b2130 msgr2=0x7f33080d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:55.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.645+0000 7f330dc16640 1 -- 172.21.15.98:0/2009465862 shutdown_connections 2024-09-17T05:21:55.647 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.645+0000 7f330dc16640 1 -- 172.21.15.98:0/2009465862 wait complete. 2024-09-17T05:21:55.656 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T05:21:55.657 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T05:21:55.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.761+0000 7fbd0767f640 1 -- 172.21.15.98:0/2558838012 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd0015bf10 msgr2=0x7fbd001604b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:55.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.761+0000 7fbd0767f640 1 --2- 172.21.15.98:0/2558838012 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd0015bf10 0x7fbd001604b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbd000cc400 tx=0x7fbcf802a530 comp rx=0 tx=0).stop 2024-09-17T05:21:55.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.761+0000 7fbd0767f640 1 -- 172.21.15.98:0/2558838012 shutdown_connections 2024-09-17T05:21:55.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.761+0000 7fbd0767f640 1 --2- 172.21.15.98:0/2558838012 >> v2:172.21.15.167:3300/0 conn(0x7fbd000cd6f0 0x7fbd000d01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:55.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.761+0000 7fbd0767f640 1 --2- 172.21.15.98:0/2558838012 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd0015bf10 0x7fbd001604b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:55.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.761+0000 7fbd0767f640 1 -- 172.21.15.98:0/2558838012 >> 172.21.15.98:0/2558838012 conn(0x7fbd000d1e20 msgr2=0x7fbd000d2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:55.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.761+0000 7fbd0767f640 1 -- 172.21.15.98:0/2558838012 shutdown_connections 2024-09-17T05:21:55.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.761+0000 7fbd0767f640 1 -- 172.21.15.98:0/2558838012 wait complete. 2024-09-17T05:21:55.763 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.762+0000 7fbd0767f640 1 Processor -- start 2024-09-17T05:21:55.763 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.762+0000 7fbd0767f640 1 -- start start 2024-09-17T05:21:55.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.763+0000 7fbd0767f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd000cd6f0 0x7fbd001592c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:55.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.763+0000 7fbd0767f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd000d0710 0x7fbd000c7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:55.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.763+0000 7fbd0767f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd0015bf10 0x7fbd000c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:55.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.763+0000 7fbd0767f640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fbd000cdce0 con 0x7fbd0015bf10 2024-09-17T05:21:55.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.763+0000 7fbd0767f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbd000cdb60 con 0x7fbd000cd6f0 2024-09-17T05:21:55.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.763+0000 7fbd0767f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fbd000cf9f0 con 0x7fbd000d0710 2024-09-17T05:21:55.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.763+0000 7fbd05c1c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd0015bf10 0x7fbd000c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:55.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.763+0000 7fbd05c1c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd0015bf10 0x7fbd000c7cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:50150/0 (socket says 172.21.15.98:50150) 2024-09-17T05:21:55.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.763+0000 7fbd05c1c640 1 -- 172.21.15.98:0/457244462 learned_addr learned my addr 172.21.15.98:0/457244462 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:21:55.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.763+0000 7fbd05c1c640 1 -- 172.21.15.98:0/457244462 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd000d0710 msgr2=0x7fbd000c7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:55.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.763+0000 7fbd05c1c640 1 --2- 172.21.15.98:0/457244462 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd000d0710 0x7fbd000c7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:55.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.763+0000 7fbd05c1c640 1 -- 172.21.15.98:0/457244462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd000cd6f0 msgr2=0x7fbd001592c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:55.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.763+0000 7fbd05c1c640 1 --2- 172.21.15.98:0/457244462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd000cd6f0 0x7fbd001592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:55.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.763+0000 7fbd05c1c640 1 -- 172.21.15.98:0/457244462 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd0015c590 con 0x7fbd0015bf10 2024-09-17T05:21:55.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.763+0000 7fbd05c1c640 1 --2- 172.21.15.98:0/457244462 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd0015bf10 0x7fbd000c7cb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbcf000c7a0 tx=0x7fbcf000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:55.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.763+0000 7fbcfdffb640 1 -- 172.21.15.98:0/457244462 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf0003da0 con 0x7fbd0015bf10 2024-09-17T05:21:55.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.763+0000 7fbcfdffb640 1 -- 172.21.15.98:0/457244462 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbcf0005070 con 0x7fbd0015bf10 2024-09-17T05:21:55.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.764+0000 7fbd0767f640 1 -- 172.21.15.98:0/457244462 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd0015c870 con 0x7fbd0015bf10 2024-09-17T05:21:55.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.764+0000 7fbcfdffb640 1 -- 172.21.15.98:0/457244462 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf00054c0 con 0x7fbd0015bf10 2024-09-17T05:21:55.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.764+0000 7fbd0767f640 1 -- 172.21.15.98:0/457244462 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd0015ce30 con 0x7fbd0015bf10 2024-09-17T05:21:55.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.765+0000 7fbd0767f640 1 -- 172.21.15.98:0/457244462 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd000d01d0 con 0x7fbd0015bf10 2024-09-17T05:21:55.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.765+0000 7fbcfdffb640 1 -- 172.21.15.98:0/457244462 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbcf0005660 con 0x7fbd0015bf10 2024-09-17T05:21:55.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.766+0000 7fbcfdffb640 1 --2- 172.21.15.98:0/457244462 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fbcec078b90 0x7fbcec07b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:55.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.766+0000 7fbcfdffb640 1 -- 172.21.15.98:0/457244462 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fbcf009ab80 con 0x7fbd0015bf10 2024-09-17T05:21:55.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.766+0000 7fbd0541b640 1 --2- 172.21.15.98:0/457244462 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fbcec078b90 0x7fbcec07b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:55.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.766+0000 7fbd0541b640 1 --2- 172.21.15.98:0/457244462 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fbcec078b90 0x7fbcec07b050 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbcf8034000 tx=0x7fbcf80046c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:55.770 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.770+0000 7fbcfdffb640 1 -- 172.21.15.98:0/457244462 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fbcf0063050 con 0x7fbd0015bf10 2024-09-17T05:21:55.988 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:55.987+0000 7fbd0767f640 1 -- 172.21.15.98:0/457244462 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fbd00069630 con 0x7fbd0015bf10 2024-09-17T05:21:56.648 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.648+0000 7fbcfdffb640 1 -- 172.21.15.98:0/457244462 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) ==== 122+0+0 (secure 0 0 0) 0x7fbcf0062950 con 0x7fbd0015bf10 2024-09-17T05:21:56.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.650+0000 7fbd0767f640 1 -- 172.21.15.98:0/457244462 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fbcec078b90 msgr2=0x7fbcec07b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:56.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.650+0000 7fbd0767f640 1 --2- 172.21.15.98:0/457244462 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fbcec078b90 0x7fbcec07b050 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbcf8034000 tx=0x7fbcf80046c0 comp rx=0 tx=0).stop 2024-09-17T05:21:56.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.650+0000 7fbd0767f640 1 -- 172.21.15.98:0/457244462 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd0015bf10 msgr2=0x7fbd000c7cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:56.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.650+0000 7fbd0767f640 1 --2- 172.21.15.98:0/457244462 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd0015bf10 0x7fbd000c7cb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbcf000c7a0 tx=0x7fbcf000cc60 comp rx=0 tx=0).stop 2024-09-17T05:21:56.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.650+0000 7fbd0767f640 1 -- 172.21.15.98:0/457244462 shutdown_connections 2024-09-17T05:21:56.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.650+0000 7fbd0767f640 1 --2- 172.21.15.98:0/457244462 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fbcec078b90 0x7fbcec07b050 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:56.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.650+0000 7fbd0767f640 1 --2- 172.21.15.98:0/457244462 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd0015bf10 0x7fbd000c7cb0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:56.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.650+0000 7fbd0767f640 1 --2- 172.21.15.98:0/457244462 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd000d0710 0x7fbd000c7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:56.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.650+0000 7fbd0767f640 1 --2- 172.21.15.98:0/457244462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd000cd6f0 0x7fbd001592c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:56.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.650+0000 7fbd0767f640 1 -- 172.21.15.98:0/457244462 >> 172.21.15.98:0/457244462 conn(0x7fbd000d1e20 msgr2=0x7fbd000caf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:56.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.650+0000 7fbd0767f640 1 -- 172.21.15.98:0/457244462 shutdown_connections 2024-09-17T05:21:56.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.650+0000 7fbd0767f640 1 -- 172.21.15.98:0/457244462 wait complete. 2024-09-17T05:21:56.663 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T05:21:56.663 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:21:56.770 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.766+0000 7fab79dec640 1 -- 172.21.15.98:0/1565396495 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fab74151750 msgr2=0x7fab74151b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:56.771 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.766+0000 7fab79dec640 1 --2- 172.21.15.98:0/1565396495 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fab74151750 0x7fab74151b60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fab740cda10 tx=0x7fab6c02a5f0 comp rx=0 tx=0).stop 2024-09-17T05:21:56.771 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.766+0000 7fab79dec640 1 -- 172.21.15.98:0/1565396495 shutdown_connections 2024-09-17T05:21:56.771 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.766+0000 7fab79dec640 1 --2- 172.21.15.98:0/1565396495 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fab74151750 0x7fab74151b60 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:56.771 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.766+0000 7fab79dec640 1 --2- 172.21.15.98:0/1565396495 >> v2:172.21.15.167:3300/0 conn(0x7fab740730c0 0x7fab74073530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:56.771 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.766+0000 7fab79dec640 1 -- 172.21.15.98:0/1565396495 >> 172.21.15.98:0/1565396495 conn(0x7fab740b2230 msgr2=0x7fab740b2610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:56.771 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.766+0000 7fab79dec640 1 -- 172.21.15.98:0/1565396495 shutdown_connections 2024-09-17T05:21:56.771 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.766+0000 7fab79dec640 1 -- 172.21.15.98:0/1565396495 wait complete. 2024-09-17T05:21:56.771 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.767+0000 7fab79dec640 1 Processor -- start 2024-09-17T05:21:56.771 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.767+0000 7fab79dec640 1 -- start start 2024-09-17T05:21:56.771 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.768+0000 7fab79dec640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fab740730c0 0x7fab741534f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:56.771 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.768+0000 7fab79dec640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fab74151750 0x7fab7413a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:56.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.768+0000 7fab79dec640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab7415bdc0 0x7fab7414bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:56.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.768+0000 7fab79dec640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fab7415c320 con 0x7fab740730c0 2024-09-17T05:21:56.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.768+0000 7fab79dec640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fab7415c1a0 con 0x7fab7415bdc0 2024-09-17T05:21:56.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.768+0000 7fab79dec640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fab741520a0 con 0x7fab74151750 2024-09-17T05:21:56.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.768+0000 7fab737fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fab740730c0 0x7fab741534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:56.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.768+0000 7fab737fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fab740730c0 0x7fab741534f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47326/0 (socket says 172.21.15.98:47326) 2024-09-17T05:21:56.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.768+0000 7fab737fe640 1 -- 172.21.15.98:0/979768112 learned_addr learned my addr 172.21.15.98:0/979768112 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:21:56.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.768+0000 7fab73fff640 1 --2- 172.21.15.98:0/979768112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab7415bdc0 0x7fab7414bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:56.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.768+0000 7fab72ffd640 1 --2- 172.21.15.98:0/979768112 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fab74151750 0x7fab7413a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:56.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.768+0000 7fab737fe640 1 -- 172.21.15.98:0/979768112 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fab74151750 msgr2=0x7fab7413a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:56.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.768+0000 7fab737fe640 1 --2- 172.21.15.98:0/979768112 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fab74151750 0x7fab7413a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:56.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.768+0000 7fab737fe640 1 -- 172.21.15.98:0/979768112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab7415bdc0 msgr2=0x7fab7414bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:56.773 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.768+0000 7fab737fe640 1 --2- 172.21.15.98:0/979768112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab7415bdc0 0x7fab7414bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:56.773 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.768+0000 7fab737fe640 1 -- 172.21.15.98:0/979768112 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab7414d4e0 con 0x7fab740730c0 2024-09-17T05:21:56.773 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.768+0000 7fab72ffd640 1 --2- 172.21.15.98:0/979768112 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fab74151750 0x7fab7413a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:21:56.773 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.769+0000 7fab737fe640 1 --2- 172.21.15.98:0/979768112 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fab740730c0 0x7fab741534f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fab6400c730 tx=0x7fab6400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:56.773 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.769+0000 7fab5bfff640 1 -- 172.21.15.98:0/979768112 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab64003b70 con 0x7fab740730c0 2024-09-17T05:21:56.773 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.769+0000 7fab5bfff640 1 -- 172.21.15.98:0/979768112 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fab64003d30 con 0x7fab740730c0 2024-09-17T05:21:56.773 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.769+0000 7fab79dec640 1 -- 172.21.15.98:0/979768112 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab74149860 con 0x7fab740730c0 2024-09-17T05:21:56.773 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.769+0000 7fab5bfff640 1 -- 172.21.15.98:0/979768112 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab6400aab0 con 0x7fab740730c0 2024-09-17T05:21:56.773 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.769+0000 7fab79dec640 1 -- 172.21.15.98:0/979768112 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab741500d0 con 0x7fab740730c0 2024-09-17T05:21:56.773 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.770+0000 7fab79dec640 1 -- 172.21.15.98:0/979768112 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab740b5440 con 0x7fab740730c0 2024-09-17T05:21:56.774 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.770+0000 7fab5bfff640 1 -- 172.21.15.98:0/979768112 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fab6400ac50 con 0x7fab740730c0 2024-09-17T05:21:56.774 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.771+0000 7fab5bfff640 1 --2- 172.21.15.98:0/979768112 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fab60078b90 0x7fab6007b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:56.774 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.771+0000 7fab5bfff640 1 -- 172.21.15.98:0/979768112 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fab6409aa50 con 0x7fab740730c0 2024-09-17T05:21:56.774 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.771+0000 7fab72ffd640 1 --2- 172.21.15.98:0/979768112 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fab60078b90 0x7fab6007b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:56.774 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.772+0000 7fab72ffd640 1 --2- 172.21.15.98:0/979768112 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fab60078b90 0x7fab6007b050 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fab68005fd0 tx=0x7fab68005850 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:56.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.775+0000 7fab5bfff640 1 -- 172.21.15.98:0/979768112 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fab740b5440 con 0x7fab740730c0 2024-09-17T05:21:56.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.986+0000 7fab79dec640 1 -- 172.21.15.98:0/979768112 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fab74073530 con 0x7fab740730c0 2024-09-17T05:21:56.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.987+0000 7fab5bfff640 1 -- 172.21.15.98:0/979768112 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5217 (secure 0 0 0) 0x7fab64062f20 con 0x7fab740730c0 2024-09-17T05:21:56.988 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:21:56.988 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":7,"btime":"2024-09-17T05:21:56:643998+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4368,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/237112225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":237112225},{"type":"v1","addr":"172.21.15.98:6833","nonce":237112225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4377,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/4042308128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":4042308128},{"type":"v1","addr":"172.21.15.98:6835","nonce":4042308128}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4378,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/313781530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":313781530},{"type":"v1","addr":"172.21.15.167:6836","nonce":313781530}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:21:53.826247+0000","modified":"2024-09-17T05:21:55.988646+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4386},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4386":{"gid":4386,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6837/4171766128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":4171766128},{"type":"v1","addr":"172.21.15.167:6837","nonce":4171766128}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4386,"qdb_cluster":[4386]},"id":1}]} 2024-09-17T05:21:56.988 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 7 2024-09-17T05:21:56.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.989+0000 7fab79dec640 1 -- 172.21.15.98:0/979768112 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fab60078b90 msgr2=0x7fab6007b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:56.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.989+0000 7fab79dec640 1 --2- 172.21.15.98:0/979768112 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fab60078b90 0x7fab6007b050 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fab68005fd0 tx=0x7fab68005850 comp rx=0 tx=0).stop 2024-09-17T05:21:56.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.989+0000 7fab79dec640 1 -- 172.21.15.98:0/979768112 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fab740730c0 msgr2=0x7fab741534f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:56.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.989+0000 7fab79dec640 1 --2- 172.21.15.98:0/979768112 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fab740730c0 0x7fab741534f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fab6400c730 tx=0x7fab6400cbf0 comp rx=0 tx=0).stop 2024-09-17T05:21:56.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.989+0000 7fab79dec640 1 -- 172.21.15.98:0/979768112 shutdown_connections 2024-09-17T05:21:56.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.989+0000 7fab79dec640 1 --2- 172.21.15.98:0/979768112 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fab60078b90 0x7fab6007b050 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:56.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.989+0000 7fab79dec640 1 --2- 172.21.15.98:0/979768112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab7415bdc0 0x7fab7414bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:56.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.989+0000 7fab79dec640 1 --2- 172.21.15.98:0/979768112 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fab74151750 0x7fab7413a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:56.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.989+0000 7fab79dec640 1 --2- 172.21.15.98:0/979768112 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fab740730c0 0x7fab741534f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:56.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.989+0000 7fab79dec640 1 -- 172.21.15.98:0/979768112 >> 172.21.15.98:0/979768112 conn(0x7fab740b2230 msgr2=0x7fab7406f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:56.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.989+0000 7fab79dec640 1 -- 172.21.15.98:0/979768112 shutdown_connections 2024-09-17T05:21:56.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:56.989+0000 7fab79dec640 1 -- 172.21.15.98:0/979768112 wait complete. 2024-09-17T05:21:57.001 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:21:57.102 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.101+0000 7f94f0641640 1 -- 172.21.15.98:0/2773658657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94d00053a0 msgr2=0x7f94d000ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:57.102 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.101+0000 7f94f0641640 1 --2- 172.21.15.98:0/2773658657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94d00053a0 0x7f94d000ba00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f94d8009e20 tx=0x7f94d0005830 comp rx=0 tx=0).stop 2024-09-17T05:21:57.102 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.101+0000 7f94f0641640 1 -- 172.21.15.98:0/2773658657 shutdown_connections 2024-09-17T05:21:57.102 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.101+0000 7f94f0641640 1 --2- 172.21.15.98:0/2773658657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94d00053a0 0x7f94d000ba00 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:57.102 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.101+0000 7f94f0641640 1 -- 172.21.15.98:0/2773658657 >> 172.21.15.98:0/2773658657 conn(0x7f94e80d1d80 msgr2=0x7f94e80d2190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:57.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.101+0000 7f94f0641640 1 -- 172.21.15.98:0/2773658657 shutdown_connections 2024-09-17T05:21:57.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.101+0000 7f94f0641640 1 -- 172.21.15.98:0/2773658657 wait complete. 2024-09-17T05:21:57.106 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.102+0000 7f94f0641640 1 Processor -- start 2024-09-17T05:21:57.106 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.102+0000 7f94f0641640 1 -- start start 2024-09-17T05:21:57.106 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.103+0000 7f94f0641640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94d00053a0 0x7f94e80b4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:57.106 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.103+0000 7f94f0641640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94e8071960 0x7f94e80b5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:57.106 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.103+0000 7f94f0641640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94e81f4f40 0x7f94e81f53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:57.106 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.103+0000 7f94f0641640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f94e80cc9f0 con 0x7f94d00053a0 2024-09-17T05:21:57.106 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.103+0000 7f94f0641640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f94e80cc870 con 0x7f94e81f4f40 2024-09-17T05:21:57.106 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.103+0000 7f94f0641640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f94e80ccb70 con 0x7f94e8071960 2024-09-17T05:21:57.107 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.103+0000 7f94ee3dd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94d00053a0 0x7f94e80b4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:57.107 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.103+0000 7f94ee3dd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94d00053a0 0x7f94e80b4bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47342/0 (socket says 172.21.15.98:47342) 2024-09-17T05:21:57.107 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.103+0000 7f94ee3dd640 1 -- 172.21.15.98:0/527087465 learned_addr learned my addr 172.21.15.98:0/527087465 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:21:57.107 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.103+0000 7f94ee3dd640 1 -- 172.21.15.98:0/527087465 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94e8071960 msgr2=0x7f94e80b5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:57.107 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.103+0000 7f94ee3dd640 1 --2- 172.21.15.98:0/527087465 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94e8071960 0x7f94e80b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:57.107 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.103+0000 7f94ee3dd640 1 -- 172.21.15.98:0/527087465 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94e81f4f40 msgr2=0x7f94e81f53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:57.107 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.103+0000 7f94ee3dd640 1 --2- 172.21.15.98:0/527087465 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94e81f4f40 0x7f94e81f53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:57.107 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.103+0000 7f94ee3dd640 1 -- 172.21.15.98:0/527087465 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94e80b6670 con 0x7f94d00053a0 2024-09-17T05:21:57.107 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.103+0000 7f94ee3dd640 1 --2- 172.21.15.98:0/527087465 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94d00053a0 0x7f94e80b4bd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f94e0004ed0 tx=0x7f94e0001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:57.108 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.103+0000 7f94e6ffd640 1 -- 172.21.15.98:0/527087465 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e0015020 con 0x7f94d00053a0 2024-09-17T05:21:57.108 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.103+0000 7f94e6ffd640 1 -- 172.21.15.98:0/527087465 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f94e0011960 con 0x7f94d00053a0 2024-09-17T05:21:57.108 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.103+0000 7f94f0641640 1 -- 172.21.15.98:0/527087465 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94e80b6950 con 0x7f94d00053a0 2024-09-17T05:21:57.108 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.103+0000 7f94e6ffd640 1 -- 172.21.15.98:0/527087465 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e0011d90 con 0x7f94d00053a0 2024-09-17T05:21:57.108 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.103+0000 7f94f0641640 1 -- 172.21.15.98:0/527087465 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94e80b6f10 con 0x7f94d00053a0 2024-09-17T05:21:57.108 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.104+0000 7f94f0641640 1 -- 172.21.15.98:0/527087465 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94e80cd0d0 con 0x7f94d00053a0 2024-09-17T05:21:57.108 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.105+0000 7f94e6ffd640 1 -- 172.21.15.98:0/527087465 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f94e0018020 con 0x7f94d00053a0 2024-09-17T05:21:57.109 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.105+0000 7f94e6ffd640 1 --2- 172.21.15.98:0/527087465 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f94d4078bc0 0x7f94d407b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:57.109 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.106+0000 7f94e6ffd640 1 -- 172.21.15.98:0/527087465 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f94e009b6e0 con 0x7f94d00053a0 2024-09-17T05:21:57.109 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.106+0000 7f94edbdc640 1 --2- 172.21.15.98:0/527087465 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f94d4078bc0 0x7f94d407b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:57.109 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.106+0000 7f94edbdc640 1 --2- 172.21.15.98:0/527087465 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f94d4078bc0 0x7f94d407b080 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f94e815d1d0 tx=0x7f94dc000f50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:57.110 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.110+0000 7f94e6ffd640 1 -- 172.21.15.98:0/527087465 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f94e001f020 con 0x7f94d00053a0 2024-09-17T05:21:57.286 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.285+0000 7f94f0641640 1 -- 172.21.15.98:0/527087465 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f94e80c5200 con 0x7f94d00053a0 2024-09-17T05:21:57.287 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.286+0000 7f94e6ffd640 1 -- 172.21.15.98:0/527087465 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16653 (secure 0 0 0) 0x7f94e0063bb0 con 0x7f94d00053a0 2024-09-17T05:21:57.288 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:21:57.288 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":21,"fsid":"fcbf5a43-b3d8-497c-b15d-3cc022477cf0","created":"2024-09-17T05:21:29.852143+0000","modified":"2024-09-17T05:21:55.491401+0000","last_up_change":"2024-09-17T05:21:42.925756+0000","last_in_change":"2024-09-17T05:21:32.893880+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:21:42.263011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:21:51.665719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T05:21:52.780673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ad711a-df74-438b-b0dc-1499d685c958","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6825","nonce":3644101529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6827","nonce":3644101529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6831","nonce":3644101529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6829","nonce":3644101529}]},"public_addr":"172.21.15.98:6825/3644101529","cluster_addr":"172.21.15.98:6827/3644101529","heartbeat_back_addr":"172.21.15.98:6831/3644101529","heartbeat_front_addr":"172.21.15.98:6829/3644101529","state":["exists","up"]},{"osd":1,"uuid":"f0ccb08d-4d8d-47b8-9320-8c372a6605b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6817","nonce":3902180920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6819","nonce":3902180920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6823","nonce":3902180920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6821","nonce":3902180920}]},"public_addr":"172.21.15.98:6817/3902180920","cluster_addr":"172.21.15.98:6819/3902180920","heartbeat_back_addr":"172.21.15.98:6823/3902180920","heartbeat_front_addr":"172.21.15.98:6821/3902180920","state":["exists","up"]},{"osd":2,"uuid":"a0985398-5e5f-494f-8abf-f785f19e94ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6801","nonce":1518887101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6803","nonce":1518887101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6807","nonce":1518887101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6805","nonce":1518887101}]},"public_addr":"172.21.15.98:6801/1518887101","cluster_addr":"172.21.15.98:6803/1518887101","heartbeat_back_addr":"172.21.15.98:6807/1518887101","heartbeat_front_addr":"172.21.15.98:6805/1518887101","state":["exists","up"]},{"osd":3,"uuid":"e960be2e-0c3a-426e-9507-d3be5895f9e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6809","nonce":4125246091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6811","nonce":4125246091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6815","nonce":4125246091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6813","nonce":4125246091}]},"public_addr":"172.21.15.98:6809/4125246091","cluster_addr":"172.21.15.98:6811/4125246091","heartbeat_back_addr":"172.21.15.98:6815/4125246091","heartbeat_front_addr":"172.21.15.98:6813/4125246091","state":["exists","up"]},{"osd":4,"uuid":"49118c00-3dc1-43ef-8ed4-aca61e56a507","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6811","nonce":765789888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6813","nonce":765789888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6817","nonce":765789888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6815","nonce":765789888}]},"public_addr":"172.21.15.167:6811/765789888","cluster_addr":"172.21.15.167:6813/765789888","heartbeat_back_addr":"172.21.15.167:6817/765789888","heartbeat_front_addr":"172.21.15.167:6815/765789888","state":["exists","up"]},{"osd":5,"uuid":"9f4e0143-2b3d-40e4-bfb5-043d9a9f4ba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6803","nonce":2567019914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6805","nonce":2567019914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6809","nonce":2567019914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6807","nonce":2567019914}]},"public_addr":"172.21.15.167:6803/2567019914","cluster_addr":"172.21.15.167:6805/2567019914","heartbeat_back_addr":"172.21.15.167:6809/2567019914","heartbeat_front_addr":"172.21.15.167:6807/2567019914","state":["exists","up"]},{"osd":6,"uuid":"28720514-e627-4dea-8f4d-bd311ec31361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6819","nonce":96262631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6821","nonce":96262631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6825","nonce":96262631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6823","nonce":96262631}]},"public_addr":"172.21.15.167:6819/96262631","cluster_addr":"172.21.15.167:6821/96262631","heartbeat_back_addr":"172.21.15.167:6825/96262631","heartbeat_front_addr":"172.21.15.167:6823/96262631","state":["exists","up"]},{"osd":7,"uuid":"01edaf9c-3898-406e-85b0-774cfda60adf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6827","nonce":4169560909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6829","nonce":4169560909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6833","nonce":4169560909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6831","nonce":4169560909}]},"public_addr":"172.21.15.167:6827/4169560909","cluster_addr":"172.21.15.167:6829/4169560909","heartbeat_back_addr":"172.21.15.167:6833/4169560909","heartbeat_front_addr":"172.21.15.167:6831/4169560909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:40.054920+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.177110+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.749278+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.400155+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.503576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.196417+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.371063+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.212852+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:21:57.290 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.288+0000 7f94f0641640 1 -- 172.21.15.98:0/527087465 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f94d4078bc0 msgr2=0x7f94d407b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:57.290 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.288+0000 7f94f0641640 1 --2- 172.21.15.98:0/527087465 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f94d4078bc0 0x7f94d407b080 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f94e815d1d0 tx=0x7f94dc000f50 comp rx=0 tx=0).stop 2024-09-17T05:21:57.290 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.288+0000 7f94f0641640 1 -- 172.21.15.98:0/527087465 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94d00053a0 msgr2=0x7f94e80b4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:57.290 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.288+0000 7f94f0641640 1 --2- 172.21.15.98:0/527087465 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94d00053a0 0x7f94e80b4bd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f94e0004ed0 tx=0x7f94e0001630 comp rx=0 tx=0).stop 2024-09-17T05:21:57.290 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.288+0000 7f94f0641640 1 -- 172.21.15.98:0/527087465 shutdown_connections 2024-09-17T05:21:57.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.288+0000 7f94f0641640 1 --2- 172.21.15.98:0/527087465 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f94d4078bc0 0x7f94d407b080 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:57.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.288+0000 7f94f0641640 1 --2- 172.21.15.98:0/527087465 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94e81f4f40 0x7f94e81f53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:57.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.288+0000 7f94f0641640 1 --2- 172.21.15.98:0/527087465 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94e8071960 0x7f94e80b5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:57.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.288+0000 7f94f0641640 1 --2- 172.21.15.98:0/527087465 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94d00053a0 0x7f94e80b4bd0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:57.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.288+0000 7f94f0641640 1 -- 172.21.15.98:0/527087465 >> 172.21.15.98:0/527087465 conn(0x7f94e80d1d80 msgr2=0x7f94e8144910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:57.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.288+0000 7f94f0641640 1 -- 172.21.15.98:0/527087465 shutdown_connections 2024-09-17T05:21:57.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.288+0000 7f94f0641640 1 -- 172.21.15.98:0/527087465 wait complete. 2024-09-17T05:21:57.300 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T05:21:57.300 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:21:57.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.401+0000 7f348552b640 1 -- 172.21.15.98:0/1722681085 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3480071490 msgr2=0x7f348015f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:57.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.401+0000 7f348552b640 1 --2- 172.21.15.98:0/1722681085 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3480071490 0x7f348015f7d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f34800d0eb0 tx=0x7f347802a5f0 comp rx=0 tx=0).stop 2024-09-17T05:21:57.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.401+0000 7f348552b640 1 -- 172.21.15.98:0/1722681085 shutdown_connections 2024-09-17T05:21:57.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.401+0000 7f348552b640 1 --2- 172.21.15.98:0/1722681085 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3480071490 0x7f348015f7d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:57.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.401+0000 7f348552b640 1 --2- 172.21.15.98:0/1722681085 >> v2:172.21.15.167:3300/0 conn(0x7f348015bac0 0x7f34800cd8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:57.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.401+0000 7f348552b640 1 -- 172.21.15.98:0/1722681085 >> 172.21.15.98:0/1722681085 conn(0x7f34800b2b90 msgr2=0x7f34800b2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:57.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.401+0000 7f348552b640 1 -- 172.21.15.98:0/1722681085 shutdown_connections 2024-09-17T05:21:57.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.401+0000 7f348552b640 1 -- 172.21.15.98:0/1722681085 wait complete. 2024-09-17T05:21:57.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.402+0000 7f348552b640 1 Processor -- start 2024-09-17T05:21:57.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.402+0000 7f348552b640 1 -- start start 2024-09-17T05:21:57.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.403+0000 7f348552b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3480071490 0x7f348013d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:57.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.403+0000 7f348552b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f348015bac0 0x7f34801f1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:57.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.403+0000 7f348552b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f348015bea0 0x7f34801430c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:57.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.403+0000 7f348552b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f34801600a0 con 0x7f348015bea0 2024-09-17T05:21:57.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.403+0000 7f348552b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f348015ff20 con 0x7f348015bac0 2024-09-17T05:21:57.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.403+0000 7f348552b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f348006cb70 con 0x7f3480071490 2024-09-17T05:21:57.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.403+0000 7f347f7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f348015bea0 0x7f34801430c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:57.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.403+0000 7f347f7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f348015bea0 0x7f34801430c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47362/0 (socket says 172.21.15.98:47362) 2024-09-17T05:21:57.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.403+0000 7f347f7fe640 1 -- 172.21.15.98:0/579768813 learned_addr learned my addr 172.21.15.98:0/579768813 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:21:57.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.403+0000 7f347e7fc640 1 --2- 172.21.15.98:0/579768813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f348015bac0 0x7f34801f1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:57.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.403+0000 7f347effd640 1 --2- 172.21.15.98:0/579768813 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3480071490 0x7f348013d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:57.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.403+0000 7f347f7fe640 1 -- 172.21.15.98:0/579768813 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3480071490 msgr2=0x7f348013d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:57.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.403+0000 7f347f7fe640 1 --2- 172.21.15.98:0/579768813 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3480071490 0x7f348013d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:57.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.403+0000 7f347f7fe640 1 -- 172.21.15.98:0/579768813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f348015bac0 msgr2=0x7f34801f1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:57.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.403+0000 7f347f7fe640 1 --2- 172.21.15.98:0/579768813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f348015bac0 0x7f34801f1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:57.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.403+0000 7f347f7fe640 1 -- 172.21.15.98:0/579768813 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f348013d910 con 0x7f348015bea0 2024-09-17T05:21:57.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.403+0000 7f347f7fe640 1 --2- 172.21.15.98:0/579768813 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f348015bea0 0x7f34801430c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3478009230 tx=0x7f3478003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:57.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.403+0000 7f34777fe640 1 -- 172.21.15.98:0/579768813 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f347803f070 con 0x7f348015bea0 2024-09-17T05:21:57.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.403+0000 7f34777fe640 1 -- 172.21.15.98:0/579768813 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f34780047a0 con 0x7f348015bea0 2024-09-17T05:21:57.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.404+0000 7f348552b640 1 -- 172.21.15.98:0/579768813 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f348013dbf0 con 0x7f348015bea0 2024-09-17T05:21:57.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.404+0000 7f34777fe640 1 -- 172.21.15.98:0/579768813 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3478035030 con 0x7f348015bea0 2024-09-17T05:21:57.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.404+0000 7f348552b640 1 -- 172.21.15.98:0/579768813 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34801599b0 con 0x7f348015bea0 2024-09-17T05:21:57.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.404+0000 7f348552b640 1 -- 172.21.15.98:0/579768813 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f348015f7d0 con 0x7f348015bea0 2024-09-17T05:21:57.408 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.405+0000 7f34777fe640 1 -- 172.21.15.98:0/579768813 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3478042070 con 0x7f348015bea0 2024-09-17T05:21:57.408 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.406+0000 7f34777fe640 1 --2- 172.21.15.98:0/579768813 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f3460078b90 0x7f346007b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:57.408 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.406+0000 7f34777fe640 1 -- 172.21.15.98:0/579768813 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f34780bbab0 con 0x7f348015bea0 2024-09-17T05:21:57.408 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.406+0000 7f347effd640 1 --2- 172.21.15.98:0/579768813 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f3460078b90 0x7f346007b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:57.408 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.406+0000 7f347effd640 1 --2- 172.21.15.98:0/579768813 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f3460078b90 0x7f346007b050 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3470005fd0 tx=0x7f3470009680 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:57.410 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.410+0000 7f34777fe640 1 -- 172.21.15.98:0/579768813 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f3478083930 con 0x7f348015bea0 2024-09-17T05:21:57.587 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.586+0000 7f348552b640 1 -- 172.21.15.98:0/579768813 --> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f34800b30a0 con 0x7f3460078b90 2024-09-17T05:21:57.591 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.590+0000 7f34777fe640 1 -- 172.21.15.98:0/579768813 <== mgr.4103 v2:172.21.15.167:6800/610796449 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+238090 (secure 0 0 0) 0x7f34800b30a0 con 0x7f3460078b90 2024-09-17T05:21:57.594 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:21:57.595 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-17T05:21:57.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.594+0000 7f348552b640 1 -- 172.21.15.98:0/579768813 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f3460078b90 msgr2=0x7f346007b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:57.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.594+0000 7f348552b640 1 --2- 172.21.15.98:0/579768813 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f3460078b90 0x7f346007b050 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3470005fd0 tx=0x7f3470009680 comp rx=0 tx=0).stop 2024-09-17T05:21:57.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.594+0000 7f348552b640 1 -- 172.21.15.98:0/579768813 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f348015bea0 msgr2=0x7f34801430c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:57.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.594+0000 7f348552b640 1 --2- 172.21.15.98:0/579768813 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f348015bea0 0x7f34801430c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3478009230 tx=0x7f3478003960 comp rx=0 tx=0).stop 2024-09-17T05:21:57.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.594+0000 7f348552b640 1 -- 172.21.15.98:0/579768813 shutdown_connections 2024-09-17T05:21:57.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.594+0000 7f348552b640 1 --2- 172.21.15.98:0/579768813 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f3460078b90 0x7f346007b050 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:57.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.594+0000 7f348552b640 1 --2- 172.21.15.98:0/579768813 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f348015bea0 0x7f34801430c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:57.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.594+0000 7f348552b640 1 --2- 172.21.15.98:0/579768813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f348015bac0 0x7f34801f1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:57.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.594+0000 7f348552b640 1 --2- 172.21.15.98:0/579768813 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3480071490 0x7f348013d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:57.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.594+0000 7f348552b640 1 -- 172.21.15.98:0/579768813 >> 172.21.15.98:0/579768813 conn(0x7f34800b2b90 msgr2=0x7f34800b13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:57.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.594+0000 7f348552b640 1 -- 172.21.15.98:0/579768813 shutdown_connections 2024-09-17T05:21:57.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.594+0000 7f348552b640 1 -- 172.21.15.98:0/579768813 wait complete. 2024-09-17T05:21:57.606 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-17T05:21:56.248467+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":20,"acting":20,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":218920,"kb_used_data":2432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755800,"statfs":{"total":773094113280,"available":772869939200,"internally_reserved":0,"allocated":2490368,"data_stored":1578082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000758"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:21:52.472932+0000","last_change":"2024-09-17T05:21:52.472932+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.472932+0000","last_undegraded":"2024-09-17T05:21:52.472932+0000","last_fullsized":"2024-09-17T05:21:52.472932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:52.460729+0000","last_change":"2024-09-17T05:21:52.460729+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.460729+0000","last_undegraded":"2024-09-17T05:21:52.460729+0000","last_fullsized":"2024-09-17T05:21:52.460729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:21:52.472910+0000","last_change":"2024-09-17T05:21:52.472910+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.472910+0000","last_undegraded":"2024-09-17T05:21:52.472910+0000","last_fullsized":"2024-09-17T05:21:52.472910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:52.460729+0000","last_change":"2024-09-17T05:21:52.460729+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.460729+0000","last_undegraded":"2024-09-17T05:21:52.460729+0000","last_fullsized":"2024-09-17T05:21:52.460729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:52.460729+0000","last_change":"2024-09-17T05:21:52.460729+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.460729+0000","last_undegraded":"2024-09-17T05:21:52.460729+0000","last_fullsized":"2024-09-17T05:21:52.460729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:52.460729+0000","last_change":"2024-09-17T05:21:52.460729+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.460729+0000","last_undegraded":"2024-09-17T05:21:52.460729+0000","last_fullsized":"2024-09-17T05:21:52.460729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:52.460729+0000","last_change":"2024-09-17T05:21:52.460729+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.460729+0000","last_undegraded":"2024-09-17T05:21:52.460729+0000","last_fullsized":"2024-09-17T05:21:52.460729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:52.460729+0000","last_change":"2024-09-17T05:21:52.460729+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.460729+0000","last_undegraded":"2024-09-17T05:21:52.460729+0000","last_fullsized":"2024-09-17T05:21:52.460729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:21:52.473895+0000","last_change":"2024-09-17T05:21:52.473895+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.473895+0000","last_undegraded":"2024-09-17T05:21:52.473895+0000","last_fullsized":"2024-09-17T05:21:52.473895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:52.460729+0000","last_change":"2024-09-17T05:21:52.460729+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.460729+0000","last_undegraded":"2024-09-17T05:21:52.460729+0000","last_fullsized":"2024-09-17T05:21:52.460729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:52.460729+0000","last_change":"2024-09-17T05:21:52.460729+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.460729+0000","last_undegraded":"2024-09-17T05:21:52.460729+0000","last_fullsized":"2024-09-17T05:21:52.460729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:21:52.475573+0000","last_change":"2024-09-17T05:21:52.475573+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.475573+0000","last_undegraded":"2024-09-17T05:21:52.475573+0000","last_fullsized":"2024-09-17T05:21:52.475573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:52.460729+0000","last_change":"2024-09-17T05:21:52.460729+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.460729+0000","last_undegraded":"2024-09-17T05:21:52.460729+0000","last_fullsized":"2024-09-17T05:21:52.460729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:21:52.475586+0000","last_change":"2024-09-17T05:21:52.475586+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.475586+0000","last_undegraded":"2024-09-17T05:21:52.475586+0000","last_fullsized":"2024-09-17T05:21:52.475586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:52.460729+0000","last_change":"2024-09-17T05:21:52.460729+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.460729+0000","last_undegraded":"2024-09-17T05:21:52.460729+0000","last_fullsized":"2024-09-17T05:21:52.460729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:21:52.476027+0000","last_change":"2024-09-17T05:21:52.476027+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.476027+0000","last_undegraded":"2024-09-17T05:21:52.476027+0000","last_fullsized":"2024-09-17T05:21:52.476027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":103,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-17T05:21:44.936297+0000","last_change":"2024-09-17T05:21:44.086098+0000","last_active":"2024-09-17T05:21:44.936297+0000","last_peered":"2024-09-17T05:21:44.936297+0000","last_clean":"2024-09-17T05:21:44.936297+0000","last_became_active":"2024-09-17T05:21:44.083477+0000","last_became_peered":"2024-09-17T05:21:44.083477+0000","last_unstale":"2024-09-17T05:21:44.936297+0000","last_undegraded":"2024-09-17T05:21:44.936297+0000","last_fullsized":"2024-09-17T05:21:44.936297+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:42.925756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:42.925756+0000","last_clean_scrub_stamp":"2024-09-17T05:21:42.925756+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:11.410250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:52.460729+0000","last_change":"2024-09-17T05:21:52.460729+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.460729+0000","last_undegraded":"2024-09-17T05:21:52.460729+0000","last_fullsized":"2024-09-17T05:21:52.460729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:52.460729+0000","last_change":"2024-09-17T05:21:52.460729+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.460729+0000","last_undegraded":"2024-09-17T05:21:52.460729+0000","last_fullsized":"2024-09-17T05:21:52.460729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:21:52.475966+0000","last_change":"2024-09-17T05:21:52.475966+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.475966+0000","last_undegraded":"2024-09-17T05:21:52.475966+0000","last_fullsized":"2024-09-17T05:21:52.475966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:52.460729+0000","last_change":"2024-09-17T05:21:52.460729+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.460729+0000","last_undegraded":"2024-09-17T05:21:52.460729+0000","last_fullsized":"2024-09-17T05:21:52.460729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:52.460729+0000","last_change":"2024-09-17T05:21:52.460729+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.460729+0000","last_undegraded":"2024-09-17T05:21:52.460729+0000","last_fullsized":"2024-09-17T05:21:52.460729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:52.460729+0000","last_change":"2024-09-17T05:21:52.460729+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.460729+0000","last_undegraded":"2024-09-17T05:21:52.460729+0000","last_fullsized":"2024-09-17T05:21:52.460729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:52.460729+0000","last_change":"2024-09-17T05:21:52.460729+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.460729+0000","last_undegraded":"2024-09-17T05:21:52.460729+0000","last_fullsized":"2024-09-17T05:21:52.460729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:52.460729+0000","last_change":"2024-09-17T05:21:52.460729+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.460729+0000","last_undegraded":"2024-09-17T05:21:52.460729+0000","last_fullsized":"2024-09-17T05:21:52.460729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:52.460729+0000","last_change":"2024-09-17T05:21:52.460729+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.460729+0000","last_undegraded":"2024-09-17T05:21:52.460729+0000","last_fullsized":"2024-09-17T05:21:52.460729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:52.460729+0000","last_change":"2024-09-17T05:21:52.460729+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.460729+0000","last_undegraded":"2024-09-17T05:21:52.460729+0000","last_fullsized":"2024-09-17T05:21:52.460729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:52.460729+0000","last_change":"2024-09-17T05:21:52.460729+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.460729+0000","last_undegraded":"2024-09-17T05:21:52.460729+0000","last_fullsized":"2024-09-17T05:21:52.460729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:52.460729+0000","last_change":"2024-09-17T05:21:52.460729+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.460729+0000","last_undegraded":"2024-09-17T05:21:52.460729+0000","last_fullsized":"2024-09-17T05:21:52.460729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:52.460729+0000","last_change":"2024-09-17T05:21:52.460729+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.460729+0000","last_undegraded":"2024-09-17T05:21:52.460729+0000","last_fullsized":"2024-09-17T05:21:52.460729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:52.460729+0000","last_change":"2024-09-17T05:21:52.460729+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.460729+0000","last_undegraded":"2024-09-17T05:21:52.460729+0000","last_fullsized":"2024-09-17T05:21:52.460729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:21:52.473007+0000","last_change":"2024-09-17T05:21:52.473007+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.473007+0000","last_undegraded":"2024-09-17T05:21:52.473007+0000","last_fullsized":"2024-09-17T05:21:52.473007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:21:52.473390+0000","last_change":"2024-09-17T05:21:52.473390+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.473390+0000","last_undegraded":"2024-09-17T05:21:52.473390+0000","last_fullsized":"2024-09-17T05:21:52.473390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":159744,"data_stored":48214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":54031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":765952,"data_stored":644399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28012,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343828,"statfs":{"total":96636764160,"available":96608079872,"internally_reserved":0,"allocated":753664,"data_stored":638582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27188,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":159744,"data_stored":48214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27188,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":159744,"data_stored":48214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":159744,"data_stored":48214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27188,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":159744,"data_stored":48214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:21:57.613 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:21:57.746 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.745+0000 7f16d73ad640 1 -- 172.21.15.98:0/3534984761 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16bc004b10 msgr2=0x7f16bc004f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:57.746 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.745+0000 7f16d73ad640 1 --2- 172.21.15.98:0/3534984761 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16bc004b10 0x7f16bc004f10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f16cc00baf0 tx=0x7f16bc006940 comp rx=0 tx=0).stop 2024-09-17T05:21:57.747 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.745+0000 7f16d73ad640 1 -- 172.21.15.98:0/3534984761 shutdown_connections 2024-09-17T05:21:57.747 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.745+0000 7f16d73ad640 1 --2- 172.21.15.98:0/3534984761 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16bc004b10 0x7f16bc004f10 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:57.747 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.745+0000 7f16d73ad640 1 -- 172.21.15.98:0/3534984761 >> 172.21.15.98:0/3534984761 conn(0x7f16d00b1950 msgr2=0x7f16d00b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:57.747 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.745+0000 7f16d73ad640 1 -- 172.21.15.98:0/3534984761 shutdown_connections 2024-09-17T05:21:57.747 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.745+0000 7f16d73ad640 1 -- 172.21.15.98:0/3534984761 wait complete. 2024-09-17T05:21:57.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.746+0000 7f16d73ad640 1 Processor -- start 2024-09-17T05:21:57.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.746+0000 7f16d73ad640 1 -- start start 2024-09-17T05:21:57.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.747+0000 7f16d73ad640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f16bc004b10 0x7f16d009b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:57.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.747+0000 7f16d73ad640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16d00c5eb0 0x7f16d00b04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:57.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.747+0000 7f16d73ad640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16d00c6310 0x7f16d00b09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:57.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.747+0000 7f16d73ad640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f16d006ef40 con 0x7f16d00c6310 2024-09-17T05:21:57.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.747+0000 7f16d73ad640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f16d0070b30 con 0x7f16d00c5eb0 2024-09-17T05:21:57.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.747+0000 7f16d73ad640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f16d00cc5f0 con 0x7f16bc004b10 2024-09-17T05:21:57.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.747+0000 7f16d594a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16d00c6310 0x7f16d00b09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:57.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.747+0000 7f16d594a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16d00c6310 0x7f16d00b09e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47388/0 (socket says 172.21.15.98:47388) 2024-09-17T05:21:57.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.747+0000 7f16d594a640 1 -- 172.21.15.98:0/2673821056 learned_addr learned my addr 172.21.15.98:0/2673821056 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:21:57.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.747+0000 7f16d4948640 1 --2- 172.21.15.98:0/2673821056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16d00c5eb0 0x7f16d00b04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:57.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.747+0000 7f16d5149640 1 --2- 172.21.15.98:0/2673821056 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f16bc004b10 0x7f16d009b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:57.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.748+0000 7f16d594a640 1 -- 172.21.15.98:0/2673821056 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f16bc004b10 msgr2=0x7f16d009b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:57.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.748+0000 7f16d594a640 1 --2- 172.21.15.98:0/2673821056 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f16bc004b10 0x7f16d009b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:57.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.748+0000 7f16d594a640 1 -- 172.21.15.98:0/2673821056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16d00c5eb0 msgr2=0x7f16d00b04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:57.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.748+0000 7f16d594a640 1 --2- 172.21.15.98:0/2673821056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16d00c5eb0 0x7f16d00b04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:57.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.748+0000 7f16d594a640 1 -- 172.21.15.98:0/2673821056 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16d01f3cb0 con 0x7f16d00c6310 2024-09-17T05:21:57.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.748+0000 7f16d594a640 1 --2- 172.21.15.98:0/2673821056 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16d00c6310 0x7f16d00b09e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f16d00cd3e0 tx=0x7f16c8004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:57.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.748+0000 7f16c5ffb640 1 -- 172.21.15.98:0/2673821056 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c8010690 con 0x7f16d00c6310 2024-09-17T05:21:57.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.748+0000 7f16c5ffb640 1 -- 172.21.15.98:0/2673821056 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f16c8010940 con 0x7f16d00c6310 2024-09-17T05:21:57.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.748+0000 7f16d73ad640 1 -- 172.21.15.98:0/2673821056 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16d009aa00 con 0x7f16d00c6310 2024-09-17T05:21:57.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.748+0000 7f16c5ffb640 1 -- 172.21.15.98:0/2673821056 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c8010d90 con 0x7f16d00c6310 2024-09-17T05:21:57.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.748+0000 7f16d73ad640 1 -- 172.21.15.98:0/2673821056 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16d009afc0 con 0x7f16d00c6310 2024-09-17T05:21:57.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.749+0000 7f16d73ad640 1 -- 172.21.15.98:0/2673821056 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16d006f850 con 0x7f16d00c6310 2024-09-17T05:21:57.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.750+0000 7f16c5ffb640 1 -- 172.21.15.98:0/2673821056 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f16c801a020 con 0x7f16d00c6310 2024-09-17T05:21:57.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.750+0000 7f16c5ffb640 1 --2- 172.21.15.98:0/2673821056 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f16b4078b90 0x7f16b407b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:57.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.750+0000 7f16c5ffb640 1 -- 172.21.15.98:0/2673821056 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f16c809aa50 con 0x7f16d00c6310 2024-09-17T05:21:57.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.750+0000 7f16d5149640 1 --2- 172.21.15.98:0/2673821056 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f16b4078b90 0x7f16b407b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:57.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.751+0000 7f16d5149640 1 --2- 172.21.15.98:0/2673821056 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f16b4078b90 0x7f16b407b050 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f16cc036000 tx=0x7f16cc03d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:57.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.754+0000 7f16c5ffb640 1 -- 172.21.15.98:0/2673821056 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f16c8021020 con 0x7f16d00c6310 2024-09-17T05:21:57.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.929+0000 7f16d73ad640 1 -- 172.21.15.98:0/2673821056 --> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f16d00cd430 con 0x7f16b4078b90 2024-09-17T05:21:57.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.933+0000 7f16c5ffb640 1 -- 172.21.15.98:0/2673821056 <== mgr.4103 v2:172.21.15.167:6800/610796449 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+238090 (secure 0 0 0) 0x7f16d00cd430 con 0x7f16b4078b90 2024-09-17T05:21:57.937 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:21:57.938 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-17T05:21:57.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.936+0000 7f16d73ad640 1 -- 172.21.15.98:0/2673821056 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f16b4078b90 msgr2=0x7f16b407b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:57.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.936+0000 7f16d73ad640 1 --2- 172.21.15.98:0/2673821056 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f16b4078b90 0x7f16b407b050 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f16cc036000 tx=0x7f16cc03d040 comp rx=0 tx=0).stop 2024-09-17T05:21:57.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.936+0000 7f16d73ad640 1 -- 172.21.15.98:0/2673821056 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16d00c6310 msgr2=0x7f16d00b09e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:57.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.936+0000 7f16d73ad640 1 --2- 172.21.15.98:0/2673821056 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16d00c6310 0x7f16d00b09e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f16d00cd3e0 tx=0x7f16c8004f90 comp rx=0 tx=0).stop 2024-09-17T05:21:57.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.937+0000 7f16d73ad640 1 -- 172.21.15.98:0/2673821056 shutdown_connections 2024-09-17T05:21:57.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.937+0000 7f16d73ad640 1 --2- 172.21.15.98:0/2673821056 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f16b4078b90 0x7f16b407b050 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:57.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.937+0000 7f16d73ad640 1 --2- 172.21.15.98:0/2673821056 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16d00c6310 0x7f16d00b09e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:57.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.937+0000 7f16d73ad640 1 --2- 172.21.15.98:0/2673821056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16d00c5eb0 0x7f16d00b04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:57.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.937+0000 7f16d73ad640 1 --2- 172.21.15.98:0/2673821056 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f16bc004b10 0x7f16d009b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:57.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.937+0000 7f16d73ad640 1 -- 172.21.15.98:0/2673821056 >> 172.21.15.98:0/2673821056 conn(0x7f16d00b1950 msgr2=0x7f16d00adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:57.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.937+0000 7f16d73ad640 1 -- 172.21.15.98:0/2673821056 shutdown_connections 2024-09-17T05:21:57.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:57.937+0000 7f16d73ad640 1 -- 172.21.15.98:0/2673821056 wait complete. 2024-09-17T05:21:57.947 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-17T05:21:56.248467+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":20,"acting":20,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":218920,"kb_used_data":2432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755800,"statfs":{"total":773094113280,"available":772869939200,"internally_reserved":0,"allocated":2490368,"data_stored":1578082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000758"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:21:52.472932+0000","last_change":"2024-09-17T05:21:52.472932+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.472932+0000","last_undegraded":"2024-09-17T05:21:52.472932+0000","last_fullsized":"2024-09-17T05:21:52.472932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:52.460729+0000","last_change":"2024-09-17T05:21:52.460729+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.460729+0000","last_undegraded":"2024-09-17T05:21:52.460729+0000","last_fullsized":"2024-09-17T05:21:52.460729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:21:52.472910+0000","last_change":"2024-09-17T05:21:52.472910+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.472910+0000","last_undegraded":"2024-09-17T05:21:52.472910+0000","last_fullsized":"2024-09-17T05:21:52.472910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:52.460729+0000","last_change":"2024-09-17T05:21:52.460729+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.460729+0000","last_undegraded":"2024-09-17T05:21:52.460729+0000","last_fullsized":"2024-09-17T05:21:52.460729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:52.460729+0000","last_change":"2024-09-17T05:21:52.460729+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.460729+0000","last_undegraded":"2024-09-17T05:21:52.460729+0000","last_fullsized":"2024-09-17T05:21:52.460729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:52.460729+0000","last_change":"2024-09-17T05:21:52.460729+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.460729+0000","last_undegraded":"2024-09-17T05:21:52.460729+0000","last_fullsized":"2024-09-17T05:21:52.460729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:52.460729+0000","last_change":"2024-09-17T05:21:52.460729+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.460729+0000","last_undegraded":"2024-09-17T05:21:52.460729+0000","last_fullsized":"2024-09-17T05:21:52.460729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:52.460729+0000","last_change":"2024-09-17T05:21:52.460729+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.460729+0000","last_undegraded":"2024-09-17T05:21:52.460729+0000","last_fullsized":"2024-09-17T05:21:52.460729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:21:52.473895+0000","last_change":"2024-09-17T05:21:52.473895+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.473895+0000","last_undegraded":"2024-09-17T05:21:52.473895+0000","last_fullsized":"2024-09-17T05:21:52.473895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:52.460729+0000","last_change":"2024-09-17T05:21:52.460729+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.460729+0000","last_undegraded":"2024-09-17T05:21:52.460729+0000","last_fullsized":"2024-09-17T05:21:52.460729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:52.460729+0000","last_change":"2024-09-17T05:21:52.460729+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.460729+0000","last_undegraded":"2024-09-17T05:21:52.460729+0000","last_fullsized":"2024-09-17T05:21:52.460729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:21:52.475573+0000","last_change":"2024-09-17T05:21:52.475573+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.475573+0000","last_undegraded":"2024-09-17T05:21:52.475573+0000","last_fullsized":"2024-09-17T05:21:52.475573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:52.460729+0000","last_change":"2024-09-17T05:21:52.460729+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.460729+0000","last_undegraded":"2024-09-17T05:21:52.460729+0000","last_fullsized":"2024-09-17T05:21:52.460729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:21:52.475586+0000","last_change":"2024-09-17T05:21:52.475586+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.475586+0000","last_undegraded":"2024-09-17T05:21:52.475586+0000","last_fullsized":"2024-09-17T05:21:52.475586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:52.460729+0000","last_change":"2024-09-17T05:21:52.460729+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.460729+0000","last_undegraded":"2024-09-17T05:21:52.460729+0000","last_fullsized":"2024-09-17T05:21:52.460729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:21:52.476027+0000","last_change":"2024-09-17T05:21:52.476027+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.476027+0000","last_undegraded":"2024-09-17T05:21:52.476027+0000","last_fullsized":"2024-09-17T05:21:52.476027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":103,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-17T05:21:44.936297+0000","last_change":"2024-09-17T05:21:44.086098+0000","last_active":"2024-09-17T05:21:44.936297+0000","last_peered":"2024-09-17T05:21:44.936297+0000","last_clean":"2024-09-17T05:21:44.936297+0000","last_became_active":"2024-09-17T05:21:44.083477+0000","last_became_peered":"2024-09-17T05:21:44.083477+0000","last_unstale":"2024-09-17T05:21:44.936297+0000","last_undegraded":"2024-09-17T05:21:44.936297+0000","last_fullsized":"2024-09-17T05:21:44.936297+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:42.925756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:42.925756+0000","last_clean_scrub_stamp":"2024-09-17T05:21:42.925756+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:11.410250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:52.460729+0000","last_change":"2024-09-17T05:21:52.460729+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.460729+0000","last_undegraded":"2024-09-17T05:21:52.460729+0000","last_fullsized":"2024-09-17T05:21:52.460729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:52.460729+0000","last_change":"2024-09-17T05:21:52.460729+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.460729+0000","last_undegraded":"2024-09-17T05:21:52.460729+0000","last_fullsized":"2024-09-17T05:21:52.460729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:21:52.475966+0000","last_change":"2024-09-17T05:21:52.475966+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.475966+0000","last_undegraded":"2024-09-17T05:21:52.475966+0000","last_fullsized":"2024-09-17T05:21:52.475966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:52.460729+0000","last_change":"2024-09-17T05:21:52.460729+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.460729+0000","last_undegraded":"2024-09-17T05:21:52.460729+0000","last_fullsized":"2024-09-17T05:21:52.460729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:52.460729+0000","last_change":"2024-09-17T05:21:52.460729+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.460729+0000","last_undegraded":"2024-09-17T05:21:52.460729+0000","last_fullsized":"2024-09-17T05:21:52.460729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:52.460729+0000","last_change":"2024-09-17T05:21:52.460729+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.460729+0000","last_undegraded":"2024-09-17T05:21:52.460729+0000","last_fullsized":"2024-09-17T05:21:52.460729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:52.460729+0000","last_change":"2024-09-17T05:21:52.460729+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.460729+0000","last_undegraded":"2024-09-17T05:21:52.460729+0000","last_fullsized":"2024-09-17T05:21:52.460729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:52.460729+0000","last_change":"2024-09-17T05:21:52.460729+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.460729+0000","last_undegraded":"2024-09-17T05:21:52.460729+0000","last_fullsized":"2024-09-17T05:21:52.460729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:52.460729+0000","last_change":"2024-09-17T05:21:52.460729+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.460729+0000","last_undegraded":"2024-09-17T05:21:52.460729+0000","last_fullsized":"2024-09-17T05:21:52.460729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:52.460729+0000","last_change":"2024-09-17T05:21:52.460729+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.460729+0000","last_undegraded":"2024-09-17T05:21:52.460729+0000","last_fullsized":"2024-09-17T05:21:52.460729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:52.460729+0000","last_change":"2024-09-17T05:21:52.460729+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.460729+0000","last_undegraded":"2024-09-17T05:21:52.460729+0000","last_fullsized":"2024-09-17T05:21:52.460729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:52.460729+0000","last_change":"2024-09-17T05:21:52.460729+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.460729+0000","last_undegraded":"2024-09-17T05:21:52.460729+0000","last_fullsized":"2024-09-17T05:21:52.460729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:52.460729+0000","last_change":"2024-09-17T05:21:52.460729+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.460729+0000","last_undegraded":"2024-09-17T05:21:52.460729+0000","last_fullsized":"2024-09-17T05:21:52.460729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:52.460729+0000","last_change":"2024-09-17T05:21:52.460729+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.460729+0000","last_undegraded":"2024-09-17T05:21:52.460729+0000","last_fullsized":"2024-09-17T05:21:52.460729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:21:52.473007+0000","last_change":"2024-09-17T05:21:52.473007+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.473007+0000","last_undegraded":"2024-09-17T05:21:52.473007+0000","last_fullsized":"2024-09-17T05:21:52.473007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:21:52.473390+0000","last_change":"2024-09-17T05:21:52.473390+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.473390+0000","last_undegraded":"2024-09-17T05:21:52.473390+0000","last_fullsized":"2024-09-17T05:21:52.473390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":159744,"data_stored":48214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":54031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":765952,"data_stored":644399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28012,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343828,"statfs":{"total":96636764160,"available":96608079872,"internally_reserved":0,"allocated":753664,"data_stored":638582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27188,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":159744,"data_stored":48214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27188,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":159744,"data_stored":48214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":159744,"data_stored":48214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27188,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":159744,"data_stored":48214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:21:57.951 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:21:58.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.087+0000 7f943e382640 1 -- 172.21.15.98:0/1092920421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94381445d0 msgr2=0x7f94380cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:58.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.087+0000 7f943e382640 1 --2- 172.21.15.98:0/1092920421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94381445d0 0x7f94380cebf0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9428009830 tx=0x7f942802a5a0 comp rx=0 tx=0).stop 2024-09-17T05:21:58.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.088+0000 7f943e382640 1 -- 172.21.15.98:0/1092920421 shutdown_connections 2024-09-17T05:21:58.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.088+0000 7f943e382640 1 --2- 172.21.15.98:0/1092920421 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94380b4ca0 0x7f94380cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:58.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.088+0000 7f943e382640 1 --2- 172.21.15.98:0/1092920421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94381445d0 0x7f94380cebf0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:58.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.088+0000 7f943e382640 1 -- 172.21.15.98:0/1092920421 >> 172.21.15.98:0/1092920421 conn(0x7f94380b1950 msgr2=0x7f94380b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:58.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.088+0000 7f943e382640 1 -- 172.21.15.98:0/1092920421 shutdown_connections 2024-09-17T05:21:58.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.088+0000 7f943e382640 1 -- 172.21.15.98:0/1092920421 wait complete. 2024-09-17T05:21:58.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.089+0000 7f943e382640 1 Processor -- start 2024-09-17T05:21:58.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.089+0000 7f943e382640 1 -- start start 2024-09-17T05:21:58.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.090+0000 7f943e382640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94380b4ca0 0x7f943815a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:58.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.090+0000 7f943e382640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94380ccfd0 0x7f943809ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:58.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.090+0000 7f943e382640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94381445d0 0x7f943809d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:58.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.090+0000 7f943e382640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f943815f080 con 0x7f94381445d0 2024-09-17T05:21:58.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.090+0000 7f943e382640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9438073bc0 con 0x7f94380ccfd0 2024-09-17T05:21:58.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.090+0000 7f943e382640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f943815f200 con 0x7f94380b4ca0 2024-09-17T05:21:58.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.090+0000 7f943c91f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94381445d0 0x7f943809d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:58.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.090+0000 7f943c91f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94381445d0 0x7f943809d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47396/0 (socket says 172.21.15.98:47396) 2024-09-17T05:21:58.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.090+0000 7f943c91f640 1 -- 172.21.15.98:0/188186223 learned_addr learned my addr 172.21.15.98:0/188186223 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:21:58.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.090+0000 7f94377fe640 1 --2- 172.21.15.98:0/188186223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94380ccfd0 0x7f943809ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:58.093 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.090+0000 7f9437fff640 1 --2- 172.21.15.98:0/188186223 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94380b4ca0 0x7f943815a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:58.093 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.090+0000 7f943c91f640 1 -- 172.21.15.98:0/188186223 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94380b4ca0 msgr2=0x7f943815a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:58.093 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.090+0000 7f943c91f640 1 --2- 172.21.15.98:0/188186223 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94380b4ca0 0x7f943815a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:58.093 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.090+0000 7f943c91f640 1 -- 172.21.15.98:0/188186223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94380ccfd0 msgr2=0x7f943809ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:58.093 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.090+0000 7f943c91f640 1 --2- 172.21.15.98:0/188186223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94380ccfd0 0x7f943809ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:58.093 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.090+0000 7f943c91f640 1 -- 172.21.15.98:0/188186223 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9438140d50 con 0x7f94381445d0 2024-09-17T05:21:58.093 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.090+0000 7f943c91f640 1 --2- 172.21.15.98:0/188186223 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94381445d0 0x7f943809d350 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f943000eb40 tx=0x7f943000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:58.093 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.090+0000 7f9434ff9640 1 -- 172.21.15.98:0/188186223 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9430004b20 con 0x7f94381445d0 2024-09-17T05:21:58.093 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.090+0000 7f9434ff9640 1 -- 172.21.15.98:0/188186223 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9430004ce0 con 0x7f94381445d0 2024-09-17T05:21:58.093 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.090+0000 7f943e382640 1 -- 172.21.15.98:0/188186223 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f943813e340 con 0x7f94381445d0 2024-09-17T05:21:58.093 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.090+0000 7f9434ff9640 1 -- 172.21.15.98:0/188186223 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9430005280 con 0x7f94381445d0 2024-09-17T05:21:58.093 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.090+0000 7f943e382640 1 -- 172.21.15.98:0/188186223 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f943809c370 con 0x7f94381445d0 2024-09-17T05:21:58.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.091+0000 7f943e382640 1 -- 172.21.15.98:0/188186223 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f943815f6b0 con 0x7f94381445d0 2024-09-17T05:21:58.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.092+0000 7f9434ff9640 1 -- 172.21.15.98:0/188186223 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9430005420 con 0x7f94381445d0 2024-09-17T05:21:58.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.092+0000 7f9434ff9640 1 --2- 172.21.15.98:0/188186223 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f9424078bc0 0x7f942407b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:58.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.093+0000 7f9434ff9640 1 -- 172.21.15.98:0/188186223 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f943009ba00 con 0x7f94381445d0 2024-09-17T05:21:58.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.093+0000 7f9437fff640 1 --2- 172.21.15.98:0/188186223 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f9424078bc0 0x7f942407b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:58.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.093+0000 7f9437fff640 1 --2- 172.21.15.98:0/188186223 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f9424078bc0 0x7f942407b080 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9428034000 tx=0x7f9428004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:58.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.097+0000 7f9434ff9640 1 -- 172.21.15.98:0/188186223 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f9430063ed0 con 0x7f94381445d0 2024-09-17T05:21:58.268 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.267+0000 7f943e382640 1 -- 172.21.15.98:0/188186223 --> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9438070a20 con 0x7f9424078bc0 2024-09-17T05:21:58.272 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.272+0000 7f9434ff9640 1 -- 172.21.15.98:0/188186223 <== mgr.4103 v2:172.21.15.167:6800/610796449 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247845 (secure 0 0 0) 0x7f9438070a20 con 0x7f9424078bc0 2024-09-17T05:21:58.275 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:21:58.276 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-17T05:21:58.278 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.275+0000 7f943e382640 1 -- 172.21.15.98:0/188186223 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f9424078bc0 msgr2=0x7f942407b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:58.278 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.275+0000 7f943e382640 1 --2- 172.21.15.98:0/188186223 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f9424078bc0 0x7f942407b080 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9428034000 tx=0x7f9428004730 comp rx=0 tx=0).stop 2024-09-17T05:21:58.278 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.275+0000 7f943e382640 1 -- 172.21.15.98:0/188186223 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94381445d0 msgr2=0x7f943809d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:58.278 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.275+0000 7f943e382640 1 --2- 172.21.15.98:0/188186223 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94381445d0 0x7f943809d350 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f943000eb40 tx=0x7f943000c2d0 comp rx=0 tx=0).stop 2024-09-17T05:21:58.278 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.275+0000 7f943e382640 1 -- 172.21.15.98:0/188186223 shutdown_connections 2024-09-17T05:21:58.278 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.275+0000 7f943e382640 1 --2- 172.21.15.98:0/188186223 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f9424078bc0 0x7f942407b080 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:58.278 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.275+0000 7f943e382640 1 --2- 172.21.15.98:0/188186223 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94381445d0 0x7f943809d350 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:58.278 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.275+0000 7f943e382640 1 --2- 172.21.15.98:0/188186223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94380ccfd0 0x7f943809ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:58.278 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.275+0000 7f943e382640 1 --2- 172.21.15.98:0/188186223 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94380b4ca0 0x7f943815a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:58.278 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.275+0000 7f943e382640 1 -- 172.21.15.98:0/188186223 >> 172.21.15.98:0/188186223 conn(0x7f94380b1950 msgr2=0x7f94380cbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:58.279 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.275+0000 7f943e382640 1 -- 172.21.15.98:0/188186223 shutdown_connections 2024-09-17T05:21:58.279 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.275+0000 7f943e382640 1 -- 172.21.15.98:0/188186223 wait complete. 2024-09-17T05:21:58.286 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-17T05:21:58.248814+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592162,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":124,"num_write_kb":1634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":93,"ondisk_log_size":93,"up":148,"acting":148,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":89,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218956,"kb_used_data":2712,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755764,"statfs":{"total":773094113280,"available":772869902336,"internally_reserved":0,"allocated":2777088,"data_stored":1706487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1794,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.781114"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.497272+0000","last_change":"2024-09-17T05:21:54.501153+0000","last_active":"2024-09-17T05:21:55.497272+0000","last_peered":"2024-09-17T05:21:55.497272+0000","last_clean":"2024-09-17T05:21:55.497272+0000","last_became_active":"2024-09-17T05:21:54.500904+0000","last_became_peered":"2024-09-17T05:21:54.500904+0000","last_unstale":"2024-09-17T05:21:55.497272+0000","last_undegraded":"2024-09-17T05:21:55.497272+0000","last_fullsized":"2024-09-17T05:21:55.497272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:52:10.150875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499897+0000","last_change":"2024-09-17T05:21:54.494958+0000","last_active":"2024-09-17T05:21:55.499897+0000","last_peered":"2024-09-17T05:21:55.499897+0000","last_clean":"2024-09-17T05:21:55.499897+0000","last_became_active":"2024-09-17T05:21:54.494510+0000","last_became_peered":"2024-09-17T05:21:54.494510+0000","last_unstale":"2024-09-17T05:21:55.499897+0000","last_undegraded":"2024-09-17T05:21:55.499897+0000","last_fullsized":"2024-09-17T05:21:55.499897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:12:27.112041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.497441+0000","last_change":"2024-09-17T05:21:54.508228+0000","last_active":"2024-09-17T05:21:55.497441+0000","last_peered":"2024-09-17T05:21:55.497441+0000","last_clean":"2024-09-17T05:21:55.497441+0000","last_became_active":"2024-09-17T05:21:54.507980+0000","last_became_peered":"2024-09-17T05:21:54.507980+0000","last_unstale":"2024-09-17T05:21:55.497441+0000","last_undegraded":"2024-09-17T05:21:55.497441+0000","last_fullsized":"2024-09-17T05:21:55.497441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:59:07.965886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.496599+0000","last_change":"2024-09-17T05:21:54.495253+0000","last_active":"2024-09-17T05:21:55.496599+0000","last_peered":"2024-09-17T05:21:55.496599+0000","last_clean":"2024-09-17T05:21:55.496599+0000","last_became_active":"2024-09-17T05:21:54.494929+0000","last_became_peered":"2024-09-17T05:21:54.494929+0000","last_unstale":"2024-09-17T05:21:55.496599+0000","last_undegraded":"2024-09-17T05:21:55.496599+0000","last_fullsized":"2024-09-17T05:21:55.496599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:38.013877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.498278+0000","last_change":"2024-09-17T05:21:54.509547+0000","last_active":"2024-09-17T05:21:55.498278+0000","last_peered":"2024-09-17T05:21:55.498278+0000","last_clean":"2024-09-17T05:21:55.498278+0000","last_became_active":"2024-09-17T05:21:54.509223+0000","last_became_peered":"2024-09-17T05:21:54.509223+0000","last_unstale":"2024-09-17T05:21:55.498278+0000","last_undegraded":"2024-09-17T05:21:55.498278+0000","last_fullsized":"2024-09-17T05:21:55.498278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:51.043848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.496253+0000","last_change":"2024-09-17T05:21:54.497328+0000","last_active":"2024-09-17T05:21:55.496253+0000","last_peered":"2024-09-17T05:21:55.496253+0000","last_clean":"2024-09-17T05:21:55.496253+0000","last_became_active":"2024-09-17T05:21:54.497033+0000","last_became_peered":"2024-09-17T05:21:54.497033+0000","last_unstale":"2024-09-17T05:21:55.496253+0000","last_undegraded":"2024-09-17T05:21:55.496253+0000","last_fullsized":"2024-09-17T05:21:55.496253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:35:45.144313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.497784+0000","last_change":"2024-09-17T05:21:54.511143+0000","last_active":"2024-09-17T05:21:55.497784+0000","last_peered":"2024-09-17T05:21:55.497784+0000","last_clean":"2024-09-17T05:21:55.497784+0000","last_became_active":"2024-09-17T05:21:54.510864+0000","last_became_peered":"2024-09-17T05:21:54.510864+0000","last_unstale":"2024-09-17T05:21:55.497784+0000","last_undegraded":"2024-09-17T05:21:55.497784+0000","last_fullsized":"2024-09-17T05:21:55.497784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:22:47.632841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.502509+0000","last_change":"2024-09-17T05:21:54.512618+0000","last_active":"2024-09-17T05:21:55.502509+0000","last_peered":"2024-09-17T05:21:55.502509+0000","last_clean":"2024-09-17T05:21:55.502509+0000","last_became_active":"2024-09-17T05:21:54.512003+0000","last_became_peered":"2024-09-17T05:21:54.512003+0000","last_unstale":"2024-09-17T05:21:55.502509+0000","last_undegraded":"2024-09-17T05:21:55.502509+0000","last_fullsized":"2024-09-17T05:21:55.502509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:28:33.399315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.502291+0000","last_change":"2024-09-17T05:21:54.512890+0000","last_active":"2024-09-17T05:21:55.502291+0000","last_peered":"2024-09-17T05:21:55.502291+0000","last_clean":"2024-09-17T05:21:55.502291+0000","last_became_active":"2024-09-17T05:21:54.511924+0000","last_became_peered":"2024-09-17T05:21:54.511924+0000","last_unstale":"2024-09-17T05:21:55.502291+0000","last_undegraded":"2024-09-17T05:21:55.502291+0000","last_fullsized":"2024-09-17T05:21:55.502291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:41.750971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499252+0000","last_change":"2024-09-17T05:21:54.501003+0000","last_active":"2024-09-17T05:21:55.499252+0000","last_peered":"2024-09-17T05:21:55.499252+0000","last_clean":"2024-09-17T05:21:55.499252+0000","last_became_active":"2024-09-17T05:21:54.500716+0000","last_became_peered":"2024-09-17T05:21:54.500716+0000","last_unstale":"2024-09-17T05:21:55.499252+0000","last_undegraded":"2024-09-17T05:21:55.499252+0000","last_fullsized":"2024-09-17T05:21:55.499252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:03.364449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499687+0000","last_change":"2024-09-17T05:21:54.499559+0000","last_active":"2024-09-17T05:21:55.499687+0000","last_peered":"2024-09-17T05:21:55.499687+0000","last_clean":"2024-09-17T05:21:55.499687+0000","last_became_active":"2024-09-17T05:21:54.498587+0000","last_became_peered":"2024-09-17T05:21:54.498587+0000","last_unstale":"2024-09-17T05:21:55.499687+0000","last_undegraded":"2024-09-17T05:21:55.499687+0000","last_fullsized":"2024-09-17T05:21:55.499687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:18.824693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.498770+0000","last_change":"2024-09-17T05:21:54.511036+0000","last_active":"2024-09-17T05:21:55.498770+0000","last_peered":"2024-09-17T05:21:55.498770+0000","last_clean":"2024-09-17T05:21:55.498770+0000","last_became_active":"2024-09-17T05:21:54.510599+0000","last_became_peered":"2024-09-17T05:21:54.510599+0000","last_unstale":"2024-09-17T05:21:55.498770+0000","last_undegraded":"2024-09-17T05:21:55.498770+0000","last_fullsized":"2024-09-17T05:21:55.498770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:29.213187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.498235+0000","last_change":"2024-09-17T05:21:54.510133+0000","last_active":"2024-09-17T05:21:55.498235+0000","last_peered":"2024-09-17T05:21:55.498235+0000","last_clean":"2024-09-17T05:21:55.498235+0000","last_became_active":"2024-09-17T05:21:54.509861+0000","last_became_peered":"2024-09-17T05:21:54.509861+0000","last_unstale":"2024-09-17T05:21:55.498235+0000","last_undegraded":"2024-09-17T05:21:55.498235+0000","last_fullsized":"2024-09-17T05:21:55.498235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:35:45.144313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.497008+0000","last_change":"2024-09-17T05:21:54.497275+0000","last_active":"2024-09-17T05:21:55.497008+0000","last_peered":"2024-09-17T05:21:55.497008+0000","last_clean":"2024-09-17T05:21:55.497008+0000","last_became_active":"2024-09-17T05:21:54.495616+0000","last_became_peered":"2024-09-17T05:21:54.495616+0000","last_unstale":"2024-09-17T05:21:55.497008+0000","last_undegraded":"2024-09-17T05:21:55.497008+0000","last_fullsized":"2024-09-17T05:21:55.497008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:29.213187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.502388+0000","last_change":"2024-09-17T05:21:54.504915+0000","last_active":"2024-09-17T05:21:55.502388+0000","last_peered":"2024-09-17T05:21:55.502388+0000","last_clean":"2024-09-17T05:21:55.502388+0000","last_became_active":"2024-09-17T05:21:54.503778+0000","last_became_peered":"2024-09-17T05:21:54.503778+0000","last_unstale":"2024-09-17T05:21:55.502388+0000","last_undegraded":"2024-09-17T05:21:55.502388+0000","last_fullsized":"2024-09-17T05:21:55.502388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:45.560083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.498656+0000","last_change":"2024-09-17T05:21:54.509569+0000","last_active":"2024-09-17T05:21:55.498656+0000","last_peered":"2024-09-17T05:21:55.498656+0000","last_clean":"2024-09-17T05:21:55.498656+0000","last_became_active":"2024-09-17T05:21:54.508928+0000","last_became_peered":"2024-09-17T05:21:54.508928+0000","last_unstale":"2024-09-17T05:21:55.498656+0000","last_undegraded":"2024-09-17T05:21:55.498656+0000","last_fullsized":"2024-09-17T05:21:55.498656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:12:31.977218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499016+0000","last_change":"2024-09-17T05:21:54.510866+0000","last_active":"2024-09-17T05:21:55.499016+0000","last_peered":"2024-09-17T05:21:55.499016+0000","last_clean":"2024-09-17T05:21:55.499016+0000","last_became_active":"2024-09-17T05:21:54.510301+0000","last_became_peered":"2024-09-17T05:21:54.510301+0000","last_unstale":"2024-09-17T05:21:55.499016+0000","last_undegraded":"2024-09-17T05:21:55.499016+0000","last_fullsized":"2024-09-17T05:21:55.499016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:52:10.150875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.502586+0000","last_change":"2024-09-17T05:21:54.497869+0000","last_active":"2024-09-17T05:21:55.502586+0000","last_peered":"2024-09-17T05:21:55.502586+0000","last_clean":"2024-09-17T05:21:55.502586+0000","last_became_active":"2024-09-17T05:21:54.497583+0000","last_became_peered":"2024-09-17T05:21:54.497583+0000","last_unstale":"2024-09-17T05:21:55.502586+0000","last_undegraded":"2024-09-17T05:21:55.502586+0000","last_fullsized":"2024-09-17T05:21:55.502586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:42:01.373169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499859+0000","last_change":"2024-09-17T05:21:54.493860+0000","last_active":"2024-09-17T05:21:55.499859+0000","last_peered":"2024-09-17T05:21:55.499859+0000","last_clean":"2024-09-17T05:21:55.499859+0000","last_became_active":"2024-09-17T05:21:54.493554+0000","last_became_peered":"2024-09-17T05:21:54.493554+0000","last_unstale":"2024-09-17T05:21:55.499859+0000","last_undegraded":"2024-09-17T05:21:55.499859+0000","last_fullsized":"2024-09-17T05:21:55.499859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:30:58.548877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.498946+0000","last_change":"2024-09-17T05:21:54.508790+0000","last_active":"2024-09-17T05:21:55.498946+0000","last_peered":"2024-09-17T05:21:55.498946+0000","last_clean":"2024-09-17T05:21:55.498946+0000","last_became_active":"2024-09-17T05:21:54.508431+0000","last_became_peered":"2024-09-17T05:21:54.508431+0000","last_unstale":"2024-09-17T05:21:55.498946+0000","last_undegraded":"2024-09-17T05:21:55.498946+0000","last_fullsized":"2024-09-17T05:21:55.498946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:26:25.545759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.502048+0000","last_change":"2024-09-17T05:21:54.505209+0000","last_active":"2024-09-17T05:21:55.502048+0000","last_peered":"2024-09-17T05:21:55.502048+0000","last_clean":"2024-09-17T05:21:55.502048+0000","last_became_active":"2024-09-17T05:21:54.504601+0000","last_became_peered":"2024-09-17T05:21:54.504601+0000","last_unstale":"2024-09-17T05:21:55.502048+0000","last_undegraded":"2024-09-17T05:21:55.502048+0000","last_fullsized":"2024-09-17T05:21:55.502048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:32.727377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.498911+0000","last_change":"2024-09-17T05:21:54.495748+0000","last_active":"2024-09-17T05:21:55.498911+0000","last_peered":"2024-09-17T05:21:55.498911+0000","last_clean":"2024-09-17T05:21:55.498911+0000","last_became_active":"2024-09-17T05:21:54.494696+0000","last_became_peered":"2024-09-17T05:21:54.494696+0000","last_unstale":"2024-09-17T05:21:55.498911+0000","last_undegraded":"2024-09-17T05:21:55.498911+0000","last_fullsized":"2024-09-17T05:21:55.498911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:02.422828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:21:52.472932+0000","last_change":"2024-09-17T05:21:52.472932+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.472932+0000","last_undegraded":"2024-09-17T05:21:52.472932+0000","last_fullsized":"2024-09-17T05:21:52.472932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.502078+0000","last_change":"2024-09-17T05:21:53.493253+0000","last_active":"2024-09-17T05:21:55.502078+0000","last_peered":"2024-09-17T05:21:55.502078+0000","last_clean":"2024-09-17T05:21:55.502078+0000","last_became_active":"2024-09-17T05:21:53.492943+0000","last_became_peered":"2024-09-17T05:21:53.492943+0000","last_unstale":"2024-09-17T05:21:55.502078+0000","last_undegraded":"2024-09-17T05:21:55.502078+0000","last_fullsized":"2024-09-17T05:21:55.502078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:53:55.808093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:21:52.472910+0000","last_change":"2024-09-17T05:21:52.472910+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.472910+0000","last_undegraded":"2024-09-17T05:21:52.472910+0000","last_fullsized":"2024-09-17T05:21:52.472910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499004+0000","last_change":"2024-09-17T05:21:53.489575+0000","last_active":"2024-09-17T05:21:55.499004+0000","last_peered":"2024-09-17T05:21:55.499004+0000","last_clean":"2024-09-17T05:21:55.499004+0000","last_became_active":"2024-09-17T05:21:53.489294+0000","last_became_peered":"2024-09-17T05:21:53.489294+0000","last_unstale":"2024-09-17T05:21:55.499004+0000","last_undegraded":"2024-09-17T05:21:55.499004+0000","last_fullsized":"2024-09-17T05:21:55.499004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:28.463818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499674+0000","last_change":"2024-09-17T05:21:54.494216+0000","last_active":"2024-09-17T05:21:55.499674+0000","last_peered":"2024-09-17T05:21:55.499674+0000","last_clean":"2024-09-17T05:21:55.499674+0000","last_became_active":"2024-09-17T05:21:54.492853+0000","last_became_peered":"2024-09-17T05:21:54.492853+0000","last_unstale":"2024-09-17T05:21:55.499674+0000","last_undegraded":"2024-09-17T05:21:55.499674+0000","last_fullsized":"2024-09-17T05:21:55.499674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:01:15.655368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.502262+0000","last_change":"2024-09-17T05:21:53.494796+0000","last_active":"2024-09-17T05:21:55.502262+0000","last_peered":"2024-09-17T05:21:55.502262+0000","last_clean":"2024-09-17T05:21:55.502262+0000","last_became_active":"2024-09-17T05:21:53.494486+0000","last_became_peered":"2024-09-17T05:21:53.494486+0000","last_unstale":"2024-09-17T05:21:55.502262+0000","last_undegraded":"2024-09-17T05:21:55.502262+0000","last_fullsized":"2024-09-17T05:21:55.502262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:59.914761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.497597+0000","last_change":"2024-09-17T05:21:54.509807+0000","last_active":"2024-09-17T05:21:55.497597+0000","last_peered":"2024-09-17T05:21:55.497597+0000","last_clean":"2024-09-17T05:21:55.497597+0000","last_became_active":"2024-09-17T05:21:54.509245+0000","last_became_peered":"2024-09-17T05:21:54.509245+0000","last_unstale":"2024-09-17T05:21:55.497597+0000","last_undegraded":"2024-09-17T05:21:55.497597+0000","last_fullsized":"2024-09-17T05:21:55.497597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:38:26.480830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.497949+0000","last_change":"2024-09-17T05:21:53.491049+0000","last_active":"2024-09-17T05:21:55.497949+0000","last_peered":"2024-09-17T05:21:55.497949+0000","last_clean":"2024-09-17T05:21:55.497949+0000","last_became_active":"2024-09-17T05:21:53.490795+0000","last_became_peered":"2024-09-17T05:21:53.490795+0000","last_unstale":"2024-09-17T05:21:55.497949+0000","last_undegraded":"2024-09-17T05:21:55.497949+0000","last_fullsized":"2024-09-17T05:21:55.497949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:03:21.023914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499832+0000","last_change":"2024-09-17T05:21:53.493370+0000","last_active":"2024-09-17T05:21:55.499832+0000","last_peered":"2024-09-17T05:21:55.499832+0000","last_clean":"2024-09-17T05:21:55.499832+0000","last_became_active":"2024-09-17T05:21:53.493010+0000","last_became_peered":"2024-09-17T05:21:53.493010+0000","last_unstale":"2024-09-17T05:21:55.499832+0000","last_undegraded":"2024-09-17T05:21:55.499832+0000","last_fullsized":"2024-09-17T05:21:55.499832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:21.689266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499435+0000","last_change":"2024-09-17T05:21:54.499432+0000","last_active":"2024-09-17T05:21:55.499435+0000","last_peered":"2024-09-17T05:21:55.499435+0000","last_clean":"2024-09-17T05:21:55.499435+0000","last_became_active":"2024-09-17T05:21:54.499133+0000","last_became_peered":"2024-09-17T05:21:54.499133+0000","last_unstale":"2024-09-17T05:21:55.499435+0000","last_undegraded":"2024-09-17T05:21:55.499435+0000","last_fullsized":"2024-09-17T05:21:55.499435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:53:18.926924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.502291+0000","last_change":"2024-09-17T05:21:53.491745+0000","last_active":"2024-09-17T05:21:55.502291+0000","last_peered":"2024-09-17T05:21:55.502291+0000","last_clean":"2024-09-17T05:21:55.502291+0000","last_became_active":"2024-09-17T05:21:53.491464+0000","last_became_peered":"2024-09-17T05:21:53.491464+0000","last_unstale":"2024-09-17T05:21:55.502291+0000","last_undegraded":"2024-09-17T05:21:55.502291+0000","last_fullsized":"2024-09-17T05:21:55.502291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:03:27.097328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.496199+0000","last_change":"2024-09-17T05:21:54.493190+0000","last_active":"2024-09-17T05:21:55.496199+0000","last_peered":"2024-09-17T05:21:55.496199+0000","last_clean":"2024-09-17T05:21:55.496199+0000","last_became_active":"2024-09-17T05:21:54.492889+0000","last_became_peered":"2024-09-17T05:21:54.492889+0000","last_unstale":"2024-09-17T05:21:55.496199+0000","last_undegraded":"2024-09-17T05:21:55.496199+0000","last_fullsized":"2024-09-17T05:21:55.496199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:40.851639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:21:52.473895+0000","last_change":"2024-09-17T05:21:52.473895+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.473895+0000","last_undegraded":"2024-09-17T05:21:52.473895+0000","last_fullsized":"2024-09-17T05:21:52.473895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499013+0000","last_change":"2024-09-17T05:21:53.489506+0000","last_active":"2024-09-17T05:21:55.499013+0000","last_peered":"2024-09-17T05:21:55.499013+0000","last_clean":"2024-09-17T05:21:55.499013+0000","last_became_active":"2024-09-17T05:21:53.488663+0000","last_became_peered":"2024-09-17T05:21:53.488663+0000","last_unstale":"2024-09-17T05:21:55.499013+0000","last_undegraded":"2024-09-17T05:21:55.499013+0000","last_fullsized":"2024-09-17T05:21:55.499013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:58:35.674900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.496782+0000","last_change":"2024-09-17T05:21:54.495318+0000","last_active":"2024-09-17T05:21:55.496782+0000","last_peered":"2024-09-17T05:21:55.496782+0000","last_clean":"2024-09-17T05:21:55.496782+0000","last_became_active":"2024-09-17T05:21:54.495022+0000","last_became_peered":"2024-09-17T05:21:54.495022+0000","last_unstale":"2024-09-17T05:21:55.496782+0000","last_undegraded":"2024-09-17T05:21:55.496782+0000","last_fullsized":"2024-09-17T05:21:55.496782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:12:31.977218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.501937+0000","last_change":"2024-09-17T05:21:53.493137+0000","last_active":"2024-09-17T05:21:55.501937+0000","last_peered":"2024-09-17T05:21:55.501937+0000","last_clean":"2024-09-17T05:21:55.501937+0000","last_became_active":"2024-09-17T05:21:53.492861+0000","last_became_peered":"2024-09-17T05:21:53.492861+0000","last_unstale":"2024-09-17T05:21:55.501937+0000","last_undegraded":"2024-09-17T05:21:55.501937+0000","last_fullsized":"2024-09-17T05:21:55.501937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:26:33.902720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.502039+0000","last_change":"2024-09-17T05:21:54.504481+0000","last_active":"2024-09-17T05:21:55.502039+0000","last_peered":"2024-09-17T05:21:55.502039+0000","last_clean":"2024-09-17T05:21:55.502039+0000","last_became_active":"2024-09-17T05:21:54.504110+0000","last_became_peered":"2024-09-17T05:21:54.504110+0000","last_unstale":"2024-09-17T05:21:55.502039+0000","last_undegraded":"2024-09-17T05:21:55.502039+0000","last_fullsized":"2024-09-17T05:21:55.502039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:06.884350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:21:52.475573+0000","last_change":"2024-09-17T05:21:52.475573+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.475573+0000","last_undegraded":"2024-09-17T05:21:52.475573+0000","last_fullsized":"2024-09-17T05:21:52.475573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.496294+0000","last_change":"2024-09-17T05:21:54.500288+0000","last_active":"2024-09-17T05:21:55.496294+0000","last_peered":"2024-09-17T05:21:55.496294+0000","last_clean":"2024-09-17T05:21:55.496294+0000","last_became_active":"2024-09-17T05:21:54.499508+0000","last_became_peered":"2024-09-17T05:21:54.499508+0000","last_unstale":"2024-09-17T05:21:55.496294+0000","last_undegraded":"2024-09-17T05:21:55.496294+0000","last_fullsized":"2024-09-17T05:21:55.496294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:51.043848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499138+0000","last_change":"2024-09-17T05:21:53.486134+0000","last_active":"2024-09-17T05:21:55.499138+0000","last_peered":"2024-09-17T05:21:55.499138+0000","last_clean":"2024-09-17T05:21:55.499138+0000","last_became_active":"2024-09-17T05:21:53.485804+0000","last_became_peered":"2024-09-17T05:21:53.485804+0000","last_unstale":"2024-09-17T05:21:55.499138+0000","last_undegraded":"2024-09-17T05:21:55.499138+0000","last_fullsized":"2024-09-17T05:21:55.499138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:34:05.720343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.497407+0000","last_change":"2024-09-17T05:21:54.499818+0000","last_active":"2024-09-17T05:21:55.497407+0000","last_peered":"2024-09-17T05:21:55.497407+0000","last_clean":"2024-09-17T05:21:55.497407+0000","last_became_active":"2024-09-17T05:21:54.499298+0000","last_became_peered":"2024-09-17T05:21:54.499298+0000","last_unstale":"2024-09-17T05:21:55.497407+0000","last_undegraded":"2024-09-17T05:21:55.497407+0000","last_fullsized":"2024-09-17T05:21:55.497407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:26:25.545759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:21:52.475586+0000","last_change":"2024-09-17T05:21:52.475586+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.475586+0000","last_undegraded":"2024-09-17T05:21:52.475586+0000","last_fullsized":"2024-09-17T05:21:52.475586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.497849+0000","last_change":"2024-09-17T05:21:54.499532+0000","last_active":"2024-09-17T05:21:55.497849+0000","last_peered":"2024-09-17T05:21:55.497849+0000","last_clean":"2024-09-17T05:21:55.497849+0000","last_became_active":"2024-09-17T05:21:54.499228+0000","last_became_peered":"2024-09-17T05:21:54.499228+0000","last_unstale":"2024-09-17T05:21:55.497849+0000","last_undegraded":"2024-09-17T05:21:55.497849+0000","last_fullsized":"2024-09-17T05:21:55.497849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:34:49.600804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499922+0000","last_change":"2024-09-17T05:21:53.481560+0000","last_active":"2024-09-17T05:21:55.499922+0000","last_peered":"2024-09-17T05:21:55.499922+0000","last_clean":"2024-09-17T05:21:55.499922+0000","last_became_active":"2024-09-17T05:21:53.481288+0000","last_became_peered":"2024-09-17T05:21:53.481288+0000","last_unstale":"2024-09-17T05:21:55.499922+0000","last_undegraded":"2024-09-17T05:21:55.499922+0000","last_fullsized":"2024-09-17T05:21:55.499922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:14:54.894468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.498134+0000","last_change":"2024-09-17T05:21:54.507480+0000","last_active":"2024-09-17T05:21:55.498134+0000","last_peered":"2024-09-17T05:21:55.498134+0000","last_clean":"2024-09-17T05:21:55.498134+0000","last_became_active":"2024-09-17T05:21:54.507184+0000","last_became_peered":"2024-09-17T05:21:54.507184+0000","last_unstale":"2024-09-17T05:21:55.498134+0000","last_undegraded":"2024-09-17T05:21:55.498134+0000","last_fullsized":"2024-09-17T05:21:55.498134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:40.851639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:21:52.476027+0000","last_change":"2024-09-17T05:21:52.476027+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.476027+0000","last_undegraded":"2024-09-17T05:21:52.476027+0000","last_fullsized":"2024-09-17T05:21:52.476027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.496458+0000","last_change":"2024-09-17T05:21:54.509525+0000","last_active":"2024-09-17T05:21:55.496458+0000","last_peered":"2024-09-17T05:21:55.496458+0000","last_clean":"2024-09-17T05:21:55.496458+0000","last_became_active":"2024-09-17T05:21:54.509257+0000","last_became_peered":"2024-09-17T05:21:54.509257+0000","last_unstale":"2024-09-17T05:21:55.496458+0000","last_undegraded":"2024-09-17T05:21:55.496458+0000","last_fullsized":"2024-09-17T05:21:55.496458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:34:47.447957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.495985+0000","last_change":"2024-09-17T05:21:44.086098+0000","last_active":"2024-09-17T05:21:55.495985+0000","last_peered":"2024-09-17T05:21:55.495985+0000","last_clean":"2024-09-17T05:21:55.495985+0000","last_became_active":"2024-09-17T05:21:44.083477+0000","last_became_peered":"2024-09-17T05:21:44.083477+0000","last_unstale":"2024-09-17T05:21:55.495985+0000","last_undegraded":"2024-09-17T05:21:55.495985+0000","last_fullsized":"2024-09-17T05:21:55.495985+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:42.925756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:42.925756+0000","last_clean_scrub_stamp":"2024-09-17T05:21:42.925756+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:11.410250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.497233+0000","last_change":"2024-09-17T05:21:53.490183+0000","last_active":"2024-09-17T05:21:55.497233+0000","last_peered":"2024-09-17T05:21:55.497233+0000","last_clean":"2024-09-17T05:21:55.497233+0000","last_became_active":"2024-09-17T05:21:53.489914+0000","last_became_peered":"2024-09-17T05:21:53.489914+0000","last_unstale":"2024-09-17T05:21:55.497233+0000","last_undegraded":"2024-09-17T05:21:55.497233+0000","last_fullsized":"2024-09-17T05:21:55.497233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:55:15.542710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.495899+0000","last_change":"2024-09-17T05:21:53.484333+0000","last_active":"2024-09-17T05:21:55.495899+0000","last_peered":"2024-09-17T05:21:55.495899+0000","last_clean":"2024-09-17T05:21:55.495899+0000","last_became_active":"2024-09-17T05:21:53.483640+0000","last_became_peered":"2024-09-17T05:21:53.483640+0000","last_unstale":"2024-09-17T05:21:55.495899+0000","last_undegraded":"2024-09-17T05:21:55.495899+0000","last_fullsized":"2024-09-17T05:21:55.495899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:37:47.645603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:21:52.475966+0000","last_change":"2024-09-17T05:21:52.475966+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.475966+0000","last_undegraded":"2024-09-17T05:21:52.475966+0000","last_fullsized":"2024-09-17T05:21:52.475966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499651+0000","last_change":"2024-09-17T05:21:54.497084+0000","last_active":"2024-09-17T05:21:55.499651+0000","last_peered":"2024-09-17T05:21:55.499651+0000","last_clean":"2024-09-17T05:21:55.499651+0000","last_became_active":"2024-09-17T05:21:54.495742+0000","last_became_peered":"2024-09-17T05:21:54.495742+0000","last_unstale":"2024-09-17T05:21:55.499651+0000","last_undegraded":"2024-09-17T05:21:55.499651+0000","last_fullsized":"2024-09-17T05:21:55.499651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:27:18.182327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499082+0000","last_change":"2024-09-17T05:21:53.490161+0000","last_active":"2024-09-17T05:21:55.499082+0000","last_peered":"2024-09-17T05:21:55.499082+0000","last_clean":"2024-09-17T05:21:55.499082+0000","last_became_active":"2024-09-17T05:21:53.489883+0000","last_became_peered":"2024-09-17T05:21:53.489883+0000","last_unstale":"2024-09-17T05:21:55.499082+0000","last_undegraded":"2024-09-17T05:21:55.499082+0000","last_fullsized":"2024-09-17T05:21:55.499082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:08.690514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499340+0000","last_change":"2024-09-17T05:21:54.503475+0000","last_active":"2024-09-17T05:21:55.499340+0000","last_peered":"2024-09-17T05:21:55.499340+0000","last_clean":"2024-09-17T05:21:55.499340+0000","last_became_active":"2024-09-17T05:21:54.503198+0000","last_became_peered":"2024-09-17T05:21:54.503198+0000","last_unstale":"2024-09-17T05:21:55.499340+0000","last_undegraded":"2024-09-17T05:21:55.499340+0000","last_fullsized":"2024-09-17T05:21:55.499340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:50:43.095802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499769+0000","last_change":"2024-09-17T05:21:53.484383+0000","last_active":"2024-09-17T05:21:55.499769+0000","last_peered":"2024-09-17T05:21:55.499769+0000","last_clean":"2024-09-17T05:21:55.499769+0000","last_became_active":"2024-09-17T05:21:53.484071+0000","last_became_peered":"2024-09-17T05:21:53.484071+0000","last_unstale":"2024-09-17T05:21:55.499769+0000","last_undegraded":"2024-09-17T05:21:55.499769+0000","last_fullsized":"2024-09-17T05:21:55.499769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:35:29.473422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.498541+0000","last_change":"2024-09-17T05:21:54.514953+0000","last_active":"2024-09-17T05:21:55.498541+0000","last_peered":"2024-09-17T05:21:55.498541+0000","last_clean":"2024-09-17T05:21:55.498541+0000","last_became_active":"2024-09-17T05:21:54.514665+0000","last_became_peered":"2024-09-17T05:21:54.514665+0000","last_unstale":"2024-09-17T05:21:55.498541+0000","last_undegraded":"2024-09-17T05:21:55.498541+0000","last_fullsized":"2024-09-17T05:21:55.498541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:38.013877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.497013+0000","last_change":"2024-09-17T05:21:53.489197+0000","last_active":"2024-09-17T05:21:55.497013+0000","last_peered":"2024-09-17T05:21:55.497013+0000","last_clean":"2024-09-17T05:21:55.497013+0000","last_became_active":"2024-09-17T05:21:53.484928+0000","last_became_peered":"2024-09-17T05:21:53.484928+0000","last_unstale":"2024-09-17T05:21:55.497013+0000","last_undegraded":"2024-09-17T05:21:55.497013+0000","last_fullsized":"2024-09-17T05:21:55.497013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:28.936504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499864+0000","last_change":"2024-09-17T05:21:54.497779+0000","last_active":"2024-09-17T05:21:55.499864+0000","last_peered":"2024-09-17T05:21:55.499864+0000","last_clean":"2024-09-17T05:21:55.499864+0000","last_became_active":"2024-09-17T05:21:54.497343+0000","last_became_peered":"2024-09-17T05:21:54.497343+0000","last_unstale":"2024-09-17T05:21:55.499864+0000","last_undegraded":"2024-09-17T05:21:55.499864+0000","last_fullsized":"2024-09-17T05:21:55.499864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:34:38.737329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.501521+0000","last_change":"2024-09-17T05:21:53.490515+0000","last_active":"2024-09-17T05:21:55.501521+0000","last_peered":"2024-09-17T05:21:55.501521+0000","last_clean":"2024-09-17T05:21:55.501521+0000","last_became_active":"2024-09-17T05:21:53.490173+0000","last_became_peered":"2024-09-17T05:21:53.490173+0000","last_unstale":"2024-09-17T05:21:55.501521+0000","last_undegraded":"2024-09-17T05:21:55.501521+0000","last_fullsized":"2024-09-17T05:21:55.501521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:42.132331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.502396+0000","last_change":"2024-09-17T05:21:53.494784+0000","last_active":"2024-09-17T05:21:55.502396+0000","last_peered":"2024-09-17T05:21:55.502396+0000","last_clean":"2024-09-17T05:21:55.502396+0000","last_became_active":"2024-09-17T05:21:53.494504+0000","last_became_peered":"2024-09-17T05:21:53.494504+0000","last_unstale":"2024-09-17T05:21:55.502396+0000","last_undegraded":"2024-09-17T05:21:55.502396+0000","last_fullsized":"2024-09-17T05:21:55.502396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:13:50.064294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.495902+0000","last_change":"2024-09-17T05:21:53.484810+0000","last_active":"2024-09-17T05:21:55.495902+0000","last_peered":"2024-09-17T05:21:55.495902+0000","last_clean":"2024-09-17T05:21:55.495902+0000","last_became_active":"2024-09-17T05:21:53.484016+0000","last_became_peered":"2024-09-17T05:21:53.484016+0000","last_unstale":"2024-09-17T05:21:55.495902+0000","last_undegraded":"2024-09-17T05:21:55.495902+0000","last_fullsized":"2024-09-17T05:21:55.495902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:58:35.674900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499028+0000","last_change":"2024-09-17T05:21:54.498171+0000","last_active":"2024-09-17T05:21:55.499028+0000","last_peered":"2024-09-17T05:21:55.499028+0000","last_clean":"2024-09-17T05:21:55.499028+0000","last_became_active":"2024-09-17T05:21:54.497780+0000","last_became_peered":"2024-09-17T05:21:54.497780+0000","last_unstale":"2024-09-17T05:21:55.499028+0000","last_undegraded":"2024-09-17T05:21:55.499028+0000","last_fullsized":"2024-09-17T05:21:55.499028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:53:19.454025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499780+0000","last_change":"2024-09-17T05:21:53.487419+0000","last_active":"2024-09-17T05:21:55.499780+0000","last_peered":"2024-09-17T05:21:55.499780+0000","last_clean":"2024-09-17T05:21:55.499780+0000","last_became_active":"2024-09-17T05:21:53.485874+0000","last_became_peered":"2024-09-17T05:21:53.485874+0000","last_unstale":"2024-09-17T05:21:55.499780+0000","last_undegraded":"2024-09-17T05:21:55.499780+0000","last_fullsized":"2024-09-17T05:21:55.499780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:31.652148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499720+0000","last_change":"2024-09-17T05:21:53.486091+0000","last_active":"2024-09-17T05:21:55.499720+0000","last_peered":"2024-09-17T05:21:55.499720+0000","last_clean":"2024-09-17T05:21:55.499720+0000","last_became_active":"2024-09-17T05:21:53.485314+0000","last_became_peered":"2024-09-17T05:21:53.485314+0000","last_unstale":"2024-09-17T05:21:55.499720+0000","last_undegraded":"2024-09-17T05:21:55.499720+0000","last_fullsized":"2024-09-17T05:21:55.499720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:53:42.808589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.496712+0000","last_change":"2024-09-17T05:21:53.489998+0000","last_active":"2024-09-17T05:21:55.496712+0000","last_peered":"2024-09-17T05:21:55.496712+0000","last_clean":"2024-09-17T05:21:55.496712+0000","last_became_active":"2024-09-17T05:21:53.489673+0000","last_became_peered":"2024-09-17T05:21:53.489673+0000","last_unstale":"2024-09-17T05:21:55.496712+0000","last_undegraded":"2024-09-17T05:21:55.496712+0000","last_fullsized":"2024-09-17T05:21:55.496712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:15.739862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.502066+0000","last_change":"2024-09-17T05:21:54.504813+0000","last_active":"2024-09-17T05:21:55.502066+0000","last_peered":"2024-09-17T05:21:55.502066+0000","last_clean":"2024-09-17T05:21:55.502066+0000","last_became_active":"2024-09-17T05:21:54.504086+0000","last_became_peered":"2024-09-17T05:21:54.504086+0000","last_unstale":"2024-09-17T05:21:55.502066+0000","last_undegraded":"2024-09-17T05:21:55.502066+0000","last_fullsized":"2024-09-17T05:21:55.502066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:06:40.408782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.498308+0000","last_change":"2024-09-17T05:21:54.512621+0000","last_active":"2024-09-17T05:21:55.498308+0000","last_peered":"2024-09-17T05:21:55.498308+0000","last_clean":"2024-09-17T05:21:55.498308+0000","last_became_active":"2024-09-17T05:21:54.512256+0000","last_became_peered":"2024-09-17T05:21:54.512256+0000","last_unstale":"2024-09-17T05:21:55.498308+0000","last_undegraded":"2024-09-17T05:21:55.498308+0000","last_fullsized":"2024-09-17T05:21:55.498308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:34:47.447957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.496194+0000","last_change":"2024-09-17T05:21:53.490984+0000","last_active":"2024-09-17T05:21:55.496194+0000","last_peered":"2024-09-17T05:21:55.496194+0000","last_clean":"2024-09-17T05:21:55.496194+0000","last_became_active":"2024-09-17T05:21:53.490001+0000","last_became_peered":"2024-09-17T05:21:53.490001+0000","last_unstale":"2024-09-17T05:21:55.496194+0000","last_undegraded":"2024-09-17T05:21:55.496194+0000","last_fullsized":"2024-09-17T05:21:55.496194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:08.690514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.497721+0000","last_change":"2024-09-17T05:21:54.510777+0000","last_active":"2024-09-17T05:21:55.497721+0000","last_peered":"2024-09-17T05:21:55.497721+0000","last_clean":"2024-09-17T05:21:55.497721+0000","last_became_active":"2024-09-17T05:21:54.510517+0000","last_became_peered":"2024-09-17T05:21:54.510517+0000","last_unstale":"2024-09-17T05:21:55.497721+0000","last_undegraded":"2024-09-17T05:21:55.497721+0000","last_fullsized":"2024-09-17T05:21:55.497721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:49:06.303460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.496892+0000","last_change":"2024-09-17T05:21:53.491157+0000","last_active":"2024-09-17T05:21:55.496892+0000","last_peered":"2024-09-17T05:21:55.496892+0000","last_clean":"2024-09-17T05:21:55.496892+0000","last_became_active":"2024-09-17T05:21:53.490315+0000","last_became_peered":"2024-09-17T05:21:53.490315+0000","last_unstale":"2024-09-17T05:21:55.496892+0000","last_undegraded":"2024-09-17T05:21:55.496892+0000","last_fullsized":"2024-09-17T05:21:55.496892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:58:14.211132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:21:52.473007+0000","last_change":"2024-09-17T05:21:52.473007+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.473007+0000","last_undegraded":"2024-09-17T05:21:52.473007+0000","last_fullsized":"2024-09-17T05:21:52.473007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:21:52.473390+0000","last_change":"2024-09-17T05:21:52.473390+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.473390+0000","last_undegraded":"2024-09-17T05:21:52.473390+0000","last_fullsized":"2024-09-17T05:21:52.473390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":82,"acting":82,"num_store_stats":5},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1794,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21,"ondisk_log_size":21,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":159744,"data_stored":48214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":54031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":765952,"data_stored":644399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":806912,"data_stored":664331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":74993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":73471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":73507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":73541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:21:58.290 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3d is not active+clean 2024-09-17T05:21:58.290 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:21:53.466708+0000', 'last_change': '2024-09-17T05:21:53.466708+0000', 'last_active': '2024-09-17T05:21:53.466708+0000', 'last_peered': '2024-09-17T05:21:53.466708+0000', 'last_clean': '2024-09-17T05:21:53.466708+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:53.466708+0000', 'last_undegraded': '2024-09-17T05:21:53.466708+0000', 'last_fullsized': '2024-09-17T05:21:53.466708+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:21:58.290 INFO:tasks.ceph.ceph_manager.ceph:PG 3.38 is not active+clean 2024-09-17T05:21:58.290 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:21:53.466708+0000', 'last_change': '2024-09-17T05:21:53.466708+0000', 'last_active': '2024-09-17T05:21:53.466708+0000', 'last_peered': '2024-09-17T05:21:53.466708+0000', 'last_clean': '2024-09-17T05:21:53.466708+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:53.466708+0000', 'last_undegraded': '2024-09-17T05:21:53.466708+0000', 'last_fullsized': '2024-09-17T05:21:53.466708+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:21:58.290 INFO:tasks.ceph.ceph_manager.ceph:PG 3.33 is not active+clean 2024-09-17T05:21:58.290 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:21:53.466708+0000', 'last_change': '2024-09-17T05:21:53.466708+0000', 'last_active': '2024-09-17T05:21:53.466708+0000', 'last_peered': '2024-09-17T05:21:53.466708+0000', 'last_clean': '2024-09-17T05:21:53.466708+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:53.466708+0000', 'last_undegraded': '2024-09-17T05:21:53.466708+0000', 'last_fullsized': '2024-09-17T05:21:53.466708+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:21:58.291 INFO:tasks.ceph.ceph_manager.ceph:PG 3.32 is not active+clean 2024-09-17T05:21:58.291 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:21:53.466708+0000', 'last_change': '2024-09-17T05:21:53.466708+0000', 'last_active': '2024-09-17T05:21:53.466708+0000', 'last_peered': '2024-09-17T05:21:53.466708+0000', 'last_clean': '2024-09-17T05:21:53.466708+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:53.466708+0000', 'last_undegraded': '2024-09-17T05:21:53.466708+0000', 'last_fullsized': '2024-09-17T05:21:53.466708+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:21:58.291 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2e is not active+clean 2024-09-17T05:21:58.291 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:21:53.466708+0000', 'last_change': '2024-09-17T05:21:53.466708+0000', 'last_active': '2024-09-17T05:21:53.466708+0000', 'last_peered': '2024-09-17T05:21:53.466708+0000', 'last_clean': '2024-09-17T05:21:53.466708+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:53.466708+0000', 'last_undegraded': '2024-09-17T05:21:53.466708+0000', 'last_fullsized': '2024-09-17T05:21:53.466708+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:21:58.291 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2b is not active+clean 2024-09-17T05:21:58.291 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:21:53.466708+0000', 'last_change': '2024-09-17T05:21:53.466708+0000', 'last_active': '2024-09-17T05:21:53.466708+0000', 'last_peered': '2024-09-17T05:21:53.466708+0000', 'last_clean': '2024-09-17T05:21:53.466708+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:53.466708+0000', 'last_undegraded': '2024-09-17T05:21:53.466708+0000', 'last_fullsized': '2024-09-17T05:21:53.466708+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:21:58.291 INFO:tasks.ceph.ceph_manager.ceph:PG 3.29 is not active+clean 2024-09-17T05:21:58.291 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:21:53.466708+0000', 'last_change': '2024-09-17T05:21:53.466708+0000', 'last_active': '2024-09-17T05:21:53.466708+0000', 'last_peered': '2024-09-17T05:21:53.466708+0000', 'last_clean': '2024-09-17T05:21:53.466708+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:53.466708+0000', 'last_undegraded': '2024-09-17T05:21:53.466708+0000', 'last_fullsized': '2024-09-17T05:21:53.466708+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:21:58.291 INFO:tasks.ceph.ceph_manager.ceph:PG 3.27 is not active+clean 2024-09-17T05:21:58.291 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:21:53.466708+0000', 'last_change': '2024-09-17T05:21:53.466708+0000', 'last_active': '2024-09-17T05:21:53.466708+0000', 'last_peered': '2024-09-17T05:21:53.466708+0000', 'last_clean': '2024-09-17T05:21:53.466708+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:53.466708+0000', 'last_undegraded': '2024-09-17T05:21:53.466708+0000', 'last_fullsized': '2024-09-17T05:21:53.466708+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:21:58.292 INFO:tasks.ceph.ceph_manager.ceph:PG 3.24 is not active+clean 2024-09-17T05:21:58.292 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:21:53.466708+0000', 'last_change': '2024-09-17T05:21:53.466708+0000', 'last_active': '2024-09-17T05:21:53.466708+0000', 'last_peered': '2024-09-17T05:21:53.466708+0000', 'last_clean': '2024-09-17T05:21:53.466708+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:53.466708+0000', 'last_undegraded': '2024-09-17T05:21:53.466708+0000', 'last_fullsized': '2024-09-17T05:21:53.466708+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:21:58.292 INFO:tasks.ceph.ceph_manager.ceph:PG 3.23 is not active+clean 2024-09-17T05:21:58.292 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:21:53.466708+0000', 'last_change': '2024-09-17T05:21:53.466708+0000', 'last_active': '2024-09-17T05:21:53.466708+0000', 'last_peered': '2024-09-17T05:21:53.466708+0000', 'last_clean': '2024-09-17T05:21:53.466708+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:53.466708+0000', 'last_undegraded': '2024-09-17T05:21:53.466708+0000', 'last_fullsized': '2024-09-17T05:21:53.466708+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:21:58.292 INFO:tasks.ceph.ceph_manager.ceph:PG 3.21 is not active+clean 2024-09-17T05:21:58.292 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:21:53.466708+0000', 'last_change': '2024-09-17T05:21:53.466708+0000', 'last_active': '2024-09-17T05:21:53.466708+0000', 'last_peered': '2024-09-17T05:21:53.466708+0000', 'last_clean': '2024-09-17T05:21:53.466708+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:53.466708+0000', 'last_undegraded': '2024-09-17T05:21:53.466708+0000', 'last_fullsized': '2024-09-17T05:21:53.466708+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:21:58.292 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1b is not active+clean 2024-09-17T05:21:58.292 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:52.472932+0000', 'last_change': '2024-09-17T05:21:52.472932+0000', 'last_active': '2024-09-17T05:21:52.460729+0000', 'last_peered': '2024-09-17T05:21:52.460729+0000', 'last_clean': '2024-09-17T05:21:52.460729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:52.472932+0000', 'last_undegraded': '2024-09-17T05:21:52.472932+0000', 'last_fullsized': '2024-09-17T05:21:52.472932+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:52.460729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:52.460729+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:52.460729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:21:58.292 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1b is not active+clean 2024-09-17T05:21:58.292 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:21:53.466708+0000', 'last_change': '2024-09-17T05:21:53.466708+0000', 'last_active': '2024-09-17T05:21:53.466708+0000', 'last_peered': '2024-09-17T05:21:53.466708+0000', 'last_clean': '2024-09-17T05:21:53.466708+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:53.466708+0000', 'last_undegraded': '2024-09-17T05:21:53.466708+0000', 'last_fullsized': '2024-09-17T05:21:53.466708+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:21:58.293 INFO:tasks.ceph.ceph_manager.ceph:PG 2.19 is not active+clean 2024-09-17T05:21:58.293 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:52.472910+0000', 'last_change': '2024-09-17T05:21:52.472910+0000', 'last_active': '2024-09-17T05:21:52.460729+0000', 'last_peered': '2024-09-17T05:21:52.460729+0000', 'last_clean': '2024-09-17T05:21:52.460729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:52.472910+0000', 'last_undegraded': '2024-09-17T05:21:52.472910+0000', 'last_fullsized': '2024-09-17T05:21:52.472910+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:52.460729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:52.460729+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:52.460729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:21:58.293 INFO:tasks.ceph.ceph_manager.ceph:PG 3.18 is not active+clean 2024-09-17T05:21:58.293 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:21:53.466708+0000', 'last_change': '2024-09-17T05:21:53.466708+0000', 'last_active': '2024-09-17T05:21:53.466708+0000', 'last_peered': '2024-09-17T05:21:53.466708+0000', 'last_clean': '2024-09-17T05:21:53.466708+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:53.466708+0000', 'last_undegraded': '2024-09-17T05:21:53.466708+0000', 'last_fullsized': '2024-09-17T05:21:53.466708+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:21:58.293 INFO:tasks.ceph.ceph_manager.ceph:PG 3.17 is not active+clean 2024-09-17T05:21:58.293 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:21:53.466708+0000', 'last_change': '2024-09-17T05:21:53.466708+0000', 'last_active': '2024-09-17T05:21:53.466708+0000', 'last_peered': '2024-09-17T05:21:53.466708+0000', 'last_clean': '2024-09-17T05:21:53.466708+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:53.466708+0000', 'last_undegraded': '2024-09-17T05:21:53.466708+0000', 'last_fullsized': '2024-09-17T05:21:53.466708+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:21:58.293 INFO:tasks.ceph.ceph_manager.ceph:PG 2.13 is not active+clean 2024-09-17T05:21:58.293 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:52.473895+0000', 'last_change': '2024-09-17T05:21:52.473895+0000', 'last_active': '2024-09-17T05:21:52.460729+0000', 'last_peered': '2024-09-17T05:21:52.460729+0000', 'last_clean': '2024-09-17T05:21:52.460729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:52.473895+0000', 'last_undegraded': '2024-09-17T05:21:52.473895+0000', 'last_fullsized': '2024-09-17T05:21:52.473895+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:52.460729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:52.460729+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:52.460729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:21:58.293 INFO:tasks.ceph.ceph_manager.ceph:PG 3.12 is not active+clean 2024-09-17T05:21:58.293 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:21:53.466708+0000', 'last_change': '2024-09-17T05:21:53.466708+0000', 'last_active': '2024-09-17T05:21:53.466708+0000', 'last_peered': '2024-09-17T05:21:53.466708+0000', 'last_clean': '2024-09-17T05:21:53.466708+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:53.466708+0000', 'last_undegraded': '2024-09-17T05:21:53.466708+0000', 'last_fullsized': '2024-09-17T05:21:53.466708+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:21:58.293 INFO:tasks.ceph.ceph_manager.ceph:PG 2.10 is not active+clean 2024-09-17T05:21:58.294 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:52.475573+0000', 'last_change': '2024-09-17T05:21:52.475573+0000', 'last_active': '2024-09-17T05:21:52.460729+0000', 'last_peered': '2024-09-17T05:21:52.460729+0000', 'last_clean': '2024-09-17T05:21:52.460729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:52.475573+0000', 'last_undegraded': '2024-09-17T05:21:52.475573+0000', 'last_fullsized': '2024-09-17T05:21:52.475573+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:52.460729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:52.460729+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:52.460729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:21:58.294 INFO:tasks.ceph.ceph_manager.ceph:PG 2.e is not active+clean 2024-09-17T05:21:58.294 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:52.475586+0000', 'last_change': '2024-09-17T05:21:52.475586+0000', 'last_active': '2024-09-17T05:21:52.460729+0000', 'last_peered': '2024-09-17T05:21:52.460729+0000', 'last_clean': '2024-09-17T05:21:52.460729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:52.475586+0000', 'last_undegraded': '2024-09-17T05:21:52.475586+0000', 'last_fullsized': '2024-09-17T05:21:52.475586+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:52.460729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:52.460729+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:52.460729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:21:58.294 INFO:tasks.ceph.ceph_manager.ceph:PG 2.c is not active+clean 2024-09-17T05:21:58.294 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:52.476027+0000', 'last_change': '2024-09-17T05:21:52.476027+0000', 'last_active': '2024-09-17T05:21:52.460729+0000', 'last_peered': '2024-09-17T05:21:52.460729+0000', 'last_clean': '2024-09-17T05:21:52.460729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:52.476027+0000', 'last_undegraded': '2024-09-17T05:21:52.476027+0000', 'last_fullsized': '2024-09-17T05:21:52.476027+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:52.460729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:52.460729+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:52.460729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:21:58.294 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2 is not active+clean 2024-09-17T05:21:58.294 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:21:53.466708+0000', 'last_change': '2024-09-17T05:21:53.466708+0000', 'last_active': '2024-09-17T05:21:53.466708+0000', 'last_peered': '2024-09-17T05:21:53.466708+0000', 'last_clean': '2024-09-17T05:21:53.466708+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:53.466708+0000', 'last_undegraded': '2024-09-17T05:21:53.466708+0000', 'last_fullsized': '2024-09-17T05:21:53.466708+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:21:58.294 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1 is not active+clean 2024-09-17T05:21:58.294 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:21:53.466708+0000', 'last_change': '2024-09-17T05:21:53.466708+0000', 'last_active': '2024-09-17T05:21:53.466708+0000', 'last_peered': '2024-09-17T05:21:53.466708+0000', 'last_clean': '2024-09-17T05:21:53.466708+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:53.466708+0000', 'last_undegraded': '2024-09-17T05:21:53.466708+0000', 'last_fullsized': '2024-09-17T05:21:53.466708+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:21:58.295 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1 is not active+clean 2024-09-17T05:21:58.295 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:52.475966+0000', 'last_change': '2024-09-17T05:21:52.475966+0000', 'last_active': '2024-09-17T05:21:52.460729+0000', 'last_peered': '2024-09-17T05:21:52.460729+0000', 'last_clean': '2024-09-17T05:21:52.460729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:52.475966+0000', 'last_undegraded': '2024-09-17T05:21:52.475966+0000', 'last_fullsized': '2024-09-17T05:21:52.475966+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:52.460729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:52.460729+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:52.460729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:21:58.295 INFO:tasks.ceph.ceph_manager.ceph:PG 3.7 is not active+clean 2024-09-17T05:21:58.295 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:21:53.466708+0000', 'last_change': '2024-09-17T05:21:53.466708+0000', 'last_active': '2024-09-17T05:21:53.466708+0000', 'last_peered': '2024-09-17T05:21:53.466708+0000', 'last_clean': '2024-09-17T05:21:53.466708+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:53.466708+0000', 'last_undegraded': '2024-09-17T05:21:53.466708+0000', 'last_fullsized': '2024-09-17T05:21:53.466708+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:21:58.295 INFO:tasks.ceph.ceph_manager.ceph:PG 3.6 is not active+clean 2024-09-17T05:21:58.295 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:21:53.466708+0000', 'last_change': '2024-09-17T05:21:53.466708+0000', 'last_active': '2024-09-17T05:21:53.466708+0000', 'last_peered': '2024-09-17T05:21:53.466708+0000', 'last_clean': '2024-09-17T05:21:53.466708+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:53.466708+0000', 'last_undegraded': '2024-09-17T05:21:53.466708+0000', 'last_fullsized': '2024-09-17T05:21:53.466708+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:21:58.295 INFO:tasks.ceph.ceph_manager.ceph:PG 3.8 is not active+clean 2024-09-17T05:21:58.296 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:21:53.466708+0000', 'last_change': '2024-09-17T05:21:53.466708+0000', 'last_active': '2024-09-17T05:21:53.466708+0000', 'last_peered': '2024-09-17T05:21:53.466708+0000', 'last_clean': '2024-09-17T05:21:53.466708+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:53.466708+0000', 'last_undegraded': '2024-09-17T05:21:53.466708+0000', 'last_fullsized': '2024-09-17T05:21:53.466708+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:21:58.296 INFO:tasks.ceph.ceph_manager.ceph:PG 3.b is not active+clean 2024-09-17T05:21:58.296 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:21:53.466708+0000', 'last_change': '2024-09-17T05:21:53.466708+0000', 'last_active': '2024-09-17T05:21:53.466708+0000', 'last_peered': '2024-09-17T05:21:53.466708+0000', 'last_clean': '2024-09-17T05:21:53.466708+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:53.466708+0000', 'last_undegraded': '2024-09-17T05:21:53.466708+0000', 'last_fullsized': '2024-09-17T05:21:53.466708+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:21:58.296 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1f is not active+clean 2024-09-17T05:21:58.296 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:21:53.466708+0000', 'last_change': '2024-09-17T05:21:53.466708+0000', 'last_active': '2024-09-17T05:21:53.466708+0000', 'last_peered': '2024-09-17T05:21:53.466708+0000', 'last_clean': '2024-09-17T05:21:53.466708+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:53.466708+0000', 'last_undegraded': '2024-09-17T05:21:53.466708+0000', 'last_fullsized': '2024-09-17T05:21:53.466708+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:21:58.296 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1e is not active+clean 2024-09-17T05:21:58.296 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:52.473007+0000', 'last_change': '2024-09-17T05:21:52.473007+0000', 'last_active': '2024-09-17T05:21:52.460729+0000', 'last_peered': '2024-09-17T05:21:52.460729+0000', 'last_clean': '2024-09-17T05:21:52.460729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:52.473007+0000', 'last_undegraded': '2024-09-17T05:21:52.473007+0000', 'last_fullsized': '2024-09-17T05:21:52.473007+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:52.460729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:52.460729+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:52.460729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:21:58.296 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1e is not active+clean 2024-09-17T05:21:58.296 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:21:53.466708+0000', 'last_change': '2024-09-17T05:21:53.466708+0000', 'last_active': '2024-09-17T05:21:53.466708+0000', 'last_peered': '2024-09-17T05:21:53.466708+0000', 'last_clean': '2024-09-17T05:21:53.466708+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:53.466708+0000', 'last_undegraded': '2024-09-17T05:21:53.466708+0000', 'last_fullsized': '2024-09-17T05:21:53.466708+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:53.466708+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:21:58.296 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1f is not active+clean 2024-09-17T05:21:58.297 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:52.473390+0000', 'last_change': '2024-09-17T05:21:52.473390+0000', 'last_active': '2024-09-17T05:21:52.460729+0000', 'last_peered': '2024-09-17T05:21:52.460729+0000', 'last_clean': '2024-09-17T05:21:52.460729+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:52.473390+0000', 'last_undegraded': '2024-09-17T05:21:52.473390+0000', 'last_fullsized': '2024-09-17T05:21:52.473390+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:52.460729+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:52.460729+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:52.460729+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:21:58.297 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T05:21:58.426 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.425+0000 7f6a9f7ec640 1 -- 172.21.15.98:0/2855221892 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a980b2be0 msgr2=0x7f6a980ce8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:58.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.425+0000 7f6a9f7ec640 1 --2- 172.21.15.98:0/2855221892 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a980b2be0 0x7f6a980ce8f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6a980b3790 tx=0x7f6a9002a5f0 comp rx=0 tx=0).stop 2024-09-17T05:21:58.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.425+0000 7f6a9f7ec640 1 -- 172.21.15.98:0/2855221892 shutdown_connections 2024-09-17T05:21:58.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.425+0000 7f6a9f7ec640 1 --2- 172.21.15.98:0/2855221892 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a980b2be0 0x7f6a980ce8f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:58.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.425+0000 7f6a9f7ec640 1 --2- 172.21.15.98:0/2855221892 >> v2:172.21.15.167:3300/0 conn(0x7f6a980b4ab0 0x7f6a980acd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:58.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.425+0000 7f6a9f7ec640 1 -- 172.21.15.98:0/2855221892 >> 172.21.15.98:0/2855221892 conn(0x7f6a980b18e0 msgr2=0x7f6a980b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:58.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.425+0000 7f6a9f7ec640 1 -- 172.21.15.98:0/2855221892 shutdown_connections 2024-09-17T05:21:58.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.425+0000 7f6a9f7ec640 1 -- 172.21.15.98:0/2855221892 wait complete. 2024-09-17T05:21:58.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.426+0000 7f6a9f7ec640 1 Processor -- start 2024-09-17T05:21:58.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.426+0000 7f6a9f7ec640 1 -- start start 2024-09-17T05:21:58.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.427+0000 7f6a9f7ec640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a980b2be0 0x7f6a9809b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:58.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.427+0000 7f6a9f7ec640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a980b4ab0 0x7f6a9809c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:58.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.427+0000 7f6a9f7ec640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a9815a660 0x7f6a98151460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:58.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.427+0000 7f6a9f7ec640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6a980cee30 con 0x7f6a9815a660 2024-09-17T05:21:58.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.427+0000 7f6a9f7ec640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6a9806f910 con 0x7f6a980b4ab0 2024-09-17T05:21:58.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.427+0000 7f6a9f7ec640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f6a980cefb0 con 0x7f6a980b2be0 2024-09-17T05:21:58.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.427+0000 7f6a9dd89640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a9815a660 0x7f6a98151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:58.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.427+0000 7f6a9dd89640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a9815a660 0x7f6a98151460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47416/0 (socket says 172.21.15.98:47416) 2024-09-17T05:21:58.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.427+0000 7f6a9dd89640 1 -- 172.21.15.98:0/138508090 learned_addr learned my addr 172.21.15.98:0/138508090 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:21:58.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.427+0000 7f6a9cd87640 1 --2- 172.21.15.98:0/138508090 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a980b4ab0 0x7f6a9809c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:58.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.427+0000 7f6a9d588640 1 --2- 172.21.15.98:0/138508090 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a980b2be0 0x7f6a9809b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:58.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.427+0000 7f6a9dd89640 1 -- 172.21.15.98:0/138508090 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a980b2be0 msgr2=0x7f6a9809b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:58.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.427+0000 7f6a9dd89640 1 --2- 172.21.15.98:0/138508090 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a980b2be0 0x7f6a9809b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:58.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.427+0000 7f6a9dd89640 1 -- 172.21.15.98:0/138508090 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a980b4ab0 msgr2=0x7f6a9809c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:58.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.427+0000 7f6a9dd89640 1 --2- 172.21.15.98:0/138508090 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a980b4ab0 0x7f6a9809c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:58.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.427+0000 7f6a9dd89640 1 -- 172.21.15.98:0/138508090 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a9809d3d0 con 0x7f6a9815a660 2024-09-17T05:21:58.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.428+0000 7f6a9dd89640 1 --2- 172.21.15.98:0/138508090 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a9815a660 0x7f6a98151460 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6a90009230 tx=0x7f6a90003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:58.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.428+0000 7f6a8dffb640 1 -- 172.21.15.98:0/138508090 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a9003f070 con 0x7f6a9815a660 2024-09-17T05:21:58.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.428+0000 7f6a8dffb640 1 -- 172.21.15.98:0/138508090 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6a900047a0 con 0x7f6a9815a660 2024-09-17T05:21:58.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.428+0000 7f6a9f7ec640 1 -- 172.21.15.98:0/138508090 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a9809d6b0 con 0x7f6a9815a660 2024-09-17T05:21:58.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.428+0000 7f6a8dffb640 1 -- 172.21.15.98:0/138508090 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a90035030 con 0x7f6a9815a660 2024-09-17T05:21:58.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.428+0000 7f6a9f7ec640 1 -- 172.21.15.98:0/138508090 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a981519a0 con 0x7f6a9815a660 2024-09-17T05:21:58.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.429+0000 7f6a9f7ec640 1 -- 172.21.15.98:0/138508090 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a98069360 con 0x7f6a9815a660 2024-09-17T05:21:58.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.429+0000 7f6a8dffb640 1 -- 172.21.15.98:0/138508090 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6a90042070 con 0x7f6a9815a660 2024-09-17T05:21:58.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.430+0000 7f6a8dffb640 1 --2- 172.21.15.98:0/138508090 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f6a7c078bc0 0x7f6a7c07b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:58.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.430+0000 7f6a8dffb640 1 -- 172.21.15.98:0/138508090 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f6a900bbab0 con 0x7f6a9815a660 2024-09-17T05:21:58.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.430+0000 7f6a9d588640 1 --2- 172.21.15.98:0/138508090 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f6a7c078bc0 0x7f6a7c07b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:58.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.431+0000 7f6a9d588640 1 --2- 172.21.15.98:0/138508090 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f6a7c078bc0 0x7f6a7c07b080 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6a94001e20 tx=0x7f6a94009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:58.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.434+0000 7f6a8dffb640 1 -- 172.21.15.98:0/138508090 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f6a90083930 con 0x7f6a9815a660 2024-09-17T05:21:58.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.681+0000 7f6a9f7ec640 1 -- 172.21.15.98:0/138508090 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f6a9809ccc0 con 0x7f6a9815a660 2024-09-17T05:21:58.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.681+0000 7f6a8dffb640 1 -- 172.21.15.98:0/138508090 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1215 (secure 0 0 0) 0x7f6a90088360 con 0x7f6a9815a660 2024-09-17T05:21:58.682 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:21:58.682 INFO:teuthology.orchestra.run.smithi098.stdout:{"fsid":"fcbf5a43-b3d8-497c-b15d-3cc022477cf0","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":28,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":21,"num_osds":8,"num_up_osds":8,"osd_up_since":1726550502,"num_in_osds":8,"osd_in_since":1726550492,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":65},{"state_name":"unknown","count":23},{"state_name":"creating+peering","count":9}],"num_pgs":97,"num_pools":3,"num_objects":15,"data_bytes":592162,"bytes_used":224210944,"bytes_avail":772869902336,"bytes_total":773094113280,"unknown_pgs_ratio":0.23711340129375458,"inactive_pgs_ratio":0.092783503234386444,"write_bytes_sec":1062,"read_op_per_sec":0,"write_op_per_sec":3},"fsmap":{"epoch":7,"btime":"2024-09-17T05:21:56:643998+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":4386}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-09-17T05:21:29.853299+0000","services":{}},"progress_events":{}} 2024-09-17T05:21:58.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.683+0000 7f6a9f7ec640 1 -- 172.21.15.98:0/138508090 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f6a7c078bc0 msgr2=0x7f6a7c07b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:58.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.683+0000 7f6a9f7ec640 1 --2- 172.21.15.98:0/138508090 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f6a7c078bc0 0x7f6a7c07b080 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6a94001e20 tx=0x7f6a94009040 comp rx=0 tx=0).stop 2024-09-17T05:21:58.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.683+0000 7f6a9f7ec640 1 -- 172.21.15.98:0/138508090 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a9815a660 msgr2=0x7f6a98151460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:58.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.683+0000 7f6a9f7ec640 1 --2- 172.21.15.98:0/138508090 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a9815a660 0x7f6a98151460 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6a90009230 tx=0x7f6a90003960 comp rx=0 tx=0).stop 2024-09-17T05:21:58.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.683+0000 7f6a9f7ec640 1 -- 172.21.15.98:0/138508090 shutdown_connections 2024-09-17T05:21:58.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.683+0000 7f6a9f7ec640 1 --2- 172.21.15.98:0/138508090 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f6a7c078bc0 0x7f6a7c07b080 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:58.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.683+0000 7f6a9f7ec640 1 --2- 172.21.15.98:0/138508090 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a9815a660 0x7f6a98151460 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:58.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.683+0000 7f6a9f7ec640 1 --2- 172.21.15.98:0/138508090 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a980b4ab0 0x7f6a9809c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:58.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.683+0000 7f6a9f7ec640 1 --2- 172.21.15.98:0/138508090 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a980b2be0 0x7f6a9809b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:58.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.683+0000 7f6a9f7ec640 1 -- 172.21.15.98:0/138508090 >> 172.21.15.98:0/138508090 conn(0x7f6a980b18e0 msgr2=0x7f6a981e77d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:58.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.683+0000 7f6a9f7ec640 1 -- 172.21.15.98:0/138508090 shutdown_connections 2024-09-17T05:21:58.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.683+0000 7f6a9f7ec640 1 -- 172.21.15.98:0/138508090 wait complete. 2024-09-17T05:21:58.695 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T05:21:58.695 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:21:58.796 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.795+0000 7fa37c471640 1 -- 172.21.15.98:0/1993640259 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa374070580 msgr2=0x7fa374151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:58.796 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.795+0000 7fa37c471640 1 --2- 172.21.15.98:0/1993640259 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa374070580 0x7fa374151e60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa36c005fd0 tx=0x7fa36c02a5d0 comp rx=0 tx=0).stop 2024-09-17T05:21:58.796 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.795+0000 7fa37c471640 1 -- 172.21.15.98:0/1993640259 shutdown_connections 2024-09-17T05:21:58.796 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.795+0000 7fa37c471640 1 --2- 172.21.15.98:0/1993640259 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa374070580 0x7fa374151e60 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:58.796 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.795+0000 7fa37c471640 1 -- 172.21.15.98:0/1993640259 >> 172.21.15.98:0/1993640259 conn(0x7fa3740b2230 msgr2=0x7fa3740b2610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:58.796 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.795+0000 7fa37c471640 1 -- 172.21.15.98:0/1993640259 shutdown_connections 2024-09-17T05:21:58.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.795+0000 7fa37c471640 1 -- 172.21.15.98:0/1993640259 wait complete. 2024-09-17T05:21:58.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.796+0000 7fa37c471640 1 Processor -- start 2024-09-17T05:21:58.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.796+0000 7fa37c471640 1 -- start start 2024-09-17T05:21:58.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.797+0000 7fa37c471640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa374070580 0x7fa37413ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:58.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.797+0000 7fa37c471640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa3740730c0 0x7fa3741f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:58.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.797+0000 7fa37c471640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa37415bdc0 0x7fa37414ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:58.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.797+0000 7fa37c471640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa37415c320 con 0x7fa374070580 2024-09-17T05:21:58.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.797+0000 7fa37c471640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa37415c1a0 con 0x7fa37415bdc0 2024-09-17T05:21:58.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.797+0000 7fa37c471640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fa374073530 con 0x7fa3740730c0 2024-09-17T05:21:58.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.797+0000 7fa37a20d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa374070580 0x7fa37413ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:58.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.797+0000 7fa37a20d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa374070580 0x7fa37413ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47426/0 (socket says 172.21.15.98:47426) 2024-09-17T05:21:58.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.797+0000 7fa37a20d640 1 -- 172.21.15.98:0/2114215081 learned_addr learned my addr 172.21.15.98:0/2114215081 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:21:58.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.797+0000 7fa37aa0e640 1 --2- 172.21.15.98:0/2114215081 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa37415bdc0 0x7fa37414ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:58.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.797+0000 7fa37a20d640 1 -- 172.21.15.98:0/2114215081 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa3740730c0 msgr2=0x7fa3741f8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:58.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.797+0000 7fa379a0c640 1 --2- 172.21.15.98:0/2114215081 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa3740730c0 0x7fa3741f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:58.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.797+0000 7fa37a20d640 1 --2- 172.21.15.98:0/2114215081 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa3740730c0 0x7fa3741f8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:58.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.797+0000 7fa37a20d640 1 -- 172.21.15.98:0/2114215081 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa37415bdc0 msgr2=0x7fa37414ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:58.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.797+0000 7fa37a20d640 1 --2- 172.21.15.98:0/2114215081 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa37415bdc0 0x7fa37414ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:58.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.797+0000 7fa37a20d640 1 -- 172.21.15.98:0/2114215081 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3741f8f70 con 0x7fa374070580 2024-09-17T05:21:58.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.797+0000 7fa37aa0e640 1 --2- 172.21.15.98:0/2114215081 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa37415bdc0 0x7fa37414ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:21:58.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.797+0000 7fa379a0c640 1 --2- 172.21.15.98:0/2114215081 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa3740730c0 0x7fa3741f8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:21:58.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.797+0000 7fa37a20d640 1 --2- 172.21.15.98:0/2114215081 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa374070580 0x7fa37413ef80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa36400ba80 tx=0x7fa36400bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:58.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.798+0000 7fa372ffd640 1 -- 172.21.15.98:0/2114215081 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa364019070 con 0x7fa374070580 2024-09-17T05:21:58.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.798+0000 7fa372ffd640 1 -- 172.21.15.98:0/2114215081 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa36400cd80 con 0x7fa374070580 2024-09-17T05:21:58.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.798+0000 7fa37c471640 1 -- 172.21.15.98:0/2114215081 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa37414dad0 con 0x7fa374070580 2024-09-17T05:21:58.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.798+0000 7fa372ffd640 1 -- 172.21.15.98:0/2114215081 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3640146a0 con 0x7fa374070580 2024-09-17T05:21:58.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.798+0000 7fa37c471640 1 -- 172.21.15.98:0/2114215081 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa37414e090 con 0x7fa374070580 2024-09-17T05:21:58.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.799+0000 7fa37c471640 1 -- 172.21.15.98:0/2114215081 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3740b3d00 con 0x7fa374070580 2024-09-17T05:21:58.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.799+0000 7fa372ffd640 1 -- 172.21.15.98:0/2114215081 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa36401c070 con 0x7fa374070580 2024-09-17T05:21:58.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.800+0000 7fa372ffd640 1 --2- 172.21.15.98:0/2114215081 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fa360078b90 0x7fa36007b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:58.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.800+0000 7fa372ffd640 1 -- 172.21.15.98:0/2114215081 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa36409aa60 con 0x7fa374070580 2024-09-17T05:21:58.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.800+0000 7fa379a0c640 1 --2- 172.21.15.98:0/2114215081 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fa360078b90 0x7fa36007b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:58.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.800+0000 7fa379a0c640 1 --2- 172.21.15.98:0/2114215081 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fa360078b90 0x7fa36007b050 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa37415b100 tx=0x7fa368009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:58.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.804+0000 7fa372ffd640 1 -- 172.21.15.98:0/2114215081 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fa3741f8f70 con 0x7fa374070580 2024-09-17T05:21:58.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.977+0000 7fa37c471640 1 -- 172.21.15.98:0/2114215081 --> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa37415dfc0 con 0x7fa360078b90 2024-09-17T05:21:58.982 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.981+0000 7fa372ffd640 1 -- 172.21.15.98:0/2114215081 <== mgr.4103 v2:172.21.15.167:6800/610796449 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247845 (secure 0 0 0) 0x7fa37415dfc0 con 0x7fa360078b90 2024-09-17T05:21:58.985 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:21:58.988 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-17T05:21:58.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.985+0000 7fa37c471640 1 -- 172.21.15.98:0/2114215081 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fa360078b90 msgr2=0x7fa36007b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:58.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.985+0000 7fa37c471640 1 --2- 172.21.15.98:0/2114215081 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fa360078b90 0x7fa36007b050 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa37415b100 tx=0x7fa368009040 comp rx=0 tx=0).stop 2024-09-17T05:21:58.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.985+0000 7fa37c471640 1 -- 172.21.15.98:0/2114215081 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa374070580 msgr2=0x7fa37413ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:58.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.985+0000 7fa37c471640 1 --2- 172.21.15.98:0/2114215081 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa374070580 0x7fa37413ef80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa36400ba80 tx=0x7fa36400bf40 comp rx=0 tx=0).stop 2024-09-17T05:21:58.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.985+0000 7fa37c471640 1 -- 172.21.15.98:0/2114215081 shutdown_connections 2024-09-17T05:21:58.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.985+0000 7fa37c471640 1 --2- 172.21.15.98:0/2114215081 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fa360078b90 0x7fa36007b050 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:58.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.985+0000 7fa37c471640 1 --2- 172.21.15.98:0/2114215081 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa37415bdc0 0x7fa37414ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:58.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.985+0000 7fa37c471640 1 --2- 172.21.15.98:0/2114215081 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa3740730c0 0x7fa3741f8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:58.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.985+0000 7fa37c471640 1 --2- 172.21.15.98:0/2114215081 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa374070580 0x7fa37413ef80 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:58.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.985+0000 7fa37c471640 1 -- 172.21.15.98:0/2114215081 >> 172.21.15.98:0/2114215081 conn(0x7fa3740b2230 msgr2=0x7fa3740b2610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:58.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.985+0000 7fa37c471640 1 -- 172.21.15.98:0/2114215081 shutdown_connections 2024-09-17T05:21:58.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:21:58.985+0000 7fa37c471640 1 -- 172.21.15.98:0/2114215081 wait complete. 2024-09-17T05:21:58.996 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-17T05:21:58.248814+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592162,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":124,"num_write_kb":1634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":93,"ondisk_log_size":93,"up":148,"acting":148,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":89,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218956,"kb_used_data":2712,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755764,"statfs":{"total":773094113280,"available":772869902336,"internally_reserved":0,"allocated":2777088,"data_stored":1706487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1794,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.781114"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.497272+0000","last_change":"2024-09-17T05:21:54.501153+0000","last_active":"2024-09-17T05:21:55.497272+0000","last_peered":"2024-09-17T05:21:55.497272+0000","last_clean":"2024-09-17T05:21:55.497272+0000","last_became_active":"2024-09-17T05:21:54.500904+0000","last_became_peered":"2024-09-17T05:21:54.500904+0000","last_unstale":"2024-09-17T05:21:55.497272+0000","last_undegraded":"2024-09-17T05:21:55.497272+0000","last_fullsized":"2024-09-17T05:21:55.497272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:52:10.150875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499897+0000","last_change":"2024-09-17T05:21:54.494958+0000","last_active":"2024-09-17T05:21:55.499897+0000","last_peered":"2024-09-17T05:21:55.499897+0000","last_clean":"2024-09-17T05:21:55.499897+0000","last_became_active":"2024-09-17T05:21:54.494510+0000","last_became_peered":"2024-09-17T05:21:54.494510+0000","last_unstale":"2024-09-17T05:21:55.499897+0000","last_undegraded":"2024-09-17T05:21:55.499897+0000","last_fullsized":"2024-09-17T05:21:55.499897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:12:27.112041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.497441+0000","last_change":"2024-09-17T05:21:54.508228+0000","last_active":"2024-09-17T05:21:55.497441+0000","last_peered":"2024-09-17T05:21:55.497441+0000","last_clean":"2024-09-17T05:21:55.497441+0000","last_became_active":"2024-09-17T05:21:54.507980+0000","last_became_peered":"2024-09-17T05:21:54.507980+0000","last_unstale":"2024-09-17T05:21:55.497441+0000","last_undegraded":"2024-09-17T05:21:55.497441+0000","last_fullsized":"2024-09-17T05:21:55.497441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:59:07.965886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.496599+0000","last_change":"2024-09-17T05:21:54.495253+0000","last_active":"2024-09-17T05:21:55.496599+0000","last_peered":"2024-09-17T05:21:55.496599+0000","last_clean":"2024-09-17T05:21:55.496599+0000","last_became_active":"2024-09-17T05:21:54.494929+0000","last_became_peered":"2024-09-17T05:21:54.494929+0000","last_unstale":"2024-09-17T05:21:55.496599+0000","last_undegraded":"2024-09-17T05:21:55.496599+0000","last_fullsized":"2024-09-17T05:21:55.496599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:38.013877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.498278+0000","last_change":"2024-09-17T05:21:54.509547+0000","last_active":"2024-09-17T05:21:55.498278+0000","last_peered":"2024-09-17T05:21:55.498278+0000","last_clean":"2024-09-17T05:21:55.498278+0000","last_became_active":"2024-09-17T05:21:54.509223+0000","last_became_peered":"2024-09-17T05:21:54.509223+0000","last_unstale":"2024-09-17T05:21:55.498278+0000","last_undegraded":"2024-09-17T05:21:55.498278+0000","last_fullsized":"2024-09-17T05:21:55.498278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:51.043848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.496253+0000","last_change":"2024-09-17T05:21:54.497328+0000","last_active":"2024-09-17T05:21:55.496253+0000","last_peered":"2024-09-17T05:21:55.496253+0000","last_clean":"2024-09-17T05:21:55.496253+0000","last_became_active":"2024-09-17T05:21:54.497033+0000","last_became_peered":"2024-09-17T05:21:54.497033+0000","last_unstale":"2024-09-17T05:21:55.496253+0000","last_undegraded":"2024-09-17T05:21:55.496253+0000","last_fullsized":"2024-09-17T05:21:55.496253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:35:45.144313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.497784+0000","last_change":"2024-09-17T05:21:54.511143+0000","last_active":"2024-09-17T05:21:55.497784+0000","last_peered":"2024-09-17T05:21:55.497784+0000","last_clean":"2024-09-17T05:21:55.497784+0000","last_became_active":"2024-09-17T05:21:54.510864+0000","last_became_peered":"2024-09-17T05:21:54.510864+0000","last_unstale":"2024-09-17T05:21:55.497784+0000","last_undegraded":"2024-09-17T05:21:55.497784+0000","last_fullsized":"2024-09-17T05:21:55.497784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:22:47.632841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.502509+0000","last_change":"2024-09-17T05:21:54.512618+0000","last_active":"2024-09-17T05:21:55.502509+0000","last_peered":"2024-09-17T05:21:55.502509+0000","last_clean":"2024-09-17T05:21:55.502509+0000","last_became_active":"2024-09-17T05:21:54.512003+0000","last_became_peered":"2024-09-17T05:21:54.512003+0000","last_unstale":"2024-09-17T05:21:55.502509+0000","last_undegraded":"2024-09-17T05:21:55.502509+0000","last_fullsized":"2024-09-17T05:21:55.502509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:28:33.399315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.502291+0000","last_change":"2024-09-17T05:21:54.512890+0000","last_active":"2024-09-17T05:21:55.502291+0000","last_peered":"2024-09-17T05:21:55.502291+0000","last_clean":"2024-09-17T05:21:55.502291+0000","last_became_active":"2024-09-17T05:21:54.511924+0000","last_became_peered":"2024-09-17T05:21:54.511924+0000","last_unstale":"2024-09-17T05:21:55.502291+0000","last_undegraded":"2024-09-17T05:21:55.502291+0000","last_fullsized":"2024-09-17T05:21:55.502291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:41.750971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499252+0000","last_change":"2024-09-17T05:21:54.501003+0000","last_active":"2024-09-17T05:21:55.499252+0000","last_peered":"2024-09-17T05:21:55.499252+0000","last_clean":"2024-09-17T05:21:55.499252+0000","last_became_active":"2024-09-17T05:21:54.500716+0000","last_became_peered":"2024-09-17T05:21:54.500716+0000","last_unstale":"2024-09-17T05:21:55.499252+0000","last_undegraded":"2024-09-17T05:21:55.499252+0000","last_fullsized":"2024-09-17T05:21:55.499252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:03.364449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499687+0000","last_change":"2024-09-17T05:21:54.499559+0000","last_active":"2024-09-17T05:21:55.499687+0000","last_peered":"2024-09-17T05:21:55.499687+0000","last_clean":"2024-09-17T05:21:55.499687+0000","last_became_active":"2024-09-17T05:21:54.498587+0000","last_became_peered":"2024-09-17T05:21:54.498587+0000","last_unstale":"2024-09-17T05:21:55.499687+0000","last_undegraded":"2024-09-17T05:21:55.499687+0000","last_fullsized":"2024-09-17T05:21:55.499687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:18.824693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.498770+0000","last_change":"2024-09-17T05:21:54.511036+0000","last_active":"2024-09-17T05:21:55.498770+0000","last_peered":"2024-09-17T05:21:55.498770+0000","last_clean":"2024-09-17T05:21:55.498770+0000","last_became_active":"2024-09-17T05:21:54.510599+0000","last_became_peered":"2024-09-17T05:21:54.510599+0000","last_unstale":"2024-09-17T05:21:55.498770+0000","last_undegraded":"2024-09-17T05:21:55.498770+0000","last_fullsized":"2024-09-17T05:21:55.498770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:29.213187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.498235+0000","last_change":"2024-09-17T05:21:54.510133+0000","last_active":"2024-09-17T05:21:55.498235+0000","last_peered":"2024-09-17T05:21:55.498235+0000","last_clean":"2024-09-17T05:21:55.498235+0000","last_became_active":"2024-09-17T05:21:54.509861+0000","last_became_peered":"2024-09-17T05:21:54.509861+0000","last_unstale":"2024-09-17T05:21:55.498235+0000","last_undegraded":"2024-09-17T05:21:55.498235+0000","last_fullsized":"2024-09-17T05:21:55.498235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:35:45.144313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.497008+0000","last_change":"2024-09-17T05:21:54.497275+0000","last_active":"2024-09-17T05:21:55.497008+0000","last_peered":"2024-09-17T05:21:55.497008+0000","last_clean":"2024-09-17T05:21:55.497008+0000","last_became_active":"2024-09-17T05:21:54.495616+0000","last_became_peered":"2024-09-17T05:21:54.495616+0000","last_unstale":"2024-09-17T05:21:55.497008+0000","last_undegraded":"2024-09-17T05:21:55.497008+0000","last_fullsized":"2024-09-17T05:21:55.497008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:29.213187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.502388+0000","last_change":"2024-09-17T05:21:54.504915+0000","last_active":"2024-09-17T05:21:55.502388+0000","last_peered":"2024-09-17T05:21:55.502388+0000","last_clean":"2024-09-17T05:21:55.502388+0000","last_became_active":"2024-09-17T05:21:54.503778+0000","last_became_peered":"2024-09-17T05:21:54.503778+0000","last_unstale":"2024-09-17T05:21:55.502388+0000","last_undegraded":"2024-09-17T05:21:55.502388+0000","last_fullsized":"2024-09-17T05:21:55.502388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:45.560083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.498656+0000","last_change":"2024-09-17T05:21:54.509569+0000","last_active":"2024-09-17T05:21:55.498656+0000","last_peered":"2024-09-17T05:21:55.498656+0000","last_clean":"2024-09-17T05:21:55.498656+0000","last_became_active":"2024-09-17T05:21:54.508928+0000","last_became_peered":"2024-09-17T05:21:54.508928+0000","last_unstale":"2024-09-17T05:21:55.498656+0000","last_undegraded":"2024-09-17T05:21:55.498656+0000","last_fullsized":"2024-09-17T05:21:55.498656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:12:31.977218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499016+0000","last_change":"2024-09-17T05:21:54.510866+0000","last_active":"2024-09-17T05:21:55.499016+0000","last_peered":"2024-09-17T05:21:55.499016+0000","last_clean":"2024-09-17T05:21:55.499016+0000","last_became_active":"2024-09-17T05:21:54.510301+0000","last_became_peered":"2024-09-17T05:21:54.510301+0000","last_unstale":"2024-09-17T05:21:55.499016+0000","last_undegraded":"2024-09-17T05:21:55.499016+0000","last_fullsized":"2024-09-17T05:21:55.499016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:52:10.150875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.502586+0000","last_change":"2024-09-17T05:21:54.497869+0000","last_active":"2024-09-17T05:21:55.502586+0000","last_peered":"2024-09-17T05:21:55.502586+0000","last_clean":"2024-09-17T05:21:55.502586+0000","last_became_active":"2024-09-17T05:21:54.497583+0000","last_became_peered":"2024-09-17T05:21:54.497583+0000","last_unstale":"2024-09-17T05:21:55.502586+0000","last_undegraded":"2024-09-17T05:21:55.502586+0000","last_fullsized":"2024-09-17T05:21:55.502586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:42:01.373169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499859+0000","last_change":"2024-09-17T05:21:54.493860+0000","last_active":"2024-09-17T05:21:55.499859+0000","last_peered":"2024-09-17T05:21:55.499859+0000","last_clean":"2024-09-17T05:21:55.499859+0000","last_became_active":"2024-09-17T05:21:54.493554+0000","last_became_peered":"2024-09-17T05:21:54.493554+0000","last_unstale":"2024-09-17T05:21:55.499859+0000","last_undegraded":"2024-09-17T05:21:55.499859+0000","last_fullsized":"2024-09-17T05:21:55.499859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:30:58.548877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.498946+0000","last_change":"2024-09-17T05:21:54.508790+0000","last_active":"2024-09-17T05:21:55.498946+0000","last_peered":"2024-09-17T05:21:55.498946+0000","last_clean":"2024-09-17T05:21:55.498946+0000","last_became_active":"2024-09-17T05:21:54.508431+0000","last_became_peered":"2024-09-17T05:21:54.508431+0000","last_unstale":"2024-09-17T05:21:55.498946+0000","last_undegraded":"2024-09-17T05:21:55.498946+0000","last_fullsized":"2024-09-17T05:21:55.498946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:26:25.545759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.502048+0000","last_change":"2024-09-17T05:21:54.505209+0000","last_active":"2024-09-17T05:21:55.502048+0000","last_peered":"2024-09-17T05:21:55.502048+0000","last_clean":"2024-09-17T05:21:55.502048+0000","last_became_active":"2024-09-17T05:21:54.504601+0000","last_became_peered":"2024-09-17T05:21:54.504601+0000","last_unstale":"2024-09-17T05:21:55.502048+0000","last_undegraded":"2024-09-17T05:21:55.502048+0000","last_fullsized":"2024-09-17T05:21:55.502048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:32.727377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.498911+0000","last_change":"2024-09-17T05:21:54.495748+0000","last_active":"2024-09-17T05:21:55.498911+0000","last_peered":"2024-09-17T05:21:55.498911+0000","last_clean":"2024-09-17T05:21:55.498911+0000","last_became_active":"2024-09-17T05:21:54.494696+0000","last_became_peered":"2024-09-17T05:21:54.494696+0000","last_unstale":"2024-09-17T05:21:55.498911+0000","last_undegraded":"2024-09-17T05:21:55.498911+0000","last_fullsized":"2024-09-17T05:21:55.498911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:02.422828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:21:52.472932+0000","last_change":"2024-09-17T05:21:52.472932+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.472932+0000","last_undegraded":"2024-09-17T05:21:52.472932+0000","last_fullsized":"2024-09-17T05:21:52.472932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.502078+0000","last_change":"2024-09-17T05:21:53.493253+0000","last_active":"2024-09-17T05:21:55.502078+0000","last_peered":"2024-09-17T05:21:55.502078+0000","last_clean":"2024-09-17T05:21:55.502078+0000","last_became_active":"2024-09-17T05:21:53.492943+0000","last_became_peered":"2024-09-17T05:21:53.492943+0000","last_unstale":"2024-09-17T05:21:55.502078+0000","last_undegraded":"2024-09-17T05:21:55.502078+0000","last_fullsized":"2024-09-17T05:21:55.502078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:53:55.808093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:21:52.472910+0000","last_change":"2024-09-17T05:21:52.472910+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.472910+0000","last_undegraded":"2024-09-17T05:21:52.472910+0000","last_fullsized":"2024-09-17T05:21:52.472910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499004+0000","last_change":"2024-09-17T05:21:53.489575+0000","last_active":"2024-09-17T05:21:55.499004+0000","last_peered":"2024-09-17T05:21:55.499004+0000","last_clean":"2024-09-17T05:21:55.499004+0000","last_became_active":"2024-09-17T05:21:53.489294+0000","last_became_peered":"2024-09-17T05:21:53.489294+0000","last_unstale":"2024-09-17T05:21:55.499004+0000","last_undegraded":"2024-09-17T05:21:55.499004+0000","last_fullsized":"2024-09-17T05:21:55.499004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:28.463818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499674+0000","last_change":"2024-09-17T05:21:54.494216+0000","last_active":"2024-09-17T05:21:55.499674+0000","last_peered":"2024-09-17T05:21:55.499674+0000","last_clean":"2024-09-17T05:21:55.499674+0000","last_became_active":"2024-09-17T05:21:54.492853+0000","last_became_peered":"2024-09-17T05:21:54.492853+0000","last_unstale":"2024-09-17T05:21:55.499674+0000","last_undegraded":"2024-09-17T05:21:55.499674+0000","last_fullsized":"2024-09-17T05:21:55.499674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:01:15.655368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.502262+0000","last_change":"2024-09-17T05:21:53.494796+0000","last_active":"2024-09-17T05:21:55.502262+0000","last_peered":"2024-09-17T05:21:55.502262+0000","last_clean":"2024-09-17T05:21:55.502262+0000","last_became_active":"2024-09-17T05:21:53.494486+0000","last_became_peered":"2024-09-17T05:21:53.494486+0000","last_unstale":"2024-09-17T05:21:55.502262+0000","last_undegraded":"2024-09-17T05:21:55.502262+0000","last_fullsized":"2024-09-17T05:21:55.502262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:59.914761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.497597+0000","last_change":"2024-09-17T05:21:54.509807+0000","last_active":"2024-09-17T05:21:55.497597+0000","last_peered":"2024-09-17T05:21:55.497597+0000","last_clean":"2024-09-17T05:21:55.497597+0000","last_became_active":"2024-09-17T05:21:54.509245+0000","last_became_peered":"2024-09-17T05:21:54.509245+0000","last_unstale":"2024-09-17T05:21:55.497597+0000","last_undegraded":"2024-09-17T05:21:55.497597+0000","last_fullsized":"2024-09-17T05:21:55.497597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:38:26.480830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.497949+0000","last_change":"2024-09-17T05:21:53.491049+0000","last_active":"2024-09-17T05:21:55.497949+0000","last_peered":"2024-09-17T05:21:55.497949+0000","last_clean":"2024-09-17T05:21:55.497949+0000","last_became_active":"2024-09-17T05:21:53.490795+0000","last_became_peered":"2024-09-17T05:21:53.490795+0000","last_unstale":"2024-09-17T05:21:55.497949+0000","last_undegraded":"2024-09-17T05:21:55.497949+0000","last_fullsized":"2024-09-17T05:21:55.497949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:03:21.023914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499832+0000","last_change":"2024-09-17T05:21:53.493370+0000","last_active":"2024-09-17T05:21:55.499832+0000","last_peered":"2024-09-17T05:21:55.499832+0000","last_clean":"2024-09-17T05:21:55.499832+0000","last_became_active":"2024-09-17T05:21:53.493010+0000","last_became_peered":"2024-09-17T05:21:53.493010+0000","last_unstale":"2024-09-17T05:21:55.499832+0000","last_undegraded":"2024-09-17T05:21:55.499832+0000","last_fullsized":"2024-09-17T05:21:55.499832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:21.689266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499435+0000","last_change":"2024-09-17T05:21:54.499432+0000","last_active":"2024-09-17T05:21:55.499435+0000","last_peered":"2024-09-17T05:21:55.499435+0000","last_clean":"2024-09-17T05:21:55.499435+0000","last_became_active":"2024-09-17T05:21:54.499133+0000","last_became_peered":"2024-09-17T05:21:54.499133+0000","last_unstale":"2024-09-17T05:21:55.499435+0000","last_undegraded":"2024-09-17T05:21:55.499435+0000","last_fullsized":"2024-09-17T05:21:55.499435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:53:18.926924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.502291+0000","last_change":"2024-09-17T05:21:53.491745+0000","last_active":"2024-09-17T05:21:55.502291+0000","last_peered":"2024-09-17T05:21:55.502291+0000","last_clean":"2024-09-17T05:21:55.502291+0000","last_became_active":"2024-09-17T05:21:53.491464+0000","last_became_peered":"2024-09-17T05:21:53.491464+0000","last_unstale":"2024-09-17T05:21:55.502291+0000","last_undegraded":"2024-09-17T05:21:55.502291+0000","last_fullsized":"2024-09-17T05:21:55.502291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:03:27.097328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.496199+0000","last_change":"2024-09-17T05:21:54.493190+0000","last_active":"2024-09-17T05:21:55.496199+0000","last_peered":"2024-09-17T05:21:55.496199+0000","last_clean":"2024-09-17T05:21:55.496199+0000","last_became_active":"2024-09-17T05:21:54.492889+0000","last_became_peered":"2024-09-17T05:21:54.492889+0000","last_unstale":"2024-09-17T05:21:55.496199+0000","last_undegraded":"2024-09-17T05:21:55.496199+0000","last_fullsized":"2024-09-17T05:21:55.496199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:40.851639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:21:52.473895+0000","last_change":"2024-09-17T05:21:52.473895+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.473895+0000","last_undegraded":"2024-09-17T05:21:52.473895+0000","last_fullsized":"2024-09-17T05:21:52.473895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499013+0000","last_change":"2024-09-17T05:21:53.489506+0000","last_active":"2024-09-17T05:21:55.499013+0000","last_peered":"2024-09-17T05:21:55.499013+0000","last_clean":"2024-09-17T05:21:55.499013+0000","last_became_active":"2024-09-17T05:21:53.488663+0000","last_became_peered":"2024-09-17T05:21:53.488663+0000","last_unstale":"2024-09-17T05:21:55.499013+0000","last_undegraded":"2024-09-17T05:21:55.499013+0000","last_fullsized":"2024-09-17T05:21:55.499013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:58:35.674900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.496782+0000","last_change":"2024-09-17T05:21:54.495318+0000","last_active":"2024-09-17T05:21:55.496782+0000","last_peered":"2024-09-17T05:21:55.496782+0000","last_clean":"2024-09-17T05:21:55.496782+0000","last_became_active":"2024-09-17T05:21:54.495022+0000","last_became_peered":"2024-09-17T05:21:54.495022+0000","last_unstale":"2024-09-17T05:21:55.496782+0000","last_undegraded":"2024-09-17T05:21:55.496782+0000","last_fullsized":"2024-09-17T05:21:55.496782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:12:31.977218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.501937+0000","last_change":"2024-09-17T05:21:53.493137+0000","last_active":"2024-09-17T05:21:55.501937+0000","last_peered":"2024-09-17T05:21:55.501937+0000","last_clean":"2024-09-17T05:21:55.501937+0000","last_became_active":"2024-09-17T05:21:53.492861+0000","last_became_peered":"2024-09-17T05:21:53.492861+0000","last_unstale":"2024-09-17T05:21:55.501937+0000","last_undegraded":"2024-09-17T05:21:55.501937+0000","last_fullsized":"2024-09-17T05:21:55.501937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:26:33.902720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.502039+0000","last_change":"2024-09-17T05:21:54.504481+0000","last_active":"2024-09-17T05:21:55.502039+0000","last_peered":"2024-09-17T05:21:55.502039+0000","last_clean":"2024-09-17T05:21:55.502039+0000","last_became_active":"2024-09-17T05:21:54.504110+0000","last_became_peered":"2024-09-17T05:21:54.504110+0000","last_unstale":"2024-09-17T05:21:55.502039+0000","last_undegraded":"2024-09-17T05:21:55.502039+0000","last_fullsized":"2024-09-17T05:21:55.502039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:06.884350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:21:52.475573+0000","last_change":"2024-09-17T05:21:52.475573+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.475573+0000","last_undegraded":"2024-09-17T05:21:52.475573+0000","last_fullsized":"2024-09-17T05:21:52.475573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.496294+0000","last_change":"2024-09-17T05:21:54.500288+0000","last_active":"2024-09-17T05:21:55.496294+0000","last_peered":"2024-09-17T05:21:55.496294+0000","last_clean":"2024-09-17T05:21:55.496294+0000","last_became_active":"2024-09-17T05:21:54.499508+0000","last_became_peered":"2024-09-17T05:21:54.499508+0000","last_unstale":"2024-09-17T05:21:55.496294+0000","last_undegraded":"2024-09-17T05:21:55.496294+0000","last_fullsized":"2024-09-17T05:21:55.496294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:51.043848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499138+0000","last_change":"2024-09-17T05:21:53.486134+0000","last_active":"2024-09-17T05:21:55.499138+0000","last_peered":"2024-09-17T05:21:55.499138+0000","last_clean":"2024-09-17T05:21:55.499138+0000","last_became_active":"2024-09-17T05:21:53.485804+0000","last_became_peered":"2024-09-17T05:21:53.485804+0000","last_unstale":"2024-09-17T05:21:55.499138+0000","last_undegraded":"2024-09-17T05:21:55.499138+0000","last_fullsized":"2024-09-17T05:21:55.499138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:34:05.720343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.497407+0000","last_change":"2024-09-17T05:21:54.499818+0000","last_active":"2024-09-17T05:21:55.497407+0000","last_peered":"2024-09-17T05:21:55.497407+0000","last_clean":"2024-09-17T05:21:55.497407+0000","last_became_active":"2024-09-17T05:21:54.499298+0000","last_became_peered":"2024-09-17T05:21:54.499298+0000","last_unstale":"2024-09-17T05:21:55.497407+0000","last_undegraded":"2024-09-17T05:21:55.497407+0000","last_fullsized":"2024-09-17T05:21:55.497407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:26:25.545759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:21:52.475586+0000","last_change":"2024-09-17T05:21:52.475586+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.475586+0000","last_undegraded":"2024-09-17T05:21:52.475586+0000","last_fullsized":"2024-09-17T05:21:52.475586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.497849+0000","last_change":"2024-09-17T05:21:54.499532+0000","last_active":"2024-09-17T05:21:55.497849+0000","last_peered":"2024-09-17T05:21:55.497849+0000","last_clean":"2024-09-17T05:21:55.497849+0000","last_became_active":"2024-09-17T05:21:54.499228+0000","last_became_peered":"2024-09-17T05:21:54.499228+0000","last_unstale":"2024-09-17T05:21:55.497849+0000","last_undegraded":"2024-09-17T05:21:55.497849+0000","last_fullsized":"2024-09-17T05:21:55.497849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:34:49.600804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499922+0000","last_change":"2024-09-17T05:21:53.481560+0000","last_active":"2024-09-17T05:21:55.499922+0000","last_peered":"2024-09-17T05:21:55.499922+0000","last_clean":"2024-09-17T05:21:55.499922+0000","last_became_active":"2024-09-17T05:21:53.481288+0000","last_became_peered":"2024-09-17T05:21:53.481288+0000","last_unstale":"2024-09-17T05:21:55.499922+0000","last_undegraded":"2024-09-17T05:21:55.499922+0000","last_fullsized":"2024-09-17T05:21:55.499922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:14:54.894468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.498134+0000","last_change":"2024-09-17T05:21:54.507480+0000","last_active":"2024-09-17T05:21:55.498134+0000","last_peered":"2024-09-17T05:21:55.498134+0000","last_clean":"2024-09-17T05:21:55.498134+0000","last_became_active":"2024-09-17T05:21:54.507184+0000","last_became_peered":"2024-09-17T05:21:54.507184+0000","last_unstale":"2024-09-17T05:21:55.498134+0000","last_undegraded":"2024-09-17T05:21:55.498134+0000","last_fullsized":"2024-09-17T05:21:55.498134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:40.851639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:21:52.476027+0000","last_change":"2024-09-17T05:21:52.476027+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.476027+0000","last_undegraded":"2024-09-17T05:21:52.476027+0000","last_fullsized":"2024-09-17T05:21:52.476027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.496458+0000","last_change":"2024-09-17T05:21:54.509525+0000","last_active":"2024-09-17T05:21:55.496458+0000","last_peered":"2024-09-17T05:21:55.496458+0000","last_clean":"2024-09-17T05:21:55.496458+0000","last_became_active":"2024-09-17T05:21:54.509257+0000","last_became_peered":"2024-09-17T05:21:54.509257+0000","last_unstale":"2024-09-17T05:21:55.496458+0000","last_undegraded":"2024-09-17T05:21:55.496458+0000","last_fullsized":"2024-09-17T05:21:55.496458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:34:47.447957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.495985+0000","last_change":"2024-09-17T05:21:44.086098+0000","last_active":"2024-09-17T05:21:55.495985+0000","last_peered":"2024-09-17T05:21:55.495985+0000","last_clean":"2024-09-17T05:21:55.495985+0000","last_became_active":"2024-09-17T05:21:44.083477+0000","last_became_peered":"2024-09-17T05:21:44.083477+0000","last_unstale":"2024-09-17T05:21:55.495985+0000","last_undegraded":"2024-09-17T05:21:55.495985+0000","last_fullsized":"2024-09-17T05:21:55.495985+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:42.925756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:42.925756+0000","last_clean_scrub_stamp":"2024-09-17T05:21:42.925756+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:11.410250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.497233+0000","last_change":"2024-09-17T05:21:53.490183+0000","last_active":"2024-09-17T05:21:55.497233+0000","last_peered":"2024-09-17T05:21:55.497233+0000","last_clean":"2024-09-17T05:21:55.497233+0000","last_became_active":"2024-09-17T05:21:53.489914+0000","last_became_peered":"2024-09-17T05:21:53.489914+0000","last_unstale":"2024-09-17T05:21:55.497233+0000","last_undegraded":"2024-09-17T05:21:55.497233+0000","last_fullsized":"2024-09-17T05:21:55.497233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:55:15.542710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.495899+0000","last_change":"2024-09-17T05:21:53.484333+0000","last_active":"2024-09-17T05:21:55.495899+0000","last_peered":"2024-09-17T05:21:55.495899+0000","last_clean":"2024-09-17T05:21:55.495899+0000","last_became_active":"2024-09-17T05:21:53.483640+0000","last_became_peered":"2024-09-17T05:21:53.483640+0000","last_unstale":"2024-09-17T05:21:55.495899+0000","last_undegraded":"2024-09-17T05:21:55.495899+0000","last_fullsized":"2024-09-17T05:21:55.495899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:37:47.645603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:21:52.475966+0000","last_change":"2024-09-17T05:21:52.475966+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.475966+0000","last_undegraded":"2024-09-17T05:21:52.475966+0000","last_fullsized":"2024-09-17T05:21:52.475966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499651+0000","last_change":"2024-09-17T05:21:54.497084+0000","last_active":"2024-09-17T05:21:55.499651+0000","last_peered":"2024-09-17T05:21:55.499651+0000","last_clean":"2024-09-17T05:21:55.499651+0000","last_became_active":"2024-09-17T05:21:54.495742+0000","last_became_peered":"2024-09-17T05:21:54.495742+0000","last_unstale":"2024-09-17T05:21:55.499651+0000","last_undegraded":"2024-09-17T05:21:55.499651+0000","last_fullsized":"2024-09-17T05:21:55.499651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:27:18.182327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499082+0000","last_change":"2024-09-17T05:21:53.490161+0000","last_active":"2024-09-17T05:21:55.499082+0000","last_peered":"2024-09-17T05:21:55.499082+0000","last_clean":"2024-09-17T05:21:55.499082+0000","last_became_active":"2024-09-17T05:21:53.489883+0000","last_became_peered":"2024-09-17T05:21:53.489883+0000","last_unstale":"2024-09-17T05:21:55.499082+0000","last_undegraded":"2024-09-17T05:21:55.499082+0000","last_fullsized":"2024-09-17T05:21:55.499082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:08.690514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499340+0000","last_change":"2024-09-17T05:21:54.503475+0000","last_active":"2024-09-17T05:21:55.499340+0000","last_peered":"2024-09-17T05:21:55.499340+0000","last_clean":"2024-09-17T05:21:55.499340+0000","last_became_active":"2024-09-17T05:21:54.503198+0000","last_became_peered":"2024-09-17T05:21:54.503198+0000","last_unstale":"2024-09-17T05:21:55.499340+0000","last_undegraded":"2024-09-17T05:21:55.499340+0000","last_fullsized":"2024-09-17T05:21:55.499340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:50:43.095802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499769+0000","last_change":"2024-09-17T05:21:53.484383+0000","last_active":"2024-09-17T05:21:55.499769+0000","last_peered":"2024-09-17T05:21:55.499769+0000","last_clean":"2024-09-17T05:21:55.499769+0000","last_became_active":"2024-09-17T05:21:53.484071+0000","last_became_peered":"2024-09-17T05:21:53.484071+0000","last_unstale":"2024-09-17T05:21:55.499769+0000","last_undegraded":"2024-09-17T05:21:55.499769+0000","last_fullsized":"2024-09-17T05:21:55.499769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:35:29.473422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.498541+0000","last_change":"2024-09-17T05:21:54.514953+0000","last_active":"2024-09-17T05:21:55.498541+0000","last_peered":"2024-09-17T05:21:55.498541+0000","last_clean":"2024-09-17T05:21:55.498541+0000","last_became_active":"2024-09-17T05:21:54.514665+0000","last_became_peered":"2024-09-17T05:21:54.514665+0000","last_unstale":"2024-09-17T05:21:55.498541+0000","last_undegraded":"2024-09-17T05:21:55.498541+0000","last_fullsized":"2024-09-17T05:21:55.498541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:38.013877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.497013+0000","last_change":"2024-09-17T05:21:53.489197+0000","last_active":"2024-09-17T05:21:55.497013+0000","last_peered":"2024-09-17T05:21:55.497013+0000","last_clean":"2024-09-17T05:21:55.497013+0000","last_became_active":"2024-09-17T05:21:53.484928+0000","last_became_peered":"2024-09-17T05:21:53.484928+0000","last_unstale":"2024-09-17T05:21:55.497013+0000","last_undegraded":"2024-09-17T05:21:55.497013+0000","last_fullsized":"2024-09-17T05:21:55.497013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:28.936504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499864+0000","last_change":"2024-09-17T05:21:54.497779+0000","last_active":"2024-09-17T05:21:55.499864+0000","last_peered":"2024-09-17T05:21:55.499864+0000","last_clean":"2024-09-17T05:21:55.499864+0000","last_became_active":"2024-09-17T05:21:54.497343+0000","last_became_peered":"2024-09-17T05:21:54.497343+0000","last_unstale":"2024-09-17T05:21:55.499864+0000","last_undegraded":"2024-09-17T05:21:55.499864+0000","last_fullsized":"2024-09-17T05:21:55.499864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:34:38.737329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.501521+0000","last_change":"2024-09-17T05:21:53.490515+0000","last_active":"2024-09-17T05:21:55.501521+0000","last_peered":"2024-09-17T05:21:55.501521+0000","last_clean":"2024-09-17T05:21:55.501521+0000","last_became_active":"2024-09-17T05:21:53.490173+0000","last_became_peered":"2024-09-17T05:21:53.490173+0000","last_unstale":"2024-09-17T05:21:55.501521+0000","last_undegraded":"2024-09-17T05:21:55.501521+0000","last_fullsized":"2024-09-17T05:21:55.501521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:42.132331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.502396+0000","last_change":"2024-09-17T05:21:53.494784+0000","last_active":"2024-09-17T05:21:55.502396+0000","last_peered":"2024-09-17T05:21:55.502396+0000","last_clean":"2024-09-17T05:21:55.502396+0000","last_became_active":"2024-09-17T05:21:53.494504+0000","last_became_peered":"2024-09-17T05:21:53.494504+0000","last_unstale":"2024-09-17T05:21:55.502396+0000","last_undegraded":"2024-09-17T05:21:55.502396+0000","last_fullsized":"2024-09-17T05:21:55.502396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:13:50.064294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.495902+0000","last_change":"2024-09-17T05:21:53.484810+0000","last_active":"2024-09-17T05:21:55.495902+0000","last_peered":"2024-09-17T05:21:55.495902+0000","last_clean":"2024-09-17T05:21:55.495902+0000","last_became_active":"2024-09-17T05:21:53.484016+0000","last_became_peered":"2024-09-17T05:21:53.484016+0000","last_unstale":"2024-09-17T05:21:55.495902+0000","last_undegraded":"2024-09-17T05:21:55.495902+0000","last_fullsized":"2024-09-17T05:21:55.495902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:58:35.674900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499028+0000","last_change":"2024-09-17T05:21:54.498171+0000","last_active":"2024-09-17T05:21:55.499028+0000","last_peered":"2024-09-17T05:21:55.499028+0000","last_clean":"2024-09-17T05:21:55.499028+0000","last_became_active":"2024-09-17T05:21:54.497780+0000","last_became_peered":"2024-09-17T05:21:54.497780+0000","last_unstale":"2024-09-17T05:21:55.499028+0000","last_undegraded":"2024-09-17T05:21:55.499028+0000","last_fullsized":"2024-09-17T05:21:55.499028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:53:19.454025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499780+0000","last_change":"2024-09-17T05:21:53.487419+0000","last_active":"2024-09-17T05:21:55.499780+0000","last_peered":"2024-09-17T05:21:55.499780+0000","last_clean":"2024-09-17T05:21:55.499780+0000","last_became_active":"2024-09-17T05:21:53.485874+0000","last_became_peered":"2024-09-17T05:21:53.485874+0000","last_unstale":"2024-09-17T05:21:55.499780+0000","last_undegraded":"2024-09-17T05:21:55.499780+0000","last_fullsized":"2024-09-17T05:21:55.499780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:31.652148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499720+0000","last_change":"2024-09-17T05:21:53.486091+0000","last_active":"2024-09-17T05:21:55.499720+0000","last_peered":"2024-09-17T05:21:55.499720+0000","last_clean":"2024-09-17T05:21:55.499720+0000","last_became_active":"2024-09-17T05:21:53.485314+0000","last_became_peered":"2024-09-17T05:21:53.485314+0000","last_unstale":"2024-09-17T05:21:55.499720+0000","last_undegraded":"2024-09-17T05:21:55.499720+0000","last_fullsized":"2024-09-17T05:21:55.499720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:53:42.808589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.496712+0000","last_change":"2024-09-17T05:21:53.489998+0000","last_active":"2024-09-17T05:21:55.496712+0000","last_peered":"2024-09-17T05:21:55.496712+0000","last_clean":"2024-09-17T05:21:55.496712+0000","last_became_active":"2024-09-17T05:21:53.489673+0000","last_became_peered":"2024-09-17T05:21:53.489673+0000","last_unstale":"2024-09-17T05:21:55.496712+0000","last_undegraded":"2024-09-17T05:21:55.496712+0000","last_fullsized":"2024-09-17T05:21:55.496712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:15.739862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.502066+0000","last_change":"2024-09-17T05:21:54.504813+0000","last_active":"2024-09-17T05:21:55.502066+0000","last_peered":"2024-09-17T05:21:55.502066+0000","last_clean":"2024-09-17T05:21:55.502066+0000","last_became_active":"2024-09-17T05:21:54.504086+0000","last_became_peered":"2024-09-17T05:21:54.504086+0000","last_unstale":"2024-09-17T05:21:55.502066+0000","last_undegraded":"2024-09-17T05:21:55.502066+0000","last_fullsized":"2024-09-17T05:21:55.502066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:06:40.408782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.498308+0000","last_change":"2024-09-17T05:21:54.512621+0000","last_active":"2024-09-17T05:21:55.498308+0000","last_peered":"2024-09-17T05:21:55.498308+0000","last_clean":"2024-09-17T05:21:55.498308+0000","last_became_active":"2024-09-17T05:21:54.512256+0000","last_became_peered":"2024-09-17T05:21:54.512256+0000","last_unstale":"2024-09-17T05:21:55.498308+0000","last_undegraded":"2024-09-17T05:21:55.498308+0000","last_fullsized":"2024-09-17T05:21:55.498308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:34:47.447957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.496194+0000","last_change":"2024-09-17T05:21:53.490984+0000","last_active":"2024-09-17T05:21:55.496194+0000","last_peered":"2024-09-17T05:21:55.496194+0000","last_clean":"2024-09-17T05:21:55.496194+0000","last_became_active":"2024-09-17T05:21:53.490001+0000","last_became_peered":"2024-09-17T05:21:53.490001+0000","last_unstale":"2024-09-17T05:21:55.496194+0000","last_undegraded":"2024-09-17T05:21:55.496194+0000","last_fullsized":"2024-09-17T05:21:55.496194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:08.690514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.497721+0000","last_change":"2024-09-17T05:21:54.510777+0000","last_active":"2024-09-17T05:21:55.497721+0000","last_peered":"2024-09-17T05:21:55.497721+0000","last_clean":"2024-09-17T05:21:55.497721+0000","last_became_active":"2024-09-17T05:21:54.510517+0000","last_became_peered":"2024-09-17T05:21:54.510517+0000","last_unstale":"2024-09-17T05:21:55.497721+0000","last_undegraded":"2024-09-17T05:21:55.497721+0000","last_fullsized":"2024-09-17T05:21:55.497721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:49:06.303460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.496892+0000","last_change":"2024-09-17T05:21:53.491157+0000","last_active":"2024-09-17T05:21:55.496892+0000","last_peered":"2024-09-17T05:21:55.496892+0000","last_clean":"2024-09-17T05:21:55.496892+0000","last_became_active":"2024-09-17T05:21:53.490315+0000","last_became_peered":"2024-09-17T05:21:53.490315+0000","last_unstale":"2024-09-17T05:21:55.496892+0000","last_undegraded":"2024-09-17T05:21:55.496892+0000","last_fullsized":"2024-09-17T05:21:55.496892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:58:14.211132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:21:52.473007+0000","last_change":"2024-09-17T05:21:52.473007+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.473007+0000","last_undegraded":"2024-09-17T05:21:52.473007+0000","last_fullsized":"2024-09-17T05:21:52.473007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:21:53.466708+0000","last_change":"2024-09-17T05:21:53.466708+0000","last_active":"2024-09-17T05:21:53.466708+0000","last_peered":"2024-09-17T05:21:53.466708+0000","last_clean":"2024-09-17T05:21:53.466708+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:53.466708+0000","last_undegraded":"2024-09-17T05:21:53.466708+0000","last_fullsized":"2024-09-17T05:21:53.466708+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:21:52.473390+0000","last_change":"2024-09-17T05:21:52.473390+0000","last_active":"2024-09-17T05:21:52.460729+0000","last_peered":"2024-09-17T05:21:52.460729+0000","last_clean":"2024-09-17T05:21:52.460729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:52.473390+0000","last_undegraded":"2024-09-17T05:21:52.473390+0000","last_fullsized":"2024-09-17T05:21:52.473390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":82,"acting":82,"num_store_stats":5},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1794,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21,"ondisk_log_size":21,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":159744,"data_stored":48214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":54031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":765952,"data_stored":644399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":806912,"data_stored":664331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":74993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":73471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":73507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":73541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:21:59.459 INFO:tasks.ceph.mds.b.smithi167.stderr:2024-09-17T05:21:59.458+0000 7f02f5542640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:22:02.001 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:22:02.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.114+0000 7f33f1c33640 1 -- 172.21.15.98:0/2084558846 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33ec0cdfb0 msgr2=0x7f33ec0cfc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:02.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.114+0000 7f33f1c33640 1 --2- 172.21.15.98:0/2084558846 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33ec0cdfb0 0x7f33ec0cfc40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f33e0005fd0 tx=0x7f33e002a530 comp rx=0 tx=0).stop 2024-09-17T05:22:02.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.114+0000 7f33f1c33640 1 -- 172.21.15.98:0/2084558846 shutdown_connections 2024-09-17T05:22:02.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.114+0000 7f33f1c33640 1 --2- 172.21.15.98:0/2084558846 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f33ec15b0c0 0x7f33ec15b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:02.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.114+0000 7f33f1c33640 1 --2- 172.21.15.98:0/2084558846 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33ec0cdfb0 0x7f33ec0cfc40 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:02.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.114+0000 7f33f1c33640 1 -- 172.21.15.98:0/2084558846 >> 172.21.15.98:0/2084558846 conn(0x7f33ec0b2b90 msgr2=0x7f33ec0b2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:02.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.114+0000 7f33f1c33640 1 -- 172.21.15.98:0/2084558846 shutdown_connections 2024-09-17T05:22:02.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.114+0000 7f33f1c33640 1 -- 172.21.15.98:0/2084558846 wait complete. 2024-09-17T05:22:02.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.115+0000 7f33f1c33640 1 Processor -- start 2024-09-17T05:22:02.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.115+0000 7f33f1c33640 1 -- start start 2024-09-17T05:22:02.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.116+0000 7f33f1c33640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33ec0cdfb0 0x7f33ec1f2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:02.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.116+0000 7f33f1c33640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f33ec15b0c0 0x7f33ec14deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:02.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.116+0000 7f33f1c33640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33ec15f220 0x7f33ec153700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:02.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.116+0000 7f33f1c33640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f33ec0708c0 con 0x7f33ec0cdfb0 2024-09-17T05:22:02.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.116+0000 7f33f1c33640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f33ec070740 con 0x7f33ec15f220 2024-09-17T05:22:02.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.116+0000 7f33f1c33640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f33ec070a40 con 0x7f33ec15b0c0 2024-09-17T05:22:02.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.116+0000 7f33eb7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33ec0cdfb0 0x7f33ec1f2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:02.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.116+0000 7f33eb7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33ec0cdfb0 0x7f33ec1f2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47438/0 (socket says 172.21.15.98:47438) 2024-09-17T05:22:02.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.116+0000 7f33eb7fe640 1 -- 172.21.15.98:0/3749678007 learned_addr learned my addr 172.21.15.98:0/3749678007 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:02.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.116+0000 7f33eaffd640 1 --2- 172.21.15.98:0/3749678007 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f33ec15b0c0 0x7f33ec14deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:02.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.116+0000 7f33ebfff640 1 --2- 172.21.15.98:0/3749678007 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33ec15f220 0x7f33ec153700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:02.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.116+0000 7f33eb7fe640 1 -- 172.21.15.98:0/3749678007 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f33ec15b0c0 msgr2=0x7f33ec14deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:02.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.116+0000 7f33eb7fe640 1 --2- 172.21.15.98:0/3749678007 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f33ec15b0c0 0x7f33ec14deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:02.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.116+0000 7f33eb7fe640 1 -- 172.21.15.98:0/3749678007 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33ec15f220 msgr2=0x7f33ec153700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:02.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.116+0000 7f33eb7fe640 1 --2- 172.21.15.98:0/3749678007 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33ec15f220 0x7f33ec153700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:02.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.116+0000 7f33eb7fe640 1 -- 172.21.15.98:0/3749678007 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33ec1f2c30 con 0x7f33ec0cdfb0 2024-09-17T05:22:02.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.116+0000 7f33ebfff640 1 --2- 172.21.15.98:0/3749678007 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33ec15f220 0x7f33ec153700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:22:02.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.116+0000 7f33eb7fe640 1 --2- 172.21.15.98:0/3749678007 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33ec0cdfb0 0x7f33ec1f2530 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f33dc00ba50 tx=0x7f33dc00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:02.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.117+0000 7f33d3fff640 1 -- 172.21.15.98:0/3749678007 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33dc019070 con 0x7f33ec0cdfb0 2024-09-17T05:22:02.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.117+0000 7f33d3fff640 1 -- 172.21.15.98:0/3749678007 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f33dc00cd10 con 0x7f33ec0cdfb0 2024-09-17T05:22:02.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.117+0000 7f33f1c33640 1 -- 172.21.15.98:0/3749678007 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33ec1f2f10 con 0x7f33ec0cdfb0 2024-09-17T05:22:02.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.117+0000 7f33d3fff640 1 -- 172.21.15.98:0/3749678007 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33dc0146a0 con 0x7f33ec0cdfb0 2024-09-17T05:22:02.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.117+0000 7f33f1c33640 1 -- 172.21.15.98:0/3749678007 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33ec14ed40 con 0x7f33ec0cdfb0 2024-09-17T05:22:02.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.118+0000 7f33f1c33640 1 -- 172.21.15.98:0/3749678007 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33ec070f80 con 0x7f33ec0cdfb0 2024-09-17T05:22:02.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.118+0000 7f33d3fff640 1 -- 172.21.15.98:0/3749678007 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f33dc01c070 con 0x7f33ec0cdfb0 2024-09-17T05:22:02.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.119+0000 7f33d3fff640 1 --2- 172.21.15.98:0/3749678007 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f33d8078b90 0x7f33d807b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:02.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.119+0000 7f33d3fff640 1 -- 172.21.15.98:0/3749678007 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f33dc09a900 con 0x7f33ec0cdfb0 2024-09-17T05:22:02.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.119+0000 7f33eaffd640 1 --2- 172.21.15.98:0/3749678007 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f33d8078b90 0x7f33d807b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:02.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.119+0000 7f33eaffd640 1 --2- 172.21.15.98:0/3749678007 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f33d8078b90 0x7f33d807b050 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f33e0033000 tx=0x7f33e0004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:02.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.123+0000 7f33d3fff640 1 -- 172.21.15.98:0/3749678007 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f33dc062810 con 0x7f33ec0cdfb0 2024-09-17T05:22:02.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.296+0000 7f33f1c33640 1 -- 172.21.15.98:0/3749678007 --> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f33ec15abf0 con 0x7f33d8078b90 2024-09-17T05:22:02.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.301+0000 7f33d3fff640 1 -- 172.21.15.98:0/3749678007 <== mgr.4103 v2:172.21.15.167:6800/610796449 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251924 (secure 0 0 0) 0x7f33ec15abf0 con 0x7f33d8078b90 2024-09-17T05:22:02.306 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:22:02.309 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-17T05:22:02.312 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.304+0000 7f33f1c33640 1 -- 172.21.15.98:0/3749678007 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f33d8078b90 msgr2=0x7f33d807b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:02.312 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.304+0000 7f33f1c33640 1 --2- 172.21.15.98:0/3749678007 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f33d8078b90 0x7f33d807b050 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f33e0033000 tx=0x7f33e0004730 comp rx=0 tx=0).stop 2024-09-17T05:22:02.312 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.304+0000 7f33f1c33640 1 -- 172.21.15.98:0/3749678007 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33ec0cdfb0 msgr2=0x7f33ec1f2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:02.312 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.304+0000 7f33f1c33640 1 --2- 172.21.15.98:0/3749678007 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33ec0cdfb0 0x7f33ec1f2530 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f33dc00ba50 tx=0x7f33dc00bf10 comp rx=0 tx=0).stop 2024-09-17T05:22:02.312 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.304+0000 7f33f1c33640 1 -- 172.21.15.98:0/3749678007 shutdown_connections 2024-09-17T05:22:02.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.304+0000 7f33f1c33640 1 --2- 172.21.15.98:0/3749678007 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f33d8078b90 0x7f33d807b050 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:02.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.304+0000 7f33f1c33640 1 --2- 172.21.15.98:0/3749678007 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33ec15f220 0x7f33ec153700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:02.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.304+0000 7f33f1c33640 1 --2- 172.21.15.98:0/3749678007 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f33ec15b0c0 0x7f33ec14deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:02.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.304+0000 7f33f1c33640 1 --2- 172.21.15.98:0/3749678007 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33ec0cdfb0 0x7f33ec1f2530 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:02.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.304+0000 7f33f1c33640 1 -- 172.21.15.98:0/3749678007 >> 172.21.15.98:0/3749678007 conn(0x7f33ec0b2b90 msgr2=0x7f33ec0b2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:02.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.304+0000 7f33f1c33640 1 -- 172.21.15.98:0/3749678007 shutdown_connections 2024-09-17T05:22:02.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.304+0000 7f33f1c33640 1 -- 172.21.15.98:0/3749678007 wait complete. 2024-09-17T05:22:02.315 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-17T05:22:02.249687+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219108,"kb_used_data":2856,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755612,"statfs":{"total":773094113280,"available":772869746688,"internally_reserved":0,"allocated":2924544,"data_stored":1772604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001626"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.497272+0000","last_change":"2024-09-17T05:21:54.501153+0000","last_active":"2024-09-17T05:21:55.497272+0000","last_peered":"2024-09-17T05:21:55.497272+0000","last_clean":"2024-09-17T05:21:55.497272+0000","last_became_active":"2024-09-17T05:21:54.500904+0000","last_became_peered":"2024-09-17T05:21:54.500904+0000","last_unstale":"2024-09-17T05:21:55.497272+0000","last_undegraded":"2024-09-17T05:21:55.497272+0000","last_fullsized":"2024-09-17T05:21:55.497272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:52:10.150875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499897+0000","last_change":"2024-09-17T05:21:54.494958+0000","last_active":"2024-09-17T05:21:55.499897+0000","last_peered":"2024-09-17T05:21:55.499897+0000","last_clean":"2024-09-17T05:21:55.499897+0000","last_became_active":"2024-09-17T05:21:54.494510+0000","last_became_peered":"2024-09-17T05:21:54.494510+0000","last_unstale":"2024-09-17T05:21:55.499897+0000","last_undegraded":"2024-09-17T05:21:55.499897+0000","last_fullsized":"2024-09-17T05:21:55.499897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:12:27.112041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.747693+0000","last_change":"2024-09-17T05:21:54.500430+0000","last_active":"2024-09-17T05:21:55.747693+0000","last_peered":"2024-09-17T05:21:55.747693+0000","last_clean":"2024-09-17T05:21:55.747693+0000","last_became_active":"2024-09-17T05:21:54.496869+0000","last_became_peered":"2024-09-17T05:21:54.496869+0000","last_unstale":"2024-09-17T05:21:55.747693+0000","last_undegraded":"2024-09-17T05:21:55.747693+0000","last_fullsized":"2024-09-17T05:21:55.747693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:56.018245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.497441+0000","last_change":"2024-09-17T05:21:54.508228+0000","last_active":"2024-09-17T05:21:55.497441+0000","last_peered":"2024-09-17T05:21:55.497441+0000","last_clean":"2024-09-17T05:21:55.497441+0000","last_became_active":"2024-09-17T05:21:54.507980+0000","last_became_peered":"2024-09-17T05:21:54.507980+0000","last_unstale":"2024-09-17T05:21:55.497441+0000","last_undegraded":"2024-09-17T05:21:55.497441+0000","last_fullsized":"2024-09-17T05:21:55.497441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:59:07.965886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.496599+0000","last_change":"2024-09-17T05:21:54.495253+0000","last_active":"2024-09-17T05:21:55.496599+0000","last_peered":"2024-09-17T05:21:55.496599+0000","last_clean":"2024-09-17T05:21:55.496599+0000","last_became_active":"2024-09-17T05:21:54.494929+0000","last_became_peered":"2024-09-17T05:21:54.494929+0000","last_unstale":"2024-09-17T05:21:55.496599+0000","last_undegraded":"2024-09-17T05:21:55.496599+0000","last_fullsized":"2024-09-17T05:21:55.496599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:38.013877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.498278+0000","last_change":"2024-09-17T05:21:54.509547+0000","last_active":"2024-09-17T05:21:55.498278+0000","last_peered":"2024-09-17T05:21:55.498278+0000","last_clean":"2024-09-17T05:21:55.498278+0000","last_became_active":"2024-09-17T05:21:54.509223+0000","last_became_peered":"2024-09-17T05:21:54.509223+0000","last_unstale":"2024-09-17T05:21:55.498278+0000","last_undegraded":"2024-09-17T05:21:55.498278+0000","last_fullsized":"2024-09-17T05:21:55.498278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:51.043848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.496253+0000","last_change":"2024-09-17T05:21:54.497328+0000","last_active":"2024-09-17T05:21:55.496253+0000","last_peered":"2024-09-17T05:21:55.496253+0000","last_clean":"2024-09-17T05:21:55.496253+0000","last_became_active":"2024-09-17T05:21:54.497033+0000","last_became_peered":"2024-09-17T05:21:54.497033+0000","last_unstale":"2024-09-17T05:21:55.496253+0000","last_undegraded":"2024-09-17T05:21:55.496253+0000","last_fullsized":"2024-09-17T05:21:55.496253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:35:45.144313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.748425+0000","last_change":"2024-09-17T05:21:54.512052+0000","last_active":"2024-09-17T05:21:55.748425+0000","last_peered":"2024-09-17T05:21:55.748425+0000","last_clean":"2024-09-17T05:21:55.748425+0000","last_became_active":"2024-09-17T05:21:54.509795+0000","last_became_peered":"2024-09-17T05:21:54.509795+0000","last_unstale":"2024-09-17T05:21:55.748425+0000","last_undegraded":"2024-09-17T05:21:55.748425+0000","last_fullsized":"2024-09-17T05:21:55.748425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:00.308980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.497784+0000","last_change":"2024-09-17T05:21:54.511143+0000","last_active":"2024-09-17T05:21:55.497784+0000","last_peered":"2024-09-17T05:21:55.497784+0000","last_clean":"2024-09-17T05:21:55.497784+0000","last_became_active":"2024-09-17T05:21:54.510864+0000","last_became_peered":"2024-09-17T05:21:54.510864+0000","last_unstale":"2024-09-17T05:21:55.497784+0000","last_undegraded":"2024-09-17T05:21:55.497784+0000","last_fullsized":"2024-09-17T05:21:55.497784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:22:47.632841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.502509+0000","last_change":"2024-09-17T05:21:54.512618+0000","last_active":"2024-09-17T05:21:55.502509+0000","last_peered":"2024-09-17T05:21:55.502509+0000","last_clean":"2024-09-17T05:21:55.502509+0000","last_became_active":"2024-09-17T05:21:54.512003+0000","last_became_peered":"2024-09-17T05:21:54.512003+0000","last_unstale":"2024-09-17T05:21:55.502509+0000","last_undegraded":"2024-09-17T05:21:55.502509+0000","last_fullsized":"2024-09-17T05:21:55.502509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:28:33.399315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.502291+0000","last_change":"2024-09-17T05:21:54.512890+0000","last_active":"2024-09-17T05:21:55.502291+0000","last_peered":"2024-09-17T05:21:55.502291+0000","last_clean":"2024-09-17T05:21:55.502291+0000","last_became_active":"2024-09-17T05:21:54.511924+0000","last_became_peered":"2024-09-17T05:21:54.511924+0000","last_unstale":"2024-09-17T05:21:55.502291+0000","last_undegraded":"2024-09-17T05:21:55.502291+0000","last_fullsized":"2024-09-17T05:21:55.502291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:41.750971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499252+0000","last_change":"2024-09-17T05:21:54.501003+0000","last_active":"2024-09-17T05:21:55.499252+0000","last_peered":"2024-09-17T05:21:55.499252+0000","last_clean":"2024-09-17T05:21:55.499252+0000","last_became_active":"2024-09-17T05:21:54.500716+0000","last_became_peered":"2024-09-17T05:21:54.500716+0000","last_unstale":"2024-09-17T05:21:55.499252+0000","last_undegraded":"2024-09-17T05:21:55.499252+0000","last_fullsized":"2024-09-17T05:21:55.499252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:03.364449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.749495+0000","last_change":"2024-09-17T05:21:54.507932+0000","last_active":"2024-09-17T05:21:55.749495+0000","last_peered":"2024-09-17T05:21:55.749495+0000","last_clean":"2024-09-17T05:21:55.749495+0000","last_became_active":"2024-09-17T05:21:54.507619+0000","last_became_peered":"2024-09-17T05:21:54.507619+0000","last_unstale":"2024-09-17T05:21:55.749495+0000","last_undegraded":"2024-09-17T05:21:55.749495+0000","last_fullsized":"2024-09-17T05:21:55.749495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:05:41.748842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.747964+0000","last_change":"2024-09-17T05:21:54.500967+0000","last_active":"2024-09-17T05:21:55.747964+0000","last_peered":"2024-09-17T05:21:55.747964+0000","last_clean":"2024-09-17T05:21:55.747964+0000","last_became_active":"2024-09-17T05:21:54.500667+0000","last_became_peered":"2024-09-17T05:21:54.500667+0000","last_unstale":"2024-09-17T05:21:55.747964+0000","last_undegraded":"2024-09-17T05:21:55.747964+0000","last_fullsized":"2024-09-17T05:21:55.747964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:20:13.444228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499687+0000","last_change":"2024-09-17T05:21:54.499559+0000","last_active":"2024-09-17T05:21:55.499687+0000","last_peered":"2024-09-17T05:21:55.499687+0000","last_clean":"2024-09-17T05:21:55.499687+0000","last_became_active":"2024-09-17T05:21:54.498587+0000","last_became_peered":"2024-09-17T05:21:54.498587+0000","last_unstale":"2024-09-17T05:21:55.499687+0000","last_undegraded":"2024-09-17T05:21:55.499687+0000","last_fullsized":"2024-09-17T05:21:55.499687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:18.824693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.498770+0000","last_change":"2024-09-17T05:21:54.511036+0000","last_active":"2024-09-17T05:21:55.498770+0000","last_peered":"2024-09-17T05:21:55.498770+0000","last_clean":"2024-09-17T05:21:55.498770+0000","last_became_active":"2024-09-17T05:21:54.510599+0000","last_became_peered":"2024-09-17T05:21:54.510599+0000","last_unstale":"2024-09-17T05:21:55.498770+0000","last_undegraded":"2024-09-17T05:21:55.498770+0000","last_fullsized":"2024-09-17T05:21:55.498770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:29.213187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.498235+0000","last_change":"2024-09-17T05:21:54.510133+0000","last_active":"2024-09-17T05:21:55.498235+0000","last_peered":"2024-09-17T05:21:55.498235+0000","last_clean":"2024-09-17T05:21:55.498235+0000","last_became_active":"2024-09-17T05:21:54.509861+0000","last_became_peered":"2024-09-17T05:21:54.509861+0000","last_unstale":"2024-09-17T05:21:55.498235+0000","last_undegraded":"2024-09-17T05:21:55.498235+0000","last_fullsized":"2024-09-17T05:21:55.498235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:35:45.144313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.749782+0000","last_change":"2024-09-17T05:21:54.498112+0000","last_active":"2024-09-17T05:21:55.749782+0000","last_peered":"2024-09-17T05:21:55.749782+0000","last_clean":"2024-09-17T05:21:55.749782+0000","last_became_active":"2024-09-17T05:21:54.497838+0000","last_became_peered":"2024-09-17T05:21:54.497838+0000","last_unstale":"2024-09-17T05:21:55.749782+0000","last_undegraded":"2024-09-17T05:21:55.749782+0000","last_fullsized":"2024-09-17T05:21:55.749782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:53:18.926924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.497008+0000","last_change":"2024-09-17T05:21:54.497275+0000","last_active":"2024-09-17T05:21:55.497008+0000","last_peered":"2024-09-17T05:21:55.497008+0000","last_clean":"2024-09-17T05:21:55.497008+0000","last_became_active":"2024-09-17T05:21:54.495616+0000","last_became_peered":"2024-09-17T05:21:54.495616+0000","last_unstale":"2024-09-17T05:21:55.497008+0000","last_undegraded":"2024-09-17T05:21:55.497008+0000","last_fullsized":"2024-09-17T05:21:55.497008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:29.213187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.502388+0000","last_change":"2024-09-17T05:21:54.504915+0000","last_active":"2024-09-17T05:21:55.502388+0000","last_peered":"2024-09-17T05:21:55.502388+0000","last_clean":"2024-09-17T05:21:55.502388+0000","last_became_active":"2024-09-17T05:21:54.503778+0000","last_became_peered":"2024-09-17T05:21:54.503778+0000","last_unstale":"2024-09-17T05:21:55.502388+0000","last_undegraded":"2024-09-17T05:21:55.502388+0000","last_fullsized":"2024-09-17T05:21:55.502388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:45.560083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.748111+0000","last_change":"2024-09-17T05:21:54.504130+0000","last_active":"2024-09-17T05:21:55.748111+0000","last_peered":"2024-09-17T05:21:55.748111+0000","last_clean":"2024-09-17T05:21:55.748111+0000","last_became_active":"2024-09-17T05:21:54.503843+0000","last_became_peered":"2024-09-17T05:21:54.503843+0000","last_unstale":"2024-09-17T05:21:55.748111+0000","last_undegraded":"2024-09-17T05:21:55.748111+0000","last_fullsized":"2024-09-17T05:21:55.748111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:41.750971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.498656+0000","last_change":"2024-09-17T05:21:54.509569+0000","last_active":"2024-09-17T05:21:55.498656+0000","last_peered":"2024-09-17T05:21:55.498656+0000","last_clean":"2024-09-17T05:21:55.498656+0000","last_became_active":"2024-09-17T05:21:54.508928+0000","last_became_peered":"2024-09-17T05:21:54.508928+0000","last_unstale":"2024-09-17T05:21:55.498656+0000","last_undegraded":"2024-09-17T05:21:55.498656+0000","last_fullsized":"2024-09-17T05:21:55.498656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:12:31.977218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.749141+0000","last_change":"2024-09-17T05:21:54.497160+0000","last_active":"2024-09-17T05:21:55.749141+0000","last_peered":"2024-09-17T05:21:55.749141+0000","last_clean":"2024-09-17T05:21:55.749141+0000","last_became_active":"2024-09-17T05:21:54.496885+0000","last_became_peered":"2024-09-17T05:21:54.496885+0000","last_unstale":"2024-09-17T05:21:55.749141+0000","last_undegraded":"2024-09-17T05:21:55.749141+0000","last_fullsized":"2024-09-17T05:21:55.749141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:59:59.386632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499016+0000","last_change":"2024-09-17T05:21:54.510866+0000","last_active":"2024-09-17T05:21:55.499016+0000","last_peered":"2024-09-17T05:21:55.499016+0000","last_clean":"2024-09-17T05:21:55.499016+0000","last_became_active":"2024-09-17T05:21:54.510301+0000","last_became_peered":"2024-09-17T05:21:54.510301+0000","last_unstale":"2024-09-17T05:21:55.499016+0000","last_undegraded":"2024-09-17T05:21:55.499016+0000","last_fullsized":"2024-09-17T05:21:55.499016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:52:10.150875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.748057+0000","last_change":"2024-09-17T05:21:54.501814+0000","last_active":"2024-09-17T05:21:55.748057+0000","last_peered":"2024-09-17T05:21:55.748057+0000","last_clean":"2024-09-17T05:21:55.748057+0000","last_became_active":"2024-09-17T05:21:54.501512+0000","last_became_peered":"2024-09-17T05:21:54.501512+0000","last_unstale":"2024-09-17T05:21:55.748057+0000","last_undegraded":"2024-09-17T05:21:55.748057+0000","last_fullsized":"2024-09-17T05:21:55.748057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:26.479441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.502586+0000","last_change":"2024-09-17T05:21:54.497869+0000","last_active":"2024-09-17T05:21:55.502586+0000","last_peered":"2024-09-17T05:21:55.502586+0000","last_clean":"2024-09-17T05:21:55.502586+0000","last_became_active":"2024-09-17T05:21:54.497583+0000","last_became_peered":"2024-09-17T05:21:54.497583+0000","last_unstale":"2024-09-17T05:21:55.502586+0000","last_undegraded":"2024-09-17T05:21:55.502586+0000","last_fullsized":"2024-09-17T05:21:55.502586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:42:01.373169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499859+0000","last_change":"2024-09-17T05:21:54.493860+0000","last_active":"2024-09-17T05:21:55.499859+0000","last_peered":"2024-09-17T05:21:55.499859+0000","last_clean":"2024-09-17T05:21:55.499859+0000","last_became_active":"2024-09-17T05:21:54.493554+0000","last_became_peered":"2024-09-17T05:21:54.493554+0000","last_unstale":"2024-09-17T05:21:55.499859+0000","last_undegraded":"2024-09-17T05:21:55.499859+0000","last_fullsized":"2024-09-17T05:21:55.499859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:30:58.548877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.748653+0000","last_change":"2024-09-17T05:21:54.498320+0000","last_active":"2024-09-17T05:21:55.748653+0000","last_peered":"2024-09-17T05:21:55.748653+0000","last_clean":"2024-09-17T05:21:55.748653+0000","last_became_active":"2024-09-17T05:21:54.498002+0000","last_became_peered":"2024-09-17T05:21:54.498002+0000","last_unstale":"2024-09-17T05:21:55.748653+0000","last_undegraded":"2024-09-17T05:21:55.748653+0000","last_fullsized":"2024-09-17T05:21:55.748653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:56:30.051932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.748189+0000","last_change":"2024-09-17T05:21:54.500883+0000","last_active":"2024-09-17T05:21:55.748189+0000","last_peered":"2024-09-17T05:21:55.748189+0000","last_clean":"2024-09-17T05:21:55.748189+0000","last_became_active":"2024-09-17T05:21:54.500587+0000","last_became_peered":"2024-09-17T05:21:54.500587+0000","last_unstale":"2024-09-17T05:21:55.748189+0000","last_undegraded":"2024-09-17T05:21:55.748189+0000","last_fullsized":"2024-09-17T05:21:55.748189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:45.560083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.498946+0000","last_change":"2024-09-17T05:21:54.508790+0000","last_active":"2024-09-17T05:21:55.498946+0000","last_peered":"2024-09-17T05:21:55.498946+0000","last_clean":"2024-09-17T05:21:55.498946+0000","last_became_active":"2024-09-17T05:21:54.508431+0000","last_became_peered":"2024-09-17T05:21:54.508431+0000","last_unstale":"2024-09-17T05:21:55.498946+0000","last_undegraded":"2024-09-17T05:21:55.498946+0000","last_fullsized":"2024-09-17T05:21:55.498946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:26:25.545759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.748213+0000","last_change":"2024-09-17T05:21:54.506270+0000","last_active":"2024-09-17T05:21:55.748213+0000","last_peered":"2024-09-17T05:21:55.748213+0000","last_clean":"2024-09-17T05:21:55.748213+0000","last_became_active":"2024-09-17T05:21:54.505940+0000","last_became_peered":"2024-09-17T05:21:54.505940+0000","last_unstale":"2024-09-17T05:21:55.748213+0000","last_undegraded":"2024-09-17T05:21:55.748213+0000","last_fullsized":"2024-09-17T05:21:55.748213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:50:43.095802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.502048+0000","last_change":"2024-09-17T05:21:54.505209+0000","last_active":"2024-09-17T05:21:55.502048+0000","last_peered":"2024-09-17T05:21:55.502048+0000","last_clean":"2024-09-17T05:21:55.502048+0000","last_became_active":"2024-09-17T05:21:54.504601+0000","last_became_peered":"2024-09-17T05:21:54.504601+0000","last_unstale":"2024-09-17T05:21:55.502048+0000","last_undegraded":"2024-09-17T05:21:55.502048+0000","last_fullsized":"2024-09-17T05:21:55.502048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:32.727377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.498911+0000","last_change":"2024-09-17T05:21:54.495748+0000","last_active":"2024-09-17T05:21:55.498911+0000","last_peered":"2024-09-17T05:21:55.498911+0000","last_clean":"2024-09-17T05:21:55.498911+0000","last_became_active":"2024-09-17T05:21:54.494696+0000","last_became_peered":"2024-09-17T05:21:54.494696+0000","last_unstale":"2024-09-17T05:21:55.498911+0000","last_undegraded":"2024-09-17T05:21:55.498911+0000","last_fullsized":"2024-09-17T05:21:55.498911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:02.422828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.749565+0000","last_change":"2024-09-17T05:21:53.484897+0000","last_active":"2024-09-17T05:21:55.749565+0000","last_peered":"2024-09-17T05:21:55.749565+0000","last_clean":"2024-09-17T05:21:55.749565+0000","last_became_active":"2024-09-17T05:21:53.484370+0000","last_became_peered":"2024-09-17T05:21:53.484370+0000","last_unstale":"2024-09-17T05:21:55.749565+0000","last_undegraded":"2024-09-17T05:21:55.749565+0000","last_fullsized":"2024-09-17T05:21:55.749565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:26:33.902720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.748296+0000","last_change":"2024-09-17T05:21:54.502294+0000","last_active":"2024-09-17T05:21:55.748296+0000","last_peered":"2024-09-17T05:21:55.748296+0000","last_clean":"2024-09-17T05:21:55.748296+0000","last_became_active":"2024-09-17T05:21:54.501214+0000","last_became_peered":"2024-09-17T05:21:54.501214+0000","last_unstale":"2024-09-17T05:21:55.748296+0000","last_undegraded":"2024-09-17T05:21:55.748296+0000","last_fullsized":"2024-09-17T05:21:55.748296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:42:01.373169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.502078+0000","last_change":"2024-09-17T05:21:53.493253+0000","last_active":"2024-09-17T05:21:55.502078+0000","last_peered":"2024-09-17T05:21:55.502078+0000","last_clean":"2024-09-17T05:21:55.502078+0000","last_became_active":"2024-09-17T05:21:53.492943+0000","last_became_peered":"2024-09-17T05:21:53.492943+0000","last_unstale":"2024-09-17T05:21:55.502078+0000","last_undegraded":"2024-09-17T05:21:55.502078+0000","last_fullsized":"2024-09-17T05:21:55.502078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:53:55.808093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.749171+0000","last_change":"2024-09-17T05:21:53.491206+0000","last_active":"2024-09-17T05:21:55.749171+0000","last_peered":"2024-09-17T05:21:55.749171+0000","last_clean":"2024-09-17T05:21:55.749171+0000","last_became_active":"2024-09-17T05:21:53.490940+0000","last_became_peered":"2024-09-17T05:21:53.490940+0000","last_unstale":"2024-09-17T05:21:55.749171+0000","last_undegraded":"2024-09-17T05:21:55.749171+0000","last_fullsized":"2024-09-17T05:21:55.749171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:39.425517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.748603+0000","last_change":"2024-09-17T05:21:54.504258+0000","last_active":"2024-09-17T05:21:55.748603+0000","last_peered":"2024-09-17T05:21:55.748603+0000","last_clean":"2024-09-17T05:21:55.748603+0000","last_became_active":"2024-09-17T05:21:54.503974+0000","last_became_peered":"2024-09-17T05:21:54.503974+0000","last_unstale":"2024-09-17T05:21:55.748603+0000","last_undegraded":"2024-09-17T05:21:55.748603+0000","last_fullsized":"2024-09-17T05:21:55.748603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:10.923504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499004+0000","last_change":"2024-09-17T05:21:53.489575+0000","last_active":"2024-09-17T05:21:55.499004+0000","last_peered":"2024-09-17T05:21:55.499004+0000","last_clean":"2024-09-17T05:21:55.499004+0000","last_became_active":"2024-09-17T05:21:53.489294+0000","last_became_peered":"2024-09-17T05:21:53.489294+0000","last_unstale":"2024-09-17T05:21:55.499004+0000","last_undegraded":"2024-09-17T05:21:55.499004+0000","last_fullsized":"2024-09-17T05:21:55.499004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:28.463818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499674+0000","last_change":"2024-09-17T05:21:54.494216+0000","last_active":"2024-09-17T05:21:55.499674+0000","last_peered":"2024-09-17T05:21:55.499674+0000","last_clean":"2024-09-17T05:21:55.499674+0000","last_became_active":"2024-09-17T05:21:54.492853+0000","last_became_peered":"2024-09-17T05:21:54.492853+0000","last_unstale":"2024-09-17T05:21:55.499674+0000","last_undegraded":"2024-09-17T05:21:55.499674+0000","last_fullsized":"2024-09-17T05:21:55.499674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:01:15.655368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.502262+0000","last_change":"2024-09-17T05:21:53.494796+0000","last_active":"2024-09-17T05:21:55.502262+0000","last_peered":"2024-09-17T05:21:55.502262+0000","last_clean":"2024-09-17T05:21:55.502262+0000","last_became_active":"2024-09-17T05:21:53.494486+0000","last_became_peered":"2024-09-17T05:21:53.494486+0000","last_unstale":"2024-09-17T05:21:55.502262+0000","last_undegraded":"2024-09-17T05:21:55.502262+0000","last_fullsized":"2024-09-17T05:21:55.502262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:59.914761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.497597+0000","last_change":"2024-09-17T05:21:54.509807+0000","last_active":"2024-09-17T05:21:55.497597+0000","last_peered":"2024-09-17T05:21:55.497597+0000","last_clean":"2024-09-17T05:21:55.497597+0000","last_became_active":"2024-09-17T05:21:54.509245+0000","last_became_peered":"2024-09-17T05:21:54.509245+0000","last_unstale":"2024-09-17T05:21:55.497597+0000","last_undegraded":"2024-09-17T05:21:55.497597+0000","last_fullsized":"2024-09-17T05:21:55.497597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:38:26.480830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.497949+0000","last_change":"2024-09-17T05:21:53.491049+0000","last_active":"2024-09-17T05:21:55.497949+0000","last_peered":"2024-09-17T05:21:55.497949+0000","last_clean":"2024-09-17T05:21:55.497949+0000","last_became_active":"2024-09-17T05:21:53.490795+0000","last_became_peered":"2024-09-17T05:21:53.490795+0000","last_unstale":"2024-09-17T05:21:55.497949+0000","last_undegraded":"2024-09-17T05:21:55.497949+0000","last_fullsized":"2024-09-17T05:21:55.497949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:03:21.023914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.748065+0000","last_change":"2024-09-17T05:21:54.512151+0000","last_active":"2024-09-17T05:21:55.748065+0000","last_peered":"2024-09-17T05:21:55.748065+0000","last_clean":"2024-09-17T05:21:55.748065+0000","last_became_active":"2024-09-17T05:21:54.511204+0000","last_became_peered":"2024-09-17T05:21:54.511204+0000","last_unstale":"2024-09-17T05:21:55.748065+0000","last_undegraded":"2024-09-17T05:21:55.748065+0000","last_fullsized":"2024-09-17T05:21:55.748065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:06:40.408782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499832+0000","last_change":"2024-09-17T05:21:53.493370+0000","last_active":"2024-09-17T05:21:55.499832+0000","last_peered":"2024-09-17T05:21:55.499832+0000","last_clean":"2024-09-17T05:21:55.499832+0000","last_became_active":"2024-09-17T05:21:53.493010+0000","last_became_peered":"2024-09-17T05:21:53.493010+0000","last_unstale":"2024-09-17T05:21:55.499832+0000","last_undegraded":"2024-09-17T05:21:55.499832+0000","last_fullsized":"2024-09-17T05:21:55.499832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:21.689266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499435+0000","last_change":"2024-09-17T05:21:54.499432+0000","last_active":"2024-09-17T05:21:55.499435+0000","last_peered":"2024-09-17T05:21:55.499435+0000","last_clean":"2024-09-17T05:21:55.499435+0000","last_became_active":"2024-09-17T05:21:54.499133+0000","last_became_peered":"2024-09-17T05:21:54.499133+0000","last_unstale":"2024-09-17T05:21:55.499435+0000","last_undegraded":"2024-09-17T05:21:55.499435+0000","last_fullsized":"2024-09-17T05:21:55.499435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:53:18.926924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.502291+0000","last_change":"2024-09-17T05:21:53.491745+0000","last_active":"2024-09-17T05:21:55.502291+0000","last_peered":"2024-09-17T05:21:55.502291+0000","last_clean":"2024-09-17T05:21:55.502291+0000","last_became_active":"2024-09-17T05:21:53.491464+0000","last_became_peered":"2024-09-17T05:21:53.491464+0000","last_unstale":"2024-09-17T05:21:55.502291+0000","last_undegraded":"2024-09-17T05:21:55.502291+0000","last_fullsized":"2024-09-17T05:21:55.502291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:03:27.097328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.496199+0000","last_change":"2024-09-17T05:21:54.493190+0000","last_active":"2024-09-17T05:21:55.496199+0000","last_peered":"2024-09-17T05:21:55.496199+0000","last_clean":"2024-09-17T05:21:55.496199+0000","last_became_active":"2024-09-17T05:21:54.492889+0000","last_became_peered":"2024-09-17T05:21:54.492889+0000","last_unstale":"2024-09-17T05:21:55.496199+0000","last_undegraded":"2024-09-17T05:21:55.496199+0000","last_fullsized":"2024-09-17T05:21:55.496199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:40.851639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.748250+0000","last_change":"2024-09-17T05:21:53.487462+0000","last_active":"2024-09-17T05:21:55.748250+0000","last_peered":"2024-09-17T05:21:55.748250+0000","last_clean":"2024-09-17T05:21:55.748250+0000","last_became_active":"2024-09-17T05:21:53.487189+0000","last_became_peered":"2024-09-17T05:21:53.487189+0000","last_unstale":"2024-09-17T05:21:55.748250+0000","last_undegraded":"2024-09-17T05:21:55.748250+0000","last_fullsized":"2024-09-17T05:21:55.748250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:37:20.042353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.748230+0000","last_change":"2024-09-17T05:21:54.500759+0000","last_active":"2024-09-17T05:21:55.748230+0000","last_peered":"2024-09-17T05:21:55.748230+0000","last_clean":"2024-09-17T05:21:55.748230+0000","last_became_active":"2024-09-17T05:21:54.500480+0000","last_became_peered":"2024-09-17T05:21:54.500480+0000","last_unstale":"2024-09-17T05:21:55.748230+0000","last_undegraded":"2024-09-17T05:21:55.748230+0000","last_fullsized":"2024-09-17T05:21:55.748230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:28:33.399315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499013+0000","last_change":"2024-09-17T05:21:53.489506+0000","last_active":"2024-09-17T05:21:55.499013+0000","last_peered":"2024-09-17T05:21:55.499013+0000","last_clean":"2024-09-17T05:21:55.499013+0000","last_became_active":"2024-09-17T05:21:53.488663+0000","last_became_peered":"2024-09-17T05:21:53.488663+0000","last_unstale":"2024-09-17T05:21:55.499013+0000","last_undegraded":"2024-09-17T05:21:55.499013+0000","last_fullsized":"2024-09-17T05:21:55.499013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:58:35.674900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.496782+0000","last_change":"2024-09-17T05:21:54.495318+0000","last_active":"2024-09-17T05:21:55.496782+0000","last_peered":"2024-09-17T05:21:55.496782+0000","last_clean":"2024-09-17T05:21:55.496782+0000","last_became_active":"2024-09-17T05:21:54.495022+0000","last_became_peered":"2024-09-17T05:21:54.495022+0000","last_unstale":"2024-09-17T05:21:55.496782+0000","last_undegraded":"2024-09-17T05:21:55.496782+0000","last_fullsized":"2024-09-17T05:21:55.496782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:12:31.977218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.501937+0000","last_change":"2024-09-17T05:21:53.493137+0000","last_active":"2024-09-17T05:21:55.501937+0000","last_peered":"2024-09-17T05:21:55.501937+0000","last_clean":"2024-09-17T05:21:55.501937+0000","last_became_active":"2024-09-17T05:21:53.492861+0000","last_became_peered":"2024-09-17T05:21:53.492861+0000","last_unstale":"2024-09-17T05:21:55.501937+0000","last_undegraded":"2024-09-17T05:21:55.501937+0000","last_fullsized":"2024-09-17T05:21:55.501937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:26:33.902720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.502039+0000","last_change":"2024-09-17T05:21:54.504481+0000","last_active":"2024-09-17T05:21:55.502039+0000","last_peered":"2024-09-17T05:21:55.502039+0000","last_clean":"2024-09-17T05:21:55.502039+0000","last_became_active":"2024-09-17T05:21:54.504110+0000","last_became_peered":"2024-09-17T05:21:54.504110+0000","last_unstale":"2024-09-17T05:21:55.502039+0000","last_undegraded":"2024-09-17T05:21:55.502039+0000","last_fullsized":"2024-09-17T05:21:55.502039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:06.884350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.748146+0000","last_change":"2024-09-17T05:21:53.487613+0000","last_active":"2024-09-17T05:21:55.748146+0000","last_peered":"2024-09-17T05:21:55.748146+0000","last_clean":"2024-09-17T05:21:55.748146+0000","last_became_active":"2024-09-17T05:21:53.487341+0000","last_became_peered":"2024-09-17T05:21:53.487341+0000","last_unstale":"2024-09-17T05:21:55.748146+0000","last_undegraded":"2024-09-17T05:21:55.748146+0000","last_fullsized":"2024-09-17T05:21:55.748146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:26:33.902720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.496294+0000","last_change":"2024-09-17T05:21:54.500288+0000","last_active":"2024-09-17T05:21:55.496294+0000","last_peered":"2024-09-17T05:21:55.496294+0000","last_clean":"2024-09-17T05:21:55.496294+0000","last_became_active":"2024-09-17T05:21:54.499508+0000","last_became_peered":"2024-09-17T05:21:54.499508+0000","last_unstale":"2024-09-17T05:21:55.496294+0000","last_undegraded":"2024-09-17T05:21:55.496294+0000","last_fullsized":"2024-09-17T05:21:55.496294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:51.043848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499138+0000","last_change":"2024-09-17T05:21:53.486134+0000","last_active":"2024-09-17T05:21:55.499138+0000","last_peered":"2024-09-17T05:21:55.499138+0000","last_clean":"2024-09-17T05:21:55.499138+0000","last_became_active":"2024-09-17T05:21:53.485804+0000","last_became_peered":"2024-09-17T05:21:53.485804+0000","last_unstale":"2024-09-17T05:21:55.499138+0000","last_undegraded":"2024-09-17T05:21:55.499138+0000","last_fullsized":"2024-09-17T05:21:55.499138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:34:05.720343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.497407+0000","last_change":"2024-09-17T05:21:54.499818+0000","last_active":"2024-09-17T05:21:55.497407+0000","last_peered":"2024-09-17T05:21:55.497407+0000","last_clean":"2024-09-17T05:21:55.497407+0000","last_became_active":"2024-09-17T05:21:54.499298+0000","last_became_peered":"2024-09-17T05:21:54.499298+0000","last_unstale":"2024-09-17T05:21:55.497407+0000","last_undegraded":"2024-09-17T05:21:55.497407+0000","last_fullsized":"2024-09-17T05:21:55.497407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:26:25.545759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.749690+0000","last_change":"2024-09-17T05:21:53.487000+0000","last_active":"2024-09-17T05:21:55.749690+0000","last_peered":"2024-09-17T05:21:55.749690+0000","last_clean":"2024-09-17T05:21:55.749690+0000","last_became_active":"2024-09-17T05:21:53.486705+0000","last_became_peered":"2024-09-17T05:21:53.486705+0000","last_unstale":"2024-09-17T05:21:55.749690+0000","last_undegraded":"2024-09-17T05:21:55.749690+0000","last_fullsized":"2024-09-17T05:21:55.749690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:53:55.808093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.497849+0000","last_change":"2024-09-17T05:21:54.499532+0000","last_active":"2024-09-17T05:21:55.497849+0000","last_peered":"2024-09-17T05:21:55.497849+0000","last_clean":"2024-09-17T05:21:55.497849+0000","last_became_active":"2024-09-17T05:21:54.499228+0000","last_became_peered":"2024-09-17T05:21:54.499228+0000","last_unstale":"2024-09-17T05:21:55.497849+0000","last_undegraded":"2024-09-17T05:21:55.497849+0000","last_fullsized":"2024-09-17T05:21:55.497849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:34:49.600804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499922+0000","last_change":"2024-09-17T05:21:53.481560+0000","last_active":"2024-09-17T05:21:55.499922+0000","last_peered":"2024-09-17T05:21:55.499922+0000","last_clean":"2024-09-17T05:21:55.499922+0000","last_became_active":"2024-09-17T05:21:53.481288+0000","last_became_peered":"2024-09-17T05:21:53.481288+0000","last_unstale":"2024-09-17T05:21:55.499922+0000","last_undegraded":"2024-09-17T05:21:55.499922+0000","last_fullsized":"2024-09-17T05:21:55.499922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:14:54.894468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.498134+0000","last_change":"2024-09-17T05:21:54.507480+0000","last_active":"2024-09-17T05:21:55.498134+0000","last_peered":"2024-09-17T05:21:55.498134+0000","last_clean":"2024-09-17T05:21:55.498134+0000","last_became_active":"2024-09-17T05:21:54.507184+0000","last_became_peered":"2024-09-17T05:21:54.507184+0000","last_unstale":"2024-09-17T05:21:55.498134+0000","last_undegraded":"2024-09-17T05:21:55.498134+0000","last_fullsized":"2024-09-17T05:21:55.498134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:40.851639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.749572+0000","last_change":"2024-09-17T05:21:53.493592+0000","last_active":"2024-09-17T05:21:55.749572+0000","last_peered":"2024-09-17T05:21:55.749572+0000","last_clean":"2024-09-17T05:21:55.749572+0000","last_became_active":"2024-09-17T05:21:53.492958+0000","last_became_peered":"2024-09-17T05:21:53.492958+0000","last_unstale":"2024-09-17T05:21:55.749572+0000","last_undegraded":"2024-09-17T05:21:55.749572+0000","last_fullsized":"2024-09-17T05:21:55.749572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:25.985141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.496458+0000","last_change":"2024-09-17T05:21:54.509525+0000","last_active":"2024-09-17T05:21:55.496458+0000","last_peered":"2024-09-17T05:21:55.496458+0000","last_clean":"2024-09-17T05:21:55.496458+0000","last_became_active":"2024-09-17T05:21:54.509257+0000","last_became_peered":"2024-09-17T05:21:54.509257+0000","last_unstale":"2024-09-17T05:21:55.496458+0000","last_undegraded":"2024-09-17T05:21:55.496458+0000","last_fullsized":"2024-09-17T05:21:55.496458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:34:47.447957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.495985+0000","last_change":"2024-09-17T05:21:44.086098+0000","last_active":"2024-09-17T05:21:55.495985+0000","last_peered":"2024-09-17T05:21:55.495985+0000","last_clean":"2024-09-17T05:21:55.495985+0000","last_became_active":"2024-09-17T05:21:44.083477+0000","last_became_peered":"2024-09-17T05:21:44.083477+0000","last_unstale":"2024-09-17T05:21:55.495985+0000","last_undegraded":"2024-09-17T05:21:55.495985+0000","last_fullsized":"2024-09-17T05:21:55.495985+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:42.925756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:42.925756+0000","last_clean_scrub_stamp":"2024-09-17T05:21:42.925756+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:11.410250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.497233+0000","last_change":"2024-09-17T05:21:53.490183+0000","last_active":"2024-09-17T05:21:55.497233+0000","last_peered":"2024-09-17T05:21:55.497233+0000","last_clean":"2024-09-17T05:21:55.497233+0000","last_became_active":"2024-09-17T05:21:53.489914+0000","last_became_peered":"2024-09-17T05:21:53.489914+0000","last_unstale":"2024-09-17T05:21:55.497233+0000","last_undegraded":"2024-09-17T05:21:55.497233+0000","last_fullsized":"2024-09-17T05:21:55.497233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:55:15.542710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.749341+0000","last_change":"2024-09-17T05:21:54.510457+0000","last_active":"2024-09-17T05:21:55.749341+0000","last_peered":"2024-09-17T05:21:55.749341+0000","last_clean":"2024-09-17T05:21:55.749341+0000","last_became_active":"2024-09-17T05:21:54.510191+0000","last_became_peered":"2024-09-17T05:21:54.510191+0000","last_unstale":"2024-09-17T05:21:55.749341+0000","last_undegraded":"2024-09-17T05:21:55.749341+0000","last_fullsized":"2024-09-17T05:21:55.749341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:54:11.270930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.495899+0000","last_change":"2024-09-17T05:21:53.484333+0000","last_active":"2024-09-17T05:21:55.495899+0000","last_peered":"2024-09-17T05:21:55.495899+0000","last_clean":"2024-09-17T05:21:55.495899+0000","last_became_active":"2024-09-17T05:21:53.483640+0000","last_became_peered":"2024-09-17T05:21:53.483640+0000","last_unstale":"2024-09-17T05:21:55.495899+0000","last_undegraded":"2024-09-17T05:21:55.495899+0000","last_fullsized":"2024-09-17T05:21:55.495899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:37:47.645603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.747762+0000","last_change":"2024-09-17T05:21:54.501913+0000","last_active":"2024-09-17T05:21:55.747762+0000","last_peered":"2024-09-17T05:21:55.747762+0000","last_clean":"2024-09-17T05:21:55.747762+0000","last_became_active":"2024-09-17T05:21:54.501513+0000","last_became_peered":"2024-09-17T05:21:54.501513+0000","last_unstale":"2024-09-17T05:21:55.747762+0000","last_undegraded":"2024-09-17T05:21:55.747762+0000","last_fullsized":"2024-09-17T05:21:55.747762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:41.511545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.748269+0000","last_change":"2024-09-17T05:21:53.487710+0000","last_active":"2024-09-17T05:21:55.748269+0000","last_peered":"2024-09-17T05:21:55.748269+0000","last_clean":"2024-09-17T05:21:55.748269+0000","last_became_active":"2024-09-17T05:21:53.487436+0000","last_became_peered":"2024-09-17T05:21:53.487436+0000","last_unstale":"2024-09-17T05:21:55.748269+0000","last_undegraded":"2024-09-17T05:21:55.748269+0000","last_fullsized":"2024-09-17T05:21:55.748269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:03:27.097328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499651+0000","last_change":"2024-09-17T05:21:54.497084+0000","last_active":"2024-09-17T05:21:55.499651+0000","last_peered":"2024-09-17T05:21:55.499651+0000","last_clean":"2024-09-17T05:21:55.499651+0000","last_became_active":"2024-09-17T05:21:54.495742+0000","last_became_peered":"2024-09-17T05:21:54.495742+0000","last_unstale":"2024-09-17T05:21:55.499651+0000","last_undegraded":"2024-09-17T05:21:55.499651+0000","last_fullsized":"2024-09-17T05:21:55.499651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:27:18.182327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499082+0000","last_change":"2024-09-17T05:21:53.490161+0000","last_active":"2024-09-17T05:21:55.499082+0000","last_peered":"2024-09-17T05:21:55.499082+0000","last_clean":"2024-09-17T05:21:55.499082+0000","last_became_active":"2024-09-17T05:21:53.489883+0000","last_became_peered":"2024-09-17T05:21:53.489883+0000","last_unstale":"2024-09-17T05:21:55.499082+0000","last_undegraded":"2024-09-17T05:21:55.499082+0000","last_fullsized":"2024-09-17T05:21:55.499082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:08.690514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499340+0000","last_change":"2024-09-17T05:21:54.503475+0000","last_active":"2024-09-17T05:21:55.499340+0000","last_peered":"2024-09-17T05:21:55.499340+0000","last_clean":"2024-09-17T05:21:55.499340+0000","last_became_active":"2024-09-17T05:21:54.503198+0000","last_became_peered":"2024-09-17T05:21:54.503198+0000","last_unstale":"2024-09-17T05:21:55.499340+0000","last_undegraded":"2024-09-17T05:21:55.499340+0000","last_fullsized":"2024-09-17T05:21:55.499340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:50:43.095802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499769+0000","last_change":"2024-09-17T05:21:53.484383+0000","last_active":"2024-09-17T05:21:55.499769+0000","last_peered":"2024-09-17T05:21:55.499769+0000","last_clean":"2024-09-17T05:21:55.499769+0000","last_became_active":"2024-09-17T05:21:53.484071+0000","last_became_peered":"2024-09-17T05:21:53.484071+0000","last_unstale":"2024-09-17T05:21:55.499769+0000","last_undegraded":"2024-09-17T05:21:55.499769+0000","last_fullsized":"2024-09-17T05:21:55.499769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:35:29.473422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.498541+0000","last_change":"2024-09-17T05:21:54.514953+0000","last_active":"2024-09-17T05:21:55.498541+0000","last_peered":"2024-09-17T05:21:55.498541+0000","last_clean":"2024-09-17T05:21:55.498541+0000","last_became_active":"2024-09-17T05:21:54.514665+0000","last_became_peered":"2024-09-17T05:21:54.514665+0000","last_unstale":"2024-09-17T05:21:55.498541+0000","last_undegraded":"2024-09-17T05:21:55.498541+0000","last_fullsized":"2024-09-17T05:21:55.498541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:38.013877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.497013+0000","last_change":"2024-09-17T05:21:53.489197+0000","last_active":"2024-09-17T05:21:55.497013+0000","last_peered":"2024-09-17T05:21:55.497013+0000","last_clean":"2024-09-17T05:21:55.497013+0000","last_became_active":"2024-09-17T05:21:53.484928+0000","last_became_peered":"2024-09-17T05:21:53.484928+0000","last_unstale":"2024-09-17T05:21:55.497013+0000","last_undegraded":"2024-09-17T05:21:55.497013+0000","last_fullsized":"2024-09-17T05:21:55.497013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:28.936504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499864+0000","last_change":"2024-09-17T05:21:54.497779+0000","last_active":"2024-09-17T05:21:55.499864+0000","last_peered":"2024-09-17T05:21:55.499864+0000","last_clean":"2024-09-17T05:21:55.499864+0000","last_became_active":"2024-09-17T05:21:54.497343+0000","last_became_peered":"2024-09-17T05:21:54.497343+0000","last_unstale":"2024-09-17T05:21:55.499864+0000","last_undegraded":"2024-09-17T05:21:55.499864+0000","last_fullsized":"2024-09-17T05:21:55.499864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:34:38.737329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.501521+0000","last_change":"2024-09-17T05:21:53.490515+0000","last_active":"2024-09-17T05:21:55.501521+0000","last_peered":"2024-09-17T05:21:55.501521+0000","last_clean":"2024-09-17T05:21:55.501521+0000","last_became_active":"2024-09-17T05:21:53.490173+0000","last_became_peered":"2024-09-17T05:21:53.490173+0000","last_unstale":"2024-09-17T05:21:55.501521+0000","last_undegraded":"2024-09-17T05:21:55.501521+0000","last_fullsized":"2024-09-17T05:21:55.501521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:42.132331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.748234+0000","last_change":"2024-09-17T05:21:54.494254+0000","last_active":"2024-09-17T05:21:55.748234+0000","last_peered":"2024-09-17T05:21:55.748234+0000","last_clean":"2024-09-17T05:21:55.748234+0000","last_became_active":"2024-09-17T05:21:54.493968+0000","last_became_peered":"2024-09-17T05:21:54.493968+0000","last_unstale":"2024-09-17T05:21:55.748234+0000","last_undegraded":"2024-09-17T05:21:55.748234+0000","last_fullsized":"2024-09-17T05:21:55.748234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:06.884350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.502396+0000","last_change":"2024-09-17T05:21:53.494784+0000","last_active":"2024-09-17T05:21:55.502396+0000","last_peered":"2024-09-17T05:21:55.502396+0000","last_clean":"2024-09-17T05:21:55.502396+0000","last_became_active":"2024-09-17T05:21:53.494504+0000","last_became_peered":"2024-09-17T05:21:53.494504+0000","last_unstale":"2024-09-17T05:21:55.502396+0000","last_undegraded":"2024-09-17T05:21:55.502396+0000","last_fullsized":"2024-09-17T05:21:55.502396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:13:50.064294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.747891+0000","last_change":"2024-09-17T05:21:54.493842+0000","last_active":"2024-09-17T05:21:55.747891+0000","last_peered":"2024-09-17T05:21:55.747891+0000","last_clean":"2024-09-17T05:21:55.747891+0000","last_became_active":"2024-09-17T05:21:54.493586+0000","last_became_peered":"2024-09-17T05:21:54.493586+0000","last_unstale":"2024-09-17T05:21:55.747891+0000","last_undegraded":"2024-09-17T05:21:55.747891+0000","last_fullsized":"2024-09-17T05:21:55.747891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:14:39.618479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.495902+0000","last_change":"2024-09-17T05:21:53.484810+0000","last_active":"2024-09-17T05:21:55.495902+0000","last_peered":"2024-09-17T05:21:55.495902+0000","last_clean":"2024-09-17T05:21:55.495902+0000","last_became_active":"2024-09-17T05:21:53.484016+0000","last_became_peered":"2024-09-17T05:21:53.484016+0000","last_unstale":"2024-09-17T05:21:55.495902+0000","last_undegraded":"2024-09-17T05:21:55.495902+0000","last_fullsized":"2024-09-17T05:21:55.495902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:58:35.674900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499028+0000","last_change":"2024-09-17T05:21:54.498171+0000","last_active":"2024-09-17T05:21:55.499028+0000","last_peered":"2024-09-17T05:21:55.499028+0000","last_clean":"2024-09-17T05:21:55.499028+0000","last_became_active":"2024-09-17T05:21:54.497780+0000","last_became_peered":"2024-09-17T05:21:54.497780+0000","last_unstale":"2024-09-17T05:21:55.499028+0000","last_undegraded":"2024-09-17T05:21:55.499028+0000","last_fullsized":"2024-09-17T05:21:55.499028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:53:19.454025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499780+0000","last_change":"2024-09-17T05:21:53.487419+0000","last_active":"2024-09-17T05:21:55.499780+0000","last_peered":"2024-09-17T05:21:55.499780+0000","last_clean":"2024-09-17T05:21:55.499780+0000","last_became_active":"2024-09-17T05:21:53.485874+0000","last_became_peered":"2024-09-17T05:21:53.485874+0000","last_unstale":"2024-09-17T05:21:55.499780+0000","last_undegraded":"2024-09-17T05:21:55.499780+0000","last_fullsized":"2024-09-17T05:21:55.499780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:31.652148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.748779+0000","last_change":"2024-09-17T05:21:54.500587+0000","last_active":"2024-09-17T05:21:55.748779+0000","last_peered":"2024-09-17T05:21:55.748779+0000","last_clean":"2024-09-17T05:21:55.748779+0000","last_became_active":"2024-09-17T05:21:54.500333+0000","last_became_peered":"2024-09-17T05:21:54.500333+0000","last_unstale":"2024-09-17T05:21:55.748779+0000","last_undegraded":"2024-09-17T05:21:55.748779+0000","last_fullsized":"2024-09-17T05:21:55.748779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:53.919157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499720+0000","last_change":"2024-09-17T05:21:53.486091+0000","last_active":"2024-09-17T05:21:55.499720+0000","last_peered":"2024-09-17T05:21:55.499720+0000","last_clean":"2024-09-17T05:21:55.499720+0000","last_became_active":"2024-09-17T05:21:53.485314+0000","last_became_peered":"2024-09-17T05:21:53.485314+0000","last_unstale":"2024-09-17T05:21:55.499720+0000","last_undegraded":"2024-09-17T05:21:55.499720+0000","last_fullsized":"2024-09-17T05:21:55.499720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:53:42.808589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.749674+0000","last_change":"2024-09-17T05:21:54.503373+0000","last_active":"2024-09-17T05:21:55.749674+0000","last_peered":"2024-09-17T05:21:55.749674+0000","last_clean":"2024-09-17T05:21:55.749674+0000","last_became_active":"2024-09-17T05:21:54.503073+0000","last_became_peered":"2024-09-17T05:21:54.503073+0000","last_unstale":"2024-09-17T05:21:55.749674+0000","last_undegraded":"2024-09-17T05:21:55.749674+0000","last_fullsized":"2024-09-17T05:21:55.749674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:28.960088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.496712+0000","last_change":"2024-09-17T05:21:53.489998+0000","last_active":"2024-09-17T05:21:55.496712+0000","last_peered":"2024-09-17T05:21:55.496712+0000","last_clean":"2024-09-17T05:21:55.496712+0000","last_became_active":"2024-09-17T05:21:53.489673+0000","last_became_peered":"2024-09-17T05:21:53.489673+0000","last_unstale":"2024-09-17T05:21:55.496712+0000","last_undegraded":"2024-09-17T05:21:55.496712+0000","last_fullsized":"2024-09-17T05:21:55.496712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:15.739862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.502066+0000","last_change":"2024-09-17T05:21:54.504813+0000","last_active":"2024-09-17T05:21:55.502066+0000","last_peered":"2024-09-17T05:21:55.502066+0000","last_clean":"2024-09-17T05:21:55.502066+0000","last_became_active":"2024-09-17T05:21:54.504086+0000","last_became_peered":"2024-09-17T05:21:54.504086+0000","last_unstale":"2024-09-17T05:21:55.502066+0000","last_undegraded":"2024-09-17T05:21:55.502066+0000","last_fullsized":"2024-09-17T05:21:55.502066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:06:40.408782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.498308+0000","last_change":"2024-09-17T05:21:54.512621+0000","last_active":"2024-09-17T05:21:55.498308+0000","last_peered":"2024-09-17T05:21:55.498308+0000","last_clean":"2024-09-17T05:21:55.498308+0000","last_became_active":"2024-09-17T05:21:54.512256+0000","last_became_peered":"2024-09-17T05:21:54.512256+0000","last_unstale":"2024-09-17T05:21:55.498308+0000","last_undegraded":"2024-09-17T05:21:55.498308+0000","last_fullsized":"2024-09-17T05:21:55.498308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:34:47.447957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.496194+0000","last_change":"2024-09-17T05:21:53.490984+0000","last_active":"2024-09-17T05:21:55.496194+0000","last_peered":"2024-09-17T05:21:55.496194+0000","last_clean":"2024-09-17T05:21:55.496194+0000","last_became_active":"2024-09-17T05:21:53.490001+0000","last_became_peered":"2024-09-17T05:21:53.490001+0000","last_unstale":"2024-09-17T05:21:55.496194+0000","last_undegraded":"2024-09-17T05:21:55.496194+0000","last_fullsized":"2024-09-17T05:21:55.496194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:08.690514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.497721+0000","last_change":"2024-09-17T05:21:54.510777+0000","last_active":"2024-09-17T05:21:55.497721+0000","last_peered":"2024-09-17T05:21:55.497721+0000","last_clean":"2024-09-17T05:21:55.497721+0000","last_became_active":"2024-09-17T05:21:54.510517+0000","last_became_peered":"2024-09-17T05:21:54.510517+0000","last_unstale":"2024-09-17T05:21:55.497721+0000","last_undegraded":"2024-09-17T05:21:55.497721+0000","last_fullsized":"2024-09-17T05:21:55.497721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:49:06.303460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.496892+0000","last_change":"2024-09-17T05:21:53.491157+0000","last_active":"2024-09-17T05:21:55.496892+0000","last_peered":"2024-09-17T05:21:55.496892+0000","last_clean":"2024-09-17T05:21:55.496892+0000","last_became_active":"2024-09-17T05:21:53.490315+0000","last_became_peered":"2024-09-17T05:21:53.490315+0000","last_unstale":"2024-09-17T05:21:55.496892+0000","last_undegraded":"2024-09-17T05:21:55.496892+0000","last_fullsized":"2024-09-17T05:21:55.496892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:58:14.211132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.747944+0000","last_change":"2024-09-17T05:21:54.512428+0000","last_active":"2024-09-17T05:21:55.747944+0000","last_peered":"2024-09-17T05:21:55.747944+0000","last_clean":"2024-09-17T05:21:55.747944+0000","last_became_active":"2024-09-17T05:21:54.511546+0000","last_became_peered":"2024-09-17T05:21:54.511546+0000","last_unstale":"2024-09-17T05:21:55.747944+0000","last_undegraded":"2024-09-17T05:21:55.747944+0000","last_fullsized":"2024-09-17T05:21:55.747944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:32.727377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.749095+0000","last_change":"2024-09-17T05:21:53.483928+0000","last_active":"2024-09-17T05:21:55.749095+0000","last_peered":"2024-09-17T05:21:55.749095+0000","last_clean":"2024-09-17T05:21:55.749095+0000","last_became_active":"2024-09-17T05:21:53.483478+0000","last_became_peered":"2024-09-17T05:21:53.483478+0000","last_unstale":"2024-09-17T05:21:55.749095+0000","last_undegraded":"2024-09-17T05:21:55.749095+0000","last_fullsized":"2024-09-17T05:21:55.749095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:25.985141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.749036+0000","last_change":"2024-09-17T05:21:54.499626+0000","last_active":"2024-09-17T05:21:55.749036+0000","last_peered":"2024-09-17T05:21:55.749036+0000","last_clean":"2024-09-17T05:21:55.749036+0000","last_became_active":"2024-09-17T05:21:54.499321+0000","last_became_peered":"2024-09-17T05:21:54.499321+0000","last_unstale":"2024-09-17T05:21:55.749036+0000","last_undegraded":"2024-09-17T05:21:55.749036+0000","last_fullsized":"2024-09-17T05:21:55.749036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:44:54.516203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.748008+0000","last_change":"2024-09-17T05:21:53.486585+0000","last_active":"2024-09-17T05:21:55.748008+0000","last_peered":"2024-09-17T05:21:55.748008+0000","last_clean":"2024-09-17T05:21:55.748008+0000","last_became_active":"2024-09-17T05:21:53.486306+0000","last_became_peered":"2024-09-17T05:21:53.486306+0000","last_unstale":"2024-09-17T05:21:55.748008+0000","last_undegraded":"2024-09-17T05:21:55.748008+0000","last_fullsized":"2024-09-17T05:21:55.748008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:19.726620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":74993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":73381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":815104,"data_stored":664387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":806912,"data_stored":664331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":74993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":73471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":73507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":73541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:22:02.320 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T05:22:02.321 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-17T05:22:02.322 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-17T05:22:02.458 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.456+0000 7f04b1871640 1 -- 172.21.15.98:0/1601655204 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f04ac15e0d0 msgr2=0x7f04ac0d09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:02.458 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.456+0000 7f04b1871640 1 --2- 172.21.15.98:0/1601655204 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f04ac15e0d0 0x7f04ac0d09c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f049c009830 tx=0x7f049c02a510 comp rx=0 tx=0).stop 2024-09-17T05:22:02.458 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.456+0000 7f04b1871640 1 -- 172.21.15.98:0/1601655204 shutdown_connections 2024-09-17T05:22:02.458 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.456+0000 7f04b1871640 1 --2- 172.21.15.98:0/1601655204 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f04ac0d2050 0x7f04ac0d0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:02.458 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.456+0000 7f04b1871640 1 --2- 172.21.15.98:0/1601655204 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f04ac15e0d0 0x7f04ac0d09c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:02.459 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.456+0000 7f04b1871640 1 -- 172.21.15.98:0/1601655204 >> 172.21.15.98:0/1601655204 conn(0x7f04ac0d3fe0 msgr2=0x7f04ac0d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:02.459 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.456+0000 7f04b1871640 1 -- 172.21.15.98:0/1601655204 shutdown_connections 2024-09-17T05:22:02.459 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.456+0000 7f04b1871640 1 -- 172.21.15.98:0/1601655204 wait complete. 2024-09-17T05:22:02.459 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.457+0000 7f04b1871640 1 Processor -- start 2024-09-17T05:22:02.459 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.457+0000 7f04b1871640 1 -- start start 2024-09-17T05:22:02.463 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.458+0000 7f04b1871640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04ac0d1440 0x7f04ac15c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:02.463 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.458+0000 7f04b1871640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f04ac0d2050 0x7f04ac0c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:02.463 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.458+0000 7f04b1871640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f04ac15e0d0 0x7f04ac0cd030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:02.463 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.458+0000 7f04b1871640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f04ac15ebc0 con 0x7f04ac15e0d0 2024-09-17T05:22:02.463 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.458+0000 7f04b1871640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f04ac0cfee0 con 0x7f04ac0d1440 2024-09-17T05:22:02.463 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.458+0000 7f04b1871640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f04ac15ed40 con 0x7f04ac0d2050 2024-09-17T05:22:02.463 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.458+0000 7f04ab7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f04ac15e0d0 0x7f04ac0cd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:02.463 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.458+0000 7f04ab7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f04ac15e0d0 0x7f04ac0cd030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47464/0 (socket says 172.21.15.98:47464) 2024-09-17T05:22:02.463 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.458+0000 7f04ab7fe640 1 -- 172.21.15.98:0/326660468 learned_addr learned my addr 172.21.15.98:0/326660468 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:02.463 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.458+0000 7f04aa7fc640 1 --2- 172.21.15.98:0/326660468 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f04ac0d2050 0x7f04ac0c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:02.464 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.458+0000 7f04aaffd640 1 --2- 172.21.15.98:0/326660468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04ac0d1440 0x7f04ac15c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:02.464 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.458+0000 7f04ab7fe640 1 -- 172.21.15.98:0/326660468 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f04ac0d2050 msgr2=0x7f04ac0c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:02.464 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.458+0000 7f04ab7fe640 1 --2- 172.21.15.98:0/326660468 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f04ac0d2050 0x7f04ac0c9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:02.464 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.458+0000 7f04ab7fe640 1 -- 172.21.15.98:0/326660468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04ac0d1440 msgr2=0x7f04ac15c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:02.464 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.458+0000 7f04ab7fe640 1 --2- 172.21.15.98:0/326660468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04ac0d1440 0x7f04ac15c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:02.464 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.458+0000 7f04ab7fe640 1 -- 172.21.15.98:0/326660468 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04ac0ca520 con 0x7f04ac15e0d0 2024-09-17T05:22:02.464 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.458+0000 7f04ab7fe640 1 --2- 172.21.15.98:0/326660468 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f04ac15e0d0 0x7f04ac0cd030 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f04a400c770 tx=0x7f04a400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:02.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.459+0000 7f04a3fff640 1 -- 172.21.15.98:0/326660468 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a4003da0 con 0x7f04ac15e0d0 2024-09-17T05:22:02.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.459+0000 7f04a3fff640 1 -- 172.21.15.98:0/326660468 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f04a400ce20 con 0x7f04ac15e0d0 2024-09-17T05:22:02.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.459+0000 7f04b1871640 1 -- 172.21.15.98:0/326660468 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04ac0c99a0 con 0x7f04ac15e0d0 2024-09-17T05:22:02.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.459+0000 7f04a3fff640 1 -- 172.21.15.98:0/326660468 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a4005290 con 0x7f04ac15e0d0 2024-09-17T05:22:02.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.459+0000 7f04b1871640 1 -- 172.21.15.98:0/326660468 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04ac09f320 con 0x7f04ac15e0d0 2024-09-17T05:22:02.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.460+0000 7f04b1871640 1 -- 172.21.15.98:0/326660468 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04ac15fa20 con 0x7f04ac15e0d0 2024-09-17T05:22:02.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.460+0000 7f04a3fff640 1 -- 172.21.15.98:0/326660468 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f04a4005430 con 0x7f04ac15e0d0 2024-09-17T05:22:02.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.461+0000 7f04a3fff640 1 --2- 172.21.15.98:0/326660468 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f048c078b90 0x7f048c07b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:02.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.461+0000 7f04a3fff640 1 -- 172.21.15.98:0/326660468 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f04a409aa40 con 0x7f04ac15e0d0 2024-09-17T05:22:02.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.461+0000 7f04aaffd640 1 --2- 172.21.15.98:0/326660468 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f048c078b90 0x7f048c07b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:02.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.462+0000 7f04aaffd640 1 --2- 172.21.15.98:0/326660468 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f048c078b90 0x7f048c07b050 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f049c034000 tx=0x7f049c004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:02.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.465+0000 7f04a3fff640 1 -- 172.21.15.98:0/326660468 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f04a4062f10 con 0x7f04ac15e0d0 2024-09-17T05:22:02.647 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.645+0000 7f04b1871640 1 -- 172.21.15.98:0/326660468 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f04ac09f100 con 0x7f04ac15e0d0 2024-09-17T05:22:02.647 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.646+0000 7f04a3fff640 1 -- 172.21.15.98:0/326660468 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v27) ==== 86+0+160 (secure 0 0 0) 0x7f04a409ae20 con 0x7f04ac15e0d0 2024-09-17T05:22:02.648 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:22:02.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.648+0000 7f04b1871640 1 -- 172.21.15.98:0/326660468 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f048c078b90 msgr2=0x7f048c07b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:02.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.648+0000 7f04b1871640 1 --2- 172.21.15.98:0/326660468 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f048c078b90 0x7f048c07b050 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f049c034000 tx=0x7f049c004730 comp rx=0 tx=0).stop 2024-09-17T05:22:02.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.648+0000 7f04b1871640 1 -- 172.21.15.98:0/326660468 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f04ac15e0d0 msgr2=0x7f04ac0cd030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:02.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.648+0000 7f04b1871640 1 --2- 172.21.15.98:0/326660468 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f04ac15e0d0 0x7f04ac0cd030 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f04a400c770 tx=0x7f04a400cc30 comp rx=0 tx=0).stop 2024-09-17T05:22:02.650 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.648+0000 7f04b1871640 1 -- 172.21.15.98:0/326660468 shutdown_connections 2024-09-17T05:22:02.650 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.648+0000 7f04b1871640 1 --2- 172.21.15.98:0/326660468 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f048c078b90 0x7f048c07b050 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:02.650 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.648+0000 7f04b1871640 1 --2- 172.21.15.98:0/326660468 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f04ac15e0d0 0x7f04ac0cd030 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:02.650 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.648+0000 7f04b1871640 1 --2- 172.21.15.98:0/326660468 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f04ac0d2050 0x7f04ac0c9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:02.650 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.648+0000 7f04b1871640 1 --2- 172.21.15.98:0/326660468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04ac0d1440 0x7f04ac15c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:02.650 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.648+0000 7f04b1871640 1 -- 172.21.15.98:0/326660468 >> 172.21.15.98:0/326660468 conn(0x7f04ac0d3fe0 msgr2=0x7f04ac0d43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:02.650 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.648+0000 7f04b1871640 1 -- 172.21.15.98:0/326660468 shutdown_connections 2024-09-17T05:22:02.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.648+0000 7f04b1871640 1 -- 172.21.15.98:0/326660468 wait complete. 2024-09-17T05:22:02.659 INFO:teuthology.orchestra.run.smithi098.stdout:[{"version":27,"timestamp":"2024-09-17T05:21:41.942610+0000","name":"","changes":[{"name":"osd.0/osd_mclock_max_capacity_iops_ssd","new_value":"5490.314032"}]}] 2024-09-17T05:22:02.660 INFO:tasks.ceph_manager:config epoch is 27 2024-09-17T05:22:02.660 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-17T05:22:02.660 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-17T05:22:02.660 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-17T05:22:02.761 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.760+0000 7fb901fa1640 1 -- 172.21.15.98:0/2665326133 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8e4005230 msgr2=0x7fb8e400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:02.761 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.760+0000 7fb901fa1640 1 --2- 172.21.15.98:0/2665326133 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8e4005230 0x7fb8e400b9c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb8f400c640 tx=0x7fb8e4005830 comp rx=0 tx=0).stop 2024-09-17T05:22:02.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.760+0000 7fb901fa1640 1 -- 172.21.15.98:0/2665326133 shutdown_connections 2024-09-17T05:22:02.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.760+0000 7fb901fa1640 1 --2- 172.21.15.98:0/2665326133 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8e4005230 0x7fb8e400b9c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:02.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.760+0000 7fb901fa1640 1 -- 172.21.15.98:0/2665326133 >> 172.21.15.98:0/2665326133 conn(0x7fb8fc0d3de0 msgr2=0x7fb8fc0d41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:02.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.760+0000 7fb901fa1640 1 -- 172.21.15.98:0/2665326133 shutdown_connections 2024-09-17T05:22:02.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.760+0000 7fb901fa1640 1 -- 172.21.15.98:0/2665326133 wait complete. 2024-09-17T05:22:02.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.761+0000 7fb901fa1640 1 Processor -- start 2024-09-17T05:22:02.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.761+0000 7fb901fa1640 1 -- start start 2024-09-17T05:22:02.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.762+0000 7fb901fa1640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8e4005230 0x7fb8fc151f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:02.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.762+0000 7fb901fa1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8fc0cccd0 0x7fb8fc1f8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:02.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.762+0000 7fb901fa1640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8fc0b58b0 0x7fb8fc0b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:02.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.762+0000 7fb901fa1640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb8fc162020 con 0x7fb8e4005230 2024-09-17T05:22:02.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.762+0000 7fb901fa1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb8fc0d2500 con 0x7fb8fc0cccd0 2024-09-17T05:22:02.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.762+0000 7fb901fa1640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fb8fc1621a0 con 0x7fb8fc0b58b0 2024-09-17T05:22:02.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.762+0000 7fb900f9f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8e4005230 0x7fb8fc151f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:02.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.762+0000 7fb900f9f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8e4005230 0x7fb8fc151f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47482/0 (socket says 172.21.15.98:47482) 2024-09-17T05:22:02.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.763+0000 7fb900f9f640 1 -- 172.21.15.98:0/2557802773 learned_addr learned my addr 172.21.15.98:0/2557802773 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:02.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.763+0000 7fb9017a0640 1 --2- 172.21.15.98:0/2557802773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8fc0b58b0 0x7fb8fc0b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:02.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.763+0000 7fb8fbfff640 1 --2- 172.21.15.98:0/2557802773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8fc0cccd0 0x7fb8fc1f8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:02.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.763+0000 7fb900f9f640 1 -- 172.21.15.98:0/2557802773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8fc0b58b0 msgr2=0x7fb8fc0b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:02.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.763+0000 7fb900f9f640 1 --2- 172.21.15.98:0/2557802773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8fc0b58b0 0x7fb8fc0b5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:02.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.763+0000 7fb900f9f640 1 -- 172.21.15.98:0/2557802773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8fc0cccd0 msgr2=0x7fb8fc1f8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:02.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.763+0000 7fb900f9f640 1 --2- 172.21.15.98:0/2557802773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8fc0cccd0 0x7fb8fc1f8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:02.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.763+0000 7fb900f9f640 1 -- 172.21.15.98:0/2557802773 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8fc0cd240 con 0x7fb8e4005230 2024-09-17T05:22:02.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.763+0000 7fb9017a0640 1 --2- 172.21.15.98:0/2557802773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8fc0b58b0 0x7fb8fc0b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:22:02.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.763+0000 7fb900f9f640 1 --2- 172.21.15.98:0/2557802773 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8e4005230 0x7fb8fc151f10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec011ab0 tx=0x7fb8ec011f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:02.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.763+0000 7fb8f97fa640 1 -- 172.21.15.98:0/2557802773 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec01e070 con 0x7fb8e4005230 2024-09-17T05:22:02.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.763+0000 7fb8f97fa640 1 -- 172.21.15.98:0/2557802773 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb8ec00fe70 con 0x7fb8e4005230 2024-09-17T05:22:02.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.763+0000 7fb901fa1640 1 -- 172.21.15.98:0/2557802773 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8fc0cd520 con 0x7fb8e4005230 2024-09-17T05:22:02.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.763+0000 7fb8f97fa640 1 -- 172.21.15.98:0/2557802773 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec0042b0 con 0x7fb8e4005230 2024-09-17T05:22:02.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.763+0000 7fb901fa1640 1 -- 172.21.15.98:0/2557802773 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8fc0cdae0 con 0x7fb8e4005230 2024-09-17T05:22:02.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.764+0000 7fb901fa1640 1 -- 172.21.15.98:0/2557802773 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8fc162700 con 0x7fb8e4005230 2024-09-17T05:22:02.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.765+0000 7fb8f97fa640 1 -- 172.21.15.98:0/2557802773 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb8ec021070 con 0x7fb8e4005230 2024-09-17T05:22:02.769 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.765+0000 7fb8f97fa640 1 --2- 172.21.15.98:0/2557802773 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fb8e8078b90 0x7fb8e807b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:02.769 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.765+0000 7fb8f97fa640 1 -- 172.21.15.98:0/2557802773 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb8ec09b710 con 0x7fb8e4005230 2024-09-17T05:22:02.769 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.765+0000 7fb8fbfff640 1 --2- 172.21.15.98:0/2557802773 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fb8e8078b90 0x7fb8e807b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:02.769 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.766+0000 7fb8fbfff640 1 --2- 172.21.15.98:0/2557802773 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fb8e8078b90 0x7fb8e807b050 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc0c72f0 tx=0x7fb8f0006b10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:02.770 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.769+0000 7fb8f97fa640 1 -- 172.21.15.98:0/2557802773 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fb8ec063510 con 0x7fb8e4005230 2024-09-17T05:22:02.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.990+0000 7fb901fa1640 1 -- 172.21.15.98:0/2557802773 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fb8fc0b6230 con 0x7fb8e4005230 2024-09-17T05:22:02.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.993+0000 7fb8f97fa640 1 -- 172.21.15.98:0/2557802773 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+194719 (secure 0 0 0) 0x7fb8ec067f40 con 0x7fb8e4005230 2024-09-17T05:22:02.997 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:22:02.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.996+0000 7fb901fa1640 1 -- 172.21.15.98:0/2557802773 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fb8e8078b90 msgr2=0x7fb8e807b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:02.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.996+0000 7fb901fa1640 1 --2- 172.21.15.98:0/2557802773 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fb8e8078b90 0x7fb8e807b050 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc0c72f0 tx=0x7fb8f0006b10 comp rx=0 tx=0).stop 2024-09-17T05:22:02.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.996+0000 7fb901fa1640 1 -- 172.21.15.98:0/2557802773 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8e4005230 msgr2=0x7fb8fc151f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:02.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.996+0000 7fb901fa1640 1 --2- 172.21.15.98:0/2557802773 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8e4005230 0x7fb8fc151f10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec011ab0 tx=0x7fb8ec011f70 comp rx=0 tx=0).stop 2024-09-17T05:22:03.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.996+0000 7fb901fa1640 1 -- 172.21.15.98:0/2557802773 shutdown_connections 2024-09-17T05:22:03.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.996+0000 7fb901fa1640 1 --2- 172.21.15.98:0/2557802773 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fb8e8078b90 0x7fb8e807b050 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.996+0000 7fb901fa1640 1 --2- 172.21.15.98:0/2557802773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8fc0b58b0 0x7fb8fc0b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.996+0000 7fb901fa1640 1 --2- 172.21.15.98:0/2557802773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8fc0cccd0 0x7fb8fc1f8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.996+0000 7fb901fa1640 1 --2- 172.21.15.98:0/2557802773 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8e4005230 0x7fb8fc151f10 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.996+0000 7fb901fa1640 1 -- 172.21.15.98:0/2557802773 >> 172.21.15.98:0/2557802773 conn(0x7fb8fc0d3de0 msgr2=0x7fb8fc15ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:03.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.996+0000 7fb901fa1640 1 -- 172.21.15.98:0/2557802773 shutdown_connections 2024-09-17T05:22:03.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:02.996+0000 7fb901fa1640 1 -- 172.21.15.98:0/2557802773 wait complete. 2024-09-17T05:22:03.007 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":5,"flags":0,"active_gid":4103,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":610796449},{"type":"v1","addr":"172.21.15.167:6801","nonce":610796449}]},"active_addr":"172.21.15.167:6801/610796449","active_change":"2024-09-17T05:21:34.240980+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4112,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.167:0","nonce":2086901431}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.167:0","nonce":3518990224}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.167:0","nonce":4069849884}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.167:0","nonce":1941511249}]}]} 2024-09-17T05:22:03.011 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-17T05:22:03.011 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-17T05:22:03.012 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:22:03.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.112+0000 7fede199b640 1 -- 172.21.15.98:0/348311386 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feddc15e0d0 msgr2=0x7feddc0d09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.112+0000 7fede199b640 1 --2- 172.21.15.98:0/348311386 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feddc15e0d0 0x7feddc0d09c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7feddc0ba010 tx=0x7fedcc02aa30 comp rx=0 tx=0).stop 2024-09-17T05:22:03.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.112+0000 7fede199b640 1 -- 172.21.15.98:0/348311386 shutdown_connections 2024-09-17T05:22:03.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.112+0000 7fede199b640 1 --2- 172.21.15.98:0/348311386 >> v2:172.21.15.167:3300/0 conn(0x7feddc0d1440 0x7feddc15e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.112+0000 7fede199b640 1 --2- 172.21.15.98:0/348311386 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feddc0d2050 0x7feddc0d0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.112+0000 7fede199b640 1 --2- 172.21.15.98:0/348311386 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feddc15e0d0 0x7feddc0d09c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.112+0000 7fede199b640 1 -- 172.21.15.98:0/348311386 >> 172.21.15.98:0/348311386 conn(0x7feddc0d3fe0 msgr2=0x7feddc0d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:03.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.112+0000 7fede199b640 1 -- 172.21.15.98:0/348311386 shutdown_connections 2024-09-17T05:22:03.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.112+0000 7fede199b640 1 -- 172.21.15.98:0/348311386 wait complete. 2024-09-17T05:22:03.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.113+0000 7fede199b640 1 Processor -- start 2024-09-17T05:22:03.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.113+0000 7fede199b640 1 -- start start 2024-09-17T05:22:03.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.114+0000 7fede199b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feddc0d1440 0x7feddc0cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:03.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.114+0000 7fede199b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feddc0d2050 0x7feddc0cced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:03.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.114+0000 7fede199b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feddc15e0d0 0x7feddc1f7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:03.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.114+0000 7fede199b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7feddc15ed80 con 0x7feddc15e0d0 2024-09-17T05:22:03.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.114+0000 7fede199b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7feddc15ec00 con 0x7feddc0d1440 2024-09-17T05:22:03.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.114+0000 7fede199b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7feddc15ef00 con 0x7feddc0d2050 2024-09-17T05:22:03.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.114+0000 7feddb7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feddc15e0d0 0x7feddc1f7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:03.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.114+0000 7feddb7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feddc15e0d0 0x7feddc1f7e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47490/0 (socket says 172.21.15.98:47490) 2024-09-17T05:22:03.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.114+0000 7feddb7fe640 1 -- 172.21.15.98:0/3288909744 learned_addr learned my addr 172.21.15.98:0/3288909744 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:03.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.114+0000 7feddaffd640 1 --2- 172.21.15.98:0/3288909744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feddc0d1440 0x7feddc0cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:03.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.114+0000 7fedda7fc640 1 --2- 172.21.15.98:0/3288909744 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feddc0d2050 0x7feddc0cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:03.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.114+0000 7feddb7fe640 1 -- 172.21.15.98:0/3288909744 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feddc0d2050 msgr2=0x7feddc0cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.114+0000 7feddb7fe640 1 --2- 172.21.15.98:0/3288909744 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feddc0d2050 0x7feddc0cced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.114+0000 7feddb7fe640 1 -- 172.21.15.98:0/3288909744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feddc0d1440 msgr2=0x7feddc0cb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.114+0000 7feddb7fe640 1 --2- 172.21.15.98:0/3288909744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feddc0d1440 0x7feddc0cb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.114+0000 7feddb7fe640 1 -- 172.21.15.98:0/3288909744 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feddc0b7f60 con 0x7feddc15e0d0 2024-09-17T05:22:03.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.114+0000 7feddb7fe640 1 --2- 172.21.15.98:0/3288909744 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feddc15e0d0 0x7feddc1f7e10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fedd400d650 tx=0x7fedd400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:03.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.114+0000 7fedc3fff640 1 -- 172.21.15.98:0/3288909744 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd4017070 con 0x7feddc15e0d0 2024-09-17T05:22:03.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.114+0000 7fedc3fff640 1 -- 172.21.15.98:0/3288909744 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fedd4005330 con 0x7feddc15e0d0 2024-09-17T05:22:03.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.114+0000 7fede199b640 1 -- 172.21.15.98:0/3288909744 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feddc0cd850 con 0x7feddc15e0d0 2024-09-17T05:22:03.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.114+0000 7fedc3fff640 1 -- 172.21.15.98:0/3288909744 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd4009820 con 0x7feddc15e0d0 2024-09-17T05:22:03.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.115+0000 7fede199b640 1 -- 172.21.15.98:0/3288909744 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feddc0cde10 con 0x7feddc15e0d0 2024-09-17T05:22:03.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.115+0000 7fede199b640 1 -- 172.21.15.98:0/3288909744 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feddc15fb90 con 0x7feddc15e0d0 2024-09-17T05:22:03.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.116+0000 7fedc3fff640 1 -- 172.21.15.98:0/3288909744 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fedd40099c0 con 0x7feddc15e0d0 2024-09-17T05:22:03.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.116+0000 7fedc3fff640 1 --2- 172.21.15.98:0/3288909744 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fedc8078b90 0x7fedc807b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:03.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.117+0000 7fedc3fff640 1 -- 172.21.15.98:0/3288909744 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fedd409ac50 con 0x7feddc15e0d0 2024-09-17T05:22:03.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.117+0000 7feddaffd640 1 --2- 172.21.15.98:0/3288909744 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fedc8078b90 0x7fedc807b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:03.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.117+0000 7feddaffd640 1 --2- 172.21.15.98:0/3288909744 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fedc8078b90 0x7fedc807b050 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fedcc035000 tx=0x7fedcc03b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:03.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.121+0000 7fedc3fff640 1 -- 172.21.15.98:0/3288909744 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fedd40a0020 con 0x7feddc15e0d0 2024-09-17T05:22:03.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.296+0000 7fede199b640 1 -- 172.21.15.98:0/3288909744 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feddc0b6370 con 0x7feddc15e0d0 2024-09-17T05:22:03.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.297+0000 7fedc3fff640 1 -- 172.21.15.98:0/3288909744 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16653 (secure 0 0 0) 0x7fedd4062b60 con 0x7feddc15e0d0 2024-09-17T05:22:03.298 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:22:03.298 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":21,"fsid":"fcbf5a43-b3d8-497c-b15d-3cc022477cf0","created":"2024-09-17T05:21:29.852143+0000","modified":"2024-09-17T05:21:55.491401+0000","last_up_change":"2024-09-17T05:21:42.925756+0000","last_in_change":"2024-09-17T05:21:32.893880+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:21:42.263011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:21:51.665719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T05:21:52.780673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ad711a-df74-438b-b0dc-1499d685c958","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6825","nonce":3644101529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6827","nonce":3644101529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6831","nonce":3644101529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6829","nonce":3644101529}]},"public_addr":"172.21.15.98:6825/3644101529","cluster_addr":"172.21.15.98:6827/3644101529","heartbeat_back_addr":"172.21.15.98:6831/3644101529","heartbeat_front_addr":"172.21.15.98:6829/3644101529","state":["exists","up"]},{"osd":1,"uuid":"f0ccb08d-4d8d-47b8-9320-8c372a6605b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6817","nonce":3902180920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6819","nonce":3902180920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6823","nonce":3902180920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6821","nonce":3902180920}]},"public_addr":"172.21.15.98:6817/3902180920","cluster_addr":"172.21.15.98:6819/3902180920","heartbeat_back_addr":"172.21.15.98:6823/3902180920","heartbeat_front_addr":"172.21.15.98:6821/3902180920","state":["exists","up"]},{"osd":2,"uuid":"a0985398-5e5f-494f-8abf-f785f19e94ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6801","nonce":1518887101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6803","nonce":1518887101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6807","nonce":1518887101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6805","nonce":1518887101}]},"public_addr":"172.21.15.98:6801/1518887101","cluster_addr":"172.21.15.98:6803/1518887101","heartbeat_back_addr":"172.21.15.98:6807/1518887101","heartbeat_front_addr":"172.21.15.98:6805/1518887101","state":["exists","up"]},{"osd":3,"uuid":"e960be2e-0c3a-426e-9507-d3be5895f9e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6809","nonce":4125246091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6811","nonce":4125246091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6815","nonce":4125246091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6813","nonce":4125246091}]},"public_addr":"172.21.15.98:6809/4125246091","cluster_addr":"172.21.15.98:6811/4125246091","heartbeat_back_addr":"172.21.15.98:6815/4125246091","heartbeat_front_addr":"172.21.15.98:6813/4125246091","state":["exists","up"]},{"osd":4,"uuid":"49118c00-3dc1-43ef-8ed4-aca61e56a507","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6811","nonce":765789888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6813","nonce":765789888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6817","nonce":765789888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6815","nonce":765789888}]},"public_addr":"172.21.15.167:6811/765789888","cluster_addr":"172.21.15.167:6813/765789888","heartbeat_back_addr":"172.21.15.167:6817/765789888","heartbeat_front_addr":"172.21.15.167:6815/765789888","state":["exists","up"]},{"osd":5,"uuid":"9f4e0143-2b3d-40e4-bfb5-043d9a9f4ba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6803","nonce":2567019914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6805","nonce":2567019914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6809","nonce":2567019914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6807","nonce":2567019914}]},"public_addr":"172.21.15.167:6803/2567019914","cluster_addr":"172.21.15.167:6805/2567019914","heartbeat_back_addr":"172.21.15.167:6809/2567019914","heartbeat_front_addr":"172.21.15.167:6807/2567019914","state":["exists","up"]},{"osd":6,"uuid":"28720514-e627-4dea-8f4d-bd311ec31361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6819","nonce":96262631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6821","nonce":96262631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6825","nonce":96262631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6823","nonce":96262631}]},"public_addr":"172.21.15.167:6819/96262631","cluster_addr":"172.21.15.167:6821/96262631","heartbeat_back_addr":"172.21.15.167:6825/96262631","heartbeat_front_addr":"172.21.15.167:6823/96262631","state":["exists","up"]},{"osd":7,"uuid":"01edaf9c-3898-406e-85b0-774cfda60adf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6827","nonce":4169560909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6829","nonce":4169560909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6833","nonce":4169560909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6831","nonce":4169560909}]},"public_addr":"172.21.15.167:6827/4169560909","cluster_addr":"172.21.15.167:6829/4169560909","heartbeat_back_addr":"172.21.15.167:6833/4169560909","heartbeat_front_addr":"172.21.15.167:6831/4169560909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:40.054920+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.177110+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.749278+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.400155+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.503576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.196417+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.371063+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.212852+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:22:03.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.300+0000 7fede199b640 1 -- 172.21.15.98:0/3288909744 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fedc8078b90 msgr2=0x7fedc807b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.300+0000 7fede199b640 1 --2- 172.21.15.98:0/3288909744 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fedc8078b90 0x7fedc807b050 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fedcc035000 tx=0x7fedcc03b040 comp rx=0 tx=0).stop 2024-09-17T05:22:03.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.300+0000 7fede199b640 1 -- 172.21.15.98:0/3288909744 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feddc15e0d0 msgr2=0x7feddc1f7e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.300+0000 7fede199b640 1 --2- 172.21.15.98:0/3288909744 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feddc15e0d0 0x7feddc1f7e10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fedd400d650 tx=0x7fedd400db10 comp rx=0 tx=0).stop 2024-09-17T05:22:03.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.300+0000 7fede199b640 1 -- 172.21.15.98:0/3288909744 shutdown_connections 2024-09-17T05:22:03.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.300+0000 7fede199b640 1 --2- 172.21.15.98:0/3288909744 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fedc8078b90 0x7fedc807b050 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.300+0000 7fede199b640 1 --2- 172.21.15.98:0/3288909744 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feddc15e0d0 0x7feddc1f7e10 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.300+0000 7fede199b640 1 --2- 172.21.15.98:0/3288909744 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feddc0d2050 0x7feddc0cced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.300+0000 7fede199b640 1 --2- 172.21.15.98:0/3288909744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feddc0d1440 0x7feddc0cb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.300+0000 7fede199b640 1 -- 172.21.15.98:0/3288909744 >> 172.21.15.98:0/3288909744 conn(0x7feddc0d3fe0 msgr2=0x7feddc06eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:03.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.300+0000 7fede199b640 1 -- 172.21.15.98:0/3288909744 shutdown_connections 2024-09-17T05:22:03.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.300+0000 7fede199b640 1 -- 172.21.15.98:0/3288909744 wait complete. 2024-09-17T05:22:03.311 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-17T05:22:03.311 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:22:03.412 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.411+0000 7f8ca6a47640 1 -- 172.21.15.98:0/1891256491 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ca0071bf0 msgr2=0x7f8ca0071260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.413 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.411+0000 7f8ca6a47640 1 --2- 172.21.15.98:0/1891256491 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ca0071bf0 0x7f8ca0071260 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8c98009be0 tx=0x7f8c9802a800 comp rx=0 tx=0).stop 2024-09-17T05:22:03.413 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.411+0000 7f8ca6a47640 1 -- 172.21.15.98:0/1891256491 shutdown_connections 2024-09-17T05:22:03.413 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.411+0000 7f8ca6a47640 1 --2- 172.21.15.98:0/1891256491 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ca0071bf0 0x7f8ca0071260 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.413 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.411+0000 7f8ca6a47640 1 -- 172.21.15.98:0/1891256491 >> 172.21.15.98:0/1891256491 conn(0x7f8ca006d230 msgr2=0x7f8ca00688b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:03.413 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.411+0000 7f8ca6a47640 1 -- 172.21.15.98:0/1891256491 shutdown_connections 2024-09-17T05:22:03.413 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.411+0000 7f8ca6a47640 1 -- 172.21.15.98:0/1891256491 wait complete. 2024-09-17T05:22:03.413 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.413+0000 7f8ca6a47640 1 Processor -- start 2024-09-17T05:22:03.414 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.413+0000 7f8ca6a47640 1 -- start start 2024-09-17T05:22:03.417 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.413+0000 7f8ca6a47640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ca0071bf0 0x7f8ca01574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:03.417 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.413+0000 7f8ca6a47640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8ca00b73c0 0x7f8ca00c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:03.417 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.413+0000 7f8ca6a47640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ca00cf170 0x7f8ca00c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:03.417 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.413+0000 7f8ca6a47640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca00d2350 con 0x7f8ca00b73c0 2024-09-17T05:22:03.417 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.413+0000 7f8ca6a47640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca00b79b0 con 0x7f8ca0071bf0 2024-09-17T05:22:03.417 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.413+0000 7f8ca6a47640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f8ca00d24d0 con 0x7f8ca00cf170 2024-09-17T05:22:03.417 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.414+0000 7f8c9f7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8ca00b73c0 0x7f8ca00c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:03.417 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.414+0000 7f8c9f7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8ca00b73c0 0x7f8ca00c7e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47496/0 (socket says 172.21.15.98:47496) 2024-09-17T05:22:03.417 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.414+0000 7f8c9f7fe640 1 -- 172.21.15.98:0/1050466888 learned_addr learned my addr 172.21.15.98:0/1050466888 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:03.418 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.414+0000 7f8c9ffff640 1 --2- 172.21.15.98:0/1050466888 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ca0071bf0 0x7f8ca01574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:03.418 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.414+0000 7f8ca4fe4640 1 --2- 172.21.15.98:0/1050466888 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ca00cf170 0x7f8ca00c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:03.418 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.414+0000 7f8c9f7fe640 1 -- 172.21.15.98:0/1050466888 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ca00cf170 msgr2=0x7f8ca00c83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.418 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.414+0000 7f8c9f7fe640 1 --2- 172.21.15.98:0/1050466888 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ca00cf170 0x7f8ca00c83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.418 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.414+0000 7f8c9f7fe640 1 -- 172.21.15.98:0/1050466888 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ca0071bf0 msgr2=0x7f8ca01574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.418 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.414+0000 7f8c9f7fe640 1 --2- 172.21.15.98:0/1050466888 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ca0071bf0 0x7f8ca01574a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.418 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.414+0000 7f8c9f7fe640 1 -- 172.21.15.98:0/1050466888 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ca01f27d0 con 0x7f8ca00b73c0 2024-09-17T05:22:03.418 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.414+0000 7f8ca4fe4640 1 --2- 172.21.15.98:0/1050466888 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ca00cf170 0x7f8ca00c83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:22:03.418 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.414+0000 7f8c9ffff640 1 --2- 172.21.15.98:0/1050466888 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ca0071bf0 0x7f8ca01574a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:22:03.418 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.414+0000 7f8c9f7fe640 1 --2- 172.21.15.98:0/1050466888 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8ca00b73c0 0x7f8ca00c7e80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8c9400c370 tx=0x7f8c9400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:03.418 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.414+0000 7f8c9cff9640 1 -- 172.21.15.98:0/1050466888 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c94017070 con 0x7f8ca00b73c0 2024-09-17T05:22:03.418 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.414+0000 7f8c9cff9640 1 -- 172.21.15.98:0/1050466888 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8c940035f0 con 0x7f8ca00b73c0 2024-09-17T05:22:03.419 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.414+0000 7f8ca6a47640 1 -- 172.21.15.98:0/1050466888 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ca01f2ab0 con 0x7f8ca00b73c0 2024-09-17T05:22:03.419 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.414+0000 7f8c9cff9640 1 -- 172.21.15.98:0/1050466888 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c94003a40 con 0x7f8ca00b73c0 2024-09-17T05:22:03.419 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.414+0000 7f8ca6a47640 1 -- 172.21.15.98:0/1050466888 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ca01579e0 con 0x7f8ca00b73c0 2024-09-17T05:22:03.419 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.415+0000 7f8ca6a47640 1 -- 172.21.15.98:0/1050466888 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ca0071260 con 0x7f8ca00b73c0 2024-09-17T05:22:03.419 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.416+0000 7f8c9cff9640 1 -- 172.21.15.98:0/1050466888 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8c9401a070 con 0x7f8ca00b73c0 2024-09-17T05:22:03.419 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.416+0000 7f8c9cff9640 1 --2- 172.21.15.98:0/1050466888 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f8c8c078b90 0x7f8c8c07b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:03.419 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.416+0000 7f8c9cff9640 1 -- 172.21.15.98:0/1050466888 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8c94099f30 con 0x7f8ca00b73c0 2024-09-17T05:22:03.419 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.417+0000 7f8c9ffff640 1 --2- 172.21.15.98:0/1050466888 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f8c8c078b90 0x7f8c8c07b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:03.420 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.417+0000 7f8c9ffff640 1 --2- 172.21.15.98:0/1050466888 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f8c8c078b90 0x7f8c8c07b050 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8c90001860 tx=0x7f8c90009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:03.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.421+0000 7f8c9cff9640 1 -- 172.21.15.98:0/1050466888 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f8c94062490 con 0x7f8ca00b73c0 2024-09-17T05:22:03.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.599+0000 7f8ca6a47640 1 -- 172.21.15.98:0/1050466888 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8ca00c54d0 con 0x7f8ca00b73c0 2024-09-17T05:22:03.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.600+0000 7f8c9cff9640 1 -- 172.21.15.98:0/1050466888 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16653 (secure 0 0 0) 0x7f8c94061d90 con 0x7f8ca00b73c0 2024-09-17T05:22:03.601 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:22:03.601 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":21,"fsid":"fcbf5a43-b3d8-497c-b15d-3cc022477cf0","created":"2024-09-17T05:21:29.852143+0000","modified":"2024-09-17T05:21:55.491401+0000","last_up_change":"2024-09-17T05:21:42.925756+0000","last_in_change":"2024-09-17T05:21:32.893880+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:21:42.263011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:21:51.665719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T05:21:52.780673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ad711a-df74-438b-b0dc-1499d685c958","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6825","nonce":3644101529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6827","nonce":3644101529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6831","nonce":3644101529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6829","nonce":3644101529}]},"public_addr":"172.21.15.98:6825/3644101529","cluster_addr":"172.21.15.98:6827/3644101529","heartbeat_back_addr":"172.21.15.98:6831/3644101529","heartbeat_front_addr":"172.21.15.98:6829/3644101529","state":["exists","up"]},{"osd":1,"uuid":"f0ccb08d-4d8d-47b8-9320-8c372a6605b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6817","nonce":3902180920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6819","nonce":3902180920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6823","nonce":3902180920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6821","nonce":3902180920}]},"public_addr":"172.21.15.98:6817/3902180920","cluster_addr":"172.21.15.98:6819/3902180920","heartbeat_back_addr":"172.21.15.98:6823/3902180920","heartbeat_front_addr":"172.21.15.98:6821/3902180920","state":["exists","up"]},{"osd":2,"uuid":"a0985398-5e5f-494f-8abf-f785f19e94ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6801","nonce":1518887101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6803","nonce":1518887101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6807","nonce":1518887101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6805","nonce":1518887101}]},"public_addr":"172.21.15.98:6801/1518887101","cluster_addr":"172.21.15.98:6803/1518887101","heartbeat_back_addr":"172.21.15.98:6807/1518887101","heartbeat_front_addr":"172.21.15.98:6805/1518887101","state":["exists","up"]},{"osd":3,"uuid":"e960be2e-0c3a-426e-9507-d3be5895f9e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6809","nonce":4125246091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6811","nonce":4125246091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6815","nonce":4125246091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6813","nonce":4125246091}]},"public_addr":"172.21.15.98:6809/4125246091","cluster_addr":"172.21.15.98:6811/4125246091","heartbeat_back_addr":"172.21.15.98:6815/4125246091","heartbeat_front_addr":"172.21.15.98:6813/4125246091","state":["exists","up"]},{"osd":4,"uuid":"49118c00-3dc1-43ef-8ed4-aca61e56a507","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6811","nonce":765789888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6813","nonce":765789888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6817","nonce":765789888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6815","nonce":765789888}]},"public_addr":"172.21.15.167:6811/765789888","cluster_addr":"172.21.15.167:6813/765789888","heartbeat_back_addr":"172.21.15.167:6817/765789888","heartbeat_front_addr":"172.21.15.167:6815/765789888","state":["exists","up"]},{"osd":5,"uuid":"9f4e0143-2b3d-40e4-bfb5-043d9a9f4ba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6803","nonce":2567019914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6805","nonce":2567019914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6809","nonce":2567019914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6807","nonce":2567019914}]},"public_addr":"172.21.15.167:6803/2567019914","cluster_addr":"172.21.15.167:6805/2567019914","heartbeat_back_addr":"172.21.15.167:6809/2567019914","heartbeat_front_addr":"172.21.15.167:6807/2567019914","state":["exists","up"]},{"osd":6,"uuid":"28720514-e627-4dea-8f4d-bd311ec31361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6819","nonce":96262631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6821","nonce":96262631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6825","nonce":96262631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6823","nonce":96262631}]},"public_addr":"172.21.15.167:6819/96262631","cluster_addr":"172.21.15.167:6821/96262631","heartbeat_back_addr":"172.21.15.167:6825/96262631","heartbeat_front_addr":"172.21.15.167:6823/96262631","state":["exists","up"]},{"osd":7,"uuid":"01edaf9c-3898-406e-85b0-774cfda60adf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6827","nonce":4169560909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6829","nonce":4169560909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6833","nonce":4169560909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6831","nonce":4169560909}]},"public_addr":"172.21.15.167:6827/4169560909","cluster_addr":"172.21.15.167:6829/4169560909","heartbeat_back_addr":"172.21.15.167:6833/4169560909","heartbeat_front_addr":"172.21.15.167:6831/4169560909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:40.054920+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.177110+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.749278+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.400155+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.503576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.196417+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.371063+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.212852+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:22:03.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.602+0000 7f8ca6a47640 1 -- 172.21.15.98:0/1050466888 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f8c8c078b90 msgr2=0x7f8c8c07b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.602+0000 7f8ca6a47640 1 --2- 172.21.15.98:0/1050466888 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f8c8c078b90 0x7f8c8c07b050 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8c90001860 tx=0x7f8c90009040 comp rx=0 tx=0).stop 2024-09-17T05:22:03.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.602+0000 7f8ca6a47640 1 -- 172.21.15.98:0/1050466888 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8ca00b73c0 msgr2=0x7f8ca00c7e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.602+0000 7f8ca6a47640 1 --2- 172.21.15.98:0/1050466888 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8ca00b73c0 0x7f8ca00c7e80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8c9400c370 tx=0x7f8c9400c830 comp rx=0 tx=0).stop 2024-09-17T05:22:03.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.602+0000 7f8ca6a47640 1 -- 172.21.15.98:0/1050466888 shutdown_connections 2024-09-17T05:22:03.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.602+0000 7f8ca6a47640 1 --2- 172.21.15.98:0/1050466888 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f8c8c078b90 0x7f8c8c07b050 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.602+0000 7f8ca6a47640 1 --2- 172.21.15.98:0/1050466888 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ca00cf170 0x7f8ca00c83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.602+0000 7f8ca6a47640 1 --2- 172.21.15.98:0/1050466888 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8ca00b73c0 0x7f8ca00c7e80 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.602+0000 7f8ca6a47640 1 --2- 172.21.15.98:0/1050466888 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ca0071bf0 0x7f8ca01574a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.602+0000 7f8ca6a47640 1 -- 172.21.15.98:0/1050466888 >> 172.21.15.98:0/1050466888 conn(0x7f8ca006d230 msgr2=0x7f8ca00688b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:03.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.602+0000 7f8ca6a47640 1 -- 172.21.15.98:0/1050466888 shutdown_connections 2024-09-17T05:22:03.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.602+0000 7f8ca6a47640 1 -- 172.21.15.98:0/1050466888 wait complete. 2024-09-17T05:22:03.614 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-17T05:22:03.614 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-17T05:22:03.615 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-17T05:22:03.615 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-17T05:22:03.616 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-17T05:22:03.616 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-17T05:22:03.616 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-17T05:22:03.617 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-17T05:22:03.787 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.786+0000 7f1419089640 1 -- 172.21.15.98:0/3015389770 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14140ae440 con 0x7f140c0e6280 2024-09-17T05:22:03.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.787+0000 7f141b08d640 1 -- 172.21.15.98:0/3015389770 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f140c0e6280 msgr2=0x7f140c0e6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.787+0000 7f141b08d640 1 --2- 172.21.15.98:0/3015389770 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f140c0e6280 0x7f140c0e6740 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f141407aef0 tx=0x7f14140a5df0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.787+0000 7f141b08d640 1 -- 172.21.15.98:0/3015389770 shutdown_connections 2024-09-17T05:22:03.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.787+0000 7f141b08d640 1 --2- 172.21.15.98:0/3015389770 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f140c04eb20 0x7f140c0e6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.787+0000 7f141b08d640 1 --2- 172.21.15.98:0/3015389770 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f140c0e6280 0x7f140c0e6740 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.787+0000 7f141b08d640 1 -- 172.21.15.98:0/3015389770 >> 172.21.15.98:0/3015389770 conn(0x7f140c01d770 msgr2=0x7f140c054560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:03.789 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.787+0000 7f46b5580640 1 -- 172.21.15.98:0/4152630149 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46a801c620 msgr2=0x7f46a801cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.789 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.787+0000 7f46b5580640 1 --2- 172.21.15.98:0/4152630149 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46a801c620 0x7f46a801cab0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f46a4005fd0 tx=0x7f46a402a510 comp rx=0 tx=0).stop 2024-09-17T05:22:03.789 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.787+0000 7f0ce2d33640 1 -- 172.21.15.98:0/625830340 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0cc4004800 msgr2=0x7f0cc4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.789 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.787+0000 7f0ce2d33640 1 --2- 172.21.15.98:0/625830340 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0cc4004800 0x7f0cc4004c80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0cd400c610 tx=0x7f0cc4005830 comp rx=0 tx=0).stop 2024-09-17T05:22:03.790 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.788+0000 7f141b08d640 1 -- 172.21.15.98:0/3015389770 shutdown_connections 2024-09-17T05:22:03.790 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.788+0000 7f46b5580640 1 -- 172.21.15.98:0/4152630149 shutdown_connections 2024-09-17T05:22:03.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.788+0000 7f0ce2d33640 1 -- 172.21.15.98:0/625830340 shutdown_connections 2024-09-17T05:22:03.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.788+0000 7f0ce2d33640 1 --2- 172.21.15.98:0/625830340 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0cc4004800 0x7f0cc4004c80 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.788+0000 7f0ce2d33640 1 -- 172.21.15.98:0/625830340 >> 172.21.15.98:0/625830340 conn(0x7f0cdc0d3fe0 msgr2=0x7f0cdc0d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:03.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.788+0000 7f0ce2d33640 1 -- 172.21.15.98:0/625830340 shutdown_connections 2024-09-17T05:22:03.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.788+0000 7f0ce2d33640 1 -- 172.21.15.98:0/625830340 wait complete. 2024-09-17T05:22:03.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.788+0000 7f46b5580640 1 --2- 172.21.15.98:0/4152630149 >> v2:172.21.15.167:3300/0 conn(0x7f46a8005a60 0x7f46a8036520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.788+0000 7f46b5580640 1 --2- 172.21.15.98:0/4152630149 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46a801c620 0x7f46a801cab0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.788+0000 7f46b5580640 1 --2- 172.21.15.98:0/4152630149 >> v2:172.21.15.98:3300/0 conn(0x7f46a800ba00 0x7f46a8035fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.788+0000 7f46b5580640 1 -- 172.21.15.98:0/4152630149 >> 172.21.15.98:0/4152630149 conn(0x7f46a8054560 msgr2=0x7f46a8054940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:03.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.788+0000 7f141b08d640 1 -- 172.21.15.98:0/3015389770 wait complete. 2024-09-17T05:22:03.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.788+0000 7f46b5580640 1 -- 172.21.15.98:0/4152630149 shutdown_connections 2024-09-17T05:22:03.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.788+0000 7f46b5580640 1 -- 172.21.15.98:0/4152630149 wait complete. 2024-09-17T05:22:03.794 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.789+0000 7f14ede71640 1 -- 172.21.15.98:0/3731207696 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f14e80b3f40 msgr2=0x7f14e815dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.794 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.789+0000 7f14ede71640 1 --2- 172.21.15.98:0/3731207696 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f14e80b3f40 0x7f14e815dbf0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f14e0005fd0 tx=0x7f14e002a4a0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.794 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.789+0000 7f14ede71640 1 -- 172.21.15.98:0/3731207696 shutdown_connections 2024-09-17T05:22:03.794 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.789+0000 7f14ede71640 1 --2- 172.21.15.98:0/3731207696 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f14e80b3f40 0x7f14e815dbf0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.794 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.789+0000 7f14ede71640 1 -- 172.21.15.98:0/3731207696 >> 172.21.15.98:0/3731207696 conn(0x7f14e80d3fc0 msgr2=0x7f14e80d43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:03.795 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.789+0000 7f141b08d640 1 Processor -- start 2024-09-17T05:22:03.795 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.789+0000 7f141b08d640 1 -- start start 2024-09-17T05:22:03.795 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.789+0000 7f14ede71640 1 -- 172.21.15.98:0/3731207696 shutdown_connections 2024-09-17T05:22:03.796 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.790+0000 7f0ce2d33640 1 Processor -- start 2024-09-17T05:22:03.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.790+0000 7f46b5580640 1 Processor -- start 2024-09-17T05:22:03.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.790+0000 7f141b08d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f140c04eb20 0x7f140c0e3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:03.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.790+0000 7f141b08d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f140c0e5ea0 0x7f140c032140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:03.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.790+0000 7f767966b640 1 -- 172.21.15.98:0/2838302178 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f766c0366f0 msgr2=0x7f766c009a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.790+0000 7f141b08d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f140c0e6280 0x7f140c0d8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:03.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.790+0000 7f767966b640 1 --2- 172.21.15.98:0/2838302178 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f766c0366f0 0x7f766c009a50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7674052430 tx=0x7f76740a5810 comp rx=0 tx=0).stop 2024-09-17T05:22:03.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.790+0000 7f141b08d640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f140c0364a0 con 0x7f140c0e5ea0 2024-09-17T05:22:03.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.790+0000 7f141b08d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f140c036320 con 0x7f140c04eb20 2024-09-17T05:22:03.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.790+0000 7f141b08d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f140c036620 con 0x7f140c0e6280 2024-09-17T05:22:03.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.790+0000 7f14ede71640 1 -- 172.21.15.98:0/3731207696 wait complete. 2024-09-17T05:22:03.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.791+0000 7f46b5580640 1 -- start start 2024-09-17T05:22:03.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.791+0000 7f141988a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f140c0e5ea0 0x7f140c032140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:03.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.791+0000 7f141988a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f140c0e5ea0 0x7f140c032140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47612/0 (socket says 172.21.15.98:47612) 2024-09-17T05:22:03.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.791+0000 7f141988a640 1 -- 172.21.15.98:0/3039161559 learned_addr learned my addr 172.21.15.98:0/3039161559 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:03.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.791+0000 7f141a08b640 1 --2- 172.21.15.98:0/3039161559 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f140c04eb20 0x7f140c0e3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:03.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.791+0000 7f0ce2d33640 1 -- start start 2024-09-17T05:22:03.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.791+0000 7fbc6fd3d640 1 -- 172.21.15.98:0/2325931390 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc54003aa0 msgr2=0x7fbc54003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.791+0000 7fbc6fd3d640 1 --2- 172.21.15.98:0/2325931390 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc54003aa0 0x7fbc54003ec0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbc64006ed0 tx=0x7fbc54005830 comp rx=0 tx=0).stop 2024-09-17T05:22:03.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.791+0000 7fbc6fd3d640 1 -- 172.21.15.98:0/2325931390 shutdown_connections 2024-09-17T05:22:03.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.791+0000 7fbc6fd3d640 1 --2- 172.21.15.98:0/2325931390 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc54003aa0 0x7fbc54003ec0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.791+0000 7fbc6fd3d640 1 -- 172.21.15.98:0/2325931390 >> 172.21.15.98:0/2325931390 conn(0x7fbc680b2670 msgr2=0x7fbc680b2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:03.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.791+0000 7f3a6d5a6640 1 -- 172.21.15.98:0/833690175 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3a500039f0 msgr2=0x7f3a50003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.791+0000 7f3a6d5a6640 1 --2- 172.21.15.98:0/833690175 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3a500039f0 0x7f3a50003e30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c009c10 tx=0x7f3a50005830 comp rx=0 tx=0).stop 2024-09-17T05:22:03.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.791+0000 7f3a6d5a6640 1 -- 172.21.15.98:0/833690175 shutdown_connections 2024-09-17T05:22:03.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.791+0000 7f3a6d5a6640 1 --2- 172.21.15.98:0/833690175 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3a500039f0 0x7f3a50003e30 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.791+0000 7f3a6d5a6640 1 -- 172.21.15.98:0/833690175 >> 172.21.15.98:0/833690175 conn(0x7f3a680d3dc0 msgr2=0x7f3a680d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:03.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.791+0000 7fbc6fd3d640 1 -- 172.21.15.98:0/2325931390 shutdown_connections 2024-09-17T05:22:03.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.791+0000 7f3a6d5a6640 1 -- 172.21.15.98:0/833690175 shutdown_connections 2024-09-17T05:22:03.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.791+0000 7f3a6d5a6640 1 -- 172.21.15.98:0/833690175 wait complete. 2024-09-17T05:22:03.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.791+0000 7f141a08b640 1 -- 172.21.15.98:0/3039161559 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f140c0e6280 msgr2=0x7f140c0d8d20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T05:22:03.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.791+0000 7f141a08b640 1 --2- 172.21.15.98:0/3039161559 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f140c0e6280 0x7f140c0d8d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.791+0000 7f141a08b640 1 -- 172.21.15.98:0/3039161559 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f140c0e5ea0 msgr2=0x7f140c032140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.791+0000 7f141a08b640 1 --2- 172.21.15.98:0/3039161559 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f140c0e5ea0 0x7f140c032140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.791+0000 7f141a08b640 1 -- 172.21.15.98:0/3039161559 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f140c0d9c50 con 0x7f140c04eb20 2024-09-17T05:22:03.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.792+0000 7f141a08b640 1 --2- 172.21.15.98:0/3039161559 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f140c04eb20 0x7f140c0e3c10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f141000c3f0 tx=0x7f141000c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:03.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.791+0000 7fbc6fd3d640 1 -- 172.21.15.98:0/2325931390 wait complete. 2024-09-17T05:22:03.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.791+0000 7f14ede71640 1 Processor -- start 2024-09-17T05:22:03.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.792+0000 7f14ede71640 1 -- start start 2024-09-17T05:22:03.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.792+0000 7f140affd640 1 -- 172.21.15.98:0/3039161559 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1410017070 con 0x7f140c04eb20 2024-09-17T05:22:03.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.792+0000 7f140affd640 1 -- 172.21.15.98:0/3039161559 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f14100053c0 con 0x7f140c04eb20 2024-09-17T05:22:03.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.792+0000 7f0ce2d33640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cc4004800 0x7f0cdc158be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:03.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.792+0000 7f0ce2d33640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cdc159120 0x7f0cdc15e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:03.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.792+0000 7f46b5580640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46a8005a60 0x7f46a8046e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:03.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.792+0000 7f140affd640 1 -- 172.21.15.98:0/3039161559 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1410003830 con 0x7f140c04eb20 2024-09-17T05:22:03.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.792+0000 7f141b08d640 1 -- 172.21.15.98:0/3039161559 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f140c0d9970 con 0x7f140c04eb20 2024-09-17T05:22:03.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.792+0000 7f141b08d640 1 -- 172.21.15.98:0/3039161559 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f140c0e36f0 con 0x7f140c04eb20 2024-09-17T05:22:03.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.792+0000 7f0ce2d33640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0cdc15ec00 0x7f0cdc0b6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:03.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.792+0000 7f0ce2d33640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0cdc0d0e00 con 0x7f0cdc15ec00 2024-09-17T05:22:03.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.792+0000 7f0ce2d33640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0cdc0d0c80 con 0x7f0cc4004800 2024-09-17T05:22:03.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.792+0000 7f0ce2d33640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f0cdc0d0f80 con 0x7f0cdc159120 2024-09-17T05:22:03.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.792+0000 7f46b5580640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46a800ba00 0x7f46a804bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:03.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.792+0000 7f46b5580640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46a801c620 0x7f46a8035690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:03.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.792+0000 7f767966b640 1 -- 172.21.15.98:0/2838302178 shutdown_connections 2024-09-17T05:22:03.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.792+0000 7f46b5580640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f46a80e2910 con 0x7f46a8005a60 2024-09-17T05:22:03.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.793+0000 7f767966b640 1 --2- 172.21.15.98:0/2838302178 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f766c0366f0 0x7f766c009a50 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.792+0000 7f46b5580640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f46a80e2790 con 0x7f46a801c620 2024-09-17T05:22:03.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.792+0000 7f46b5580640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f46a80e2a90 con 0x7f46a800ba00 2024-09-17T05:22:03.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.792+0000 7f46affff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46a8005a60 0x7f46a8046e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:03.810 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.792+0000 7f46affff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46a8005a60 0x7f46a8046e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47620/0 (socket says 172.21.15.98:47620) 2024-09-17T05:22:03.810 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.792+0000 7f46affff640 1 -- 172.21.15.98:0/4193904244 learned_addr learned my addr 172.21.15.98:0/4193904244 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:03.810 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.793+0000 7f767966b640 1 --2- 172.21.15.98:0/2838302178 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f766c01c890 0x7f766c01cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.810 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.793+0000 7f767966b640 1 -- 172.21.15.98:0/2838302178 >> 172.21.15.98:0/2838302178 conn(0x7f766c054560 msgr2=0x7f766c054940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:03.810 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.793+0000 7f767966b640 1 -- 172.21.15.98:0/2838302178 shutdown_connections 2024-09-17T05:22:03.810 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.792+0000 7f0cdbfff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cdc159120 0x7f0cdc15e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:03.811 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.793+0000 7f767966b640 1 -- 172.21.15.98:0/2838302178 wait complete. 2024-09-17T05:22:03.811 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.792+0000 7f83c6b4b640 1 -- 172.21.15.98:0/4082222264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83ac004800 msgr2=0x7f83ac004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.811 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.792+0000 7f83c6b4b640 1 --2- 172.21.15.98:0/4082222264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83ac004800 0x7f83ac004c80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f83b0009b20 tx=0x7f83ac005830 comp rx=0 tx=0).stop 2024-09-17T05:22:03.811 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.793+0000 7f46b4d7f640 1 --2- 172.21.15.98:0/4193904244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46a801c620 0x7f46a8035690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:03.811 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.793+0000 7f46affff640 1 -- 172.21.15.98:0/4193904244 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46a800ba00 msgr2=0x7f46a804bfb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T05:22:03.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.793+0000 7f46affff640 1 --2- 172.21.15.98:0/4193904244 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46a800ba00 0x7f46a804bfb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.793+0000 7f46affff640 1 -- 172.21.15.98:0/4193904244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46a801c620 msgr2=0x7f46a8035690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.793+0000 7f46affff640 1 --2- 172.21.15.98:0/4193904244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46a801c620 0x7f46a8035690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.793+0000 7f46affff640 1 -- 172.21.15.98:0/4193904244 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46a8036820 con 0x7f46a8005a60 2024-09-17T05:22:03.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.793+0000 7fbc6fd3d640 1 Processor -- start 2024-09-17T05:22:03.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.793+0000 7f14ede71640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14e80b3f40 0x7f14e80b7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:03.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.793+0000 7f14ede71640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f14e80cf5e0 0x7f14e8157570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:03.813 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.793+0000 7f14ede71640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f14e80d09b0 0x7f14e80b7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:03.813 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.793+0000 7f14ede71640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f14e815e4c0 con 0x7f14e80cf5e0 2024-09-17T05:22:03.813 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.793+0000 7f14ede71640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f14e815e340 con 0x7f14e80b3f40 2024-09-17T05:22:03.813 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.793+0000 7f14ede71640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f14e815e640 con 0x7f14e80d09b0 2024-09-17T05:22:03.813 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.793+0000 7f14e7fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f14e80d09b0 0x7f14e80b7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:03.813 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.793+0000 7fbc6fd3d640 1 -- start start 2024-09-17T05:22:03.813 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.792+0000 7f0ce12d0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0cdc15ec00 0x7f0cdc0b6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:03.814 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.793+0000 7f0ce12d0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0cdc15ec00 0x7f0cdc0b6e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47632/0 (socket says 172.21.15.98:47632) 2024-09-17T05:22:03.814 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.793+0000 7f0ce12d0640 1 -- 172.21.15.98:0/4068792808 learned_addr learned my addr 172.21.15.98:0/4068792808 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:03.814 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.793+0000 7f14deffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f14e80cf5e0 0x7f14e8157570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:03.814 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.793+0000 7f14deffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f14e80cf5e0 0x7f14e8157570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47642/0 (socket says 172.21.15.98:47642) 2024-09-17T05:22:03.814 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.793+0000 7f14deffd640 1 -- 172.21.15.98:0/50316275 learned_addr learned my addr 172.21.15.98:0/50316275 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:03.814 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.793+0000 7f14e77fe640 1 --2- 172.21.15.98:0/50316275 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14e80b3f40 0x7f14e80b7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:03.814 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.792+0000 7f0cdbfff640 1 --2- 172.21.15.98:0/4068792808 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cdc159120 0x7f0cdc15e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.98:37870/0 (socket says 172.21.15.98:37870) 2024-09-17T05:22:03.815 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.793+0000 7f46affff640 1 --2- 172.21.15.98:0/4193904244 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46a8005a60 0x7f46a8046e50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f469c00ea20 tx=0x7f469c00eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:03.815 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.793+0000 7f1408ff9640 1 -- 172.21.15.98:0/3039161559 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f140c036b40 con 0x7f140c04eb20 2024-09-17T05:22:03.815 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.793+0000 7f3a6d5a6640 1 Processor -- start 2024-09-17T05:22:03.816 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.793+0000 7f0ce12d0640 1 -- 172.21.15.98:0/4068792808 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cdc159120 msgr2=0x7f0cdc15e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.816 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.794+0000 7f0ce0acf640 1 --2- 172.21.15.98:0/4068792808 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cc4004800 0x7f0cdc158be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:03.816 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.794+0000 7f0ce12d0640 1 --2- 172.21.15.98:0/4068792808 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cdc159120 0x7f0cdc15e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.816 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.794+0000 7f0ce12d0640 1 -- 172.21.15.98:0/4068792808 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cc4004800 msgr2=0x7f0cdc158be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.816 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.794+0000 7f0ce12d0640 1 --2- 172.21.15.98:0/4068792808 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cc4004800 0x7f0cdc158be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.816 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.794+0000 7f0ce12d0640 1 -- 172.21.15.98:0/4068792808 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cdc0b78b0 con 0x7f0cdc15ec00 2024-09-17T05:22:03.816 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.794+0000 7f0ce0acf640 1 --2- 172.21.15.98:0/4068792808 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cc4004800 0x7f0cdc158be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:22:03.817 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.794+0000 7f83c6b4b640 1 -- 172.21.15.98:0/4082222264 shutdown_connections 2024-09-17T05:22:03.817 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.794+0000 7f3a6d5a6640 1 -- start start 2024-09-17T05:22:03.817 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.794+0000 7f83c6b4b640 1 --2- 172.21.15.98:0/4082222264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83ac004800 0x7f83ac004c80 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.817 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.794+0000 7f46acff9640 1 -- 172.21.15.98:0/4193904244 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f469c00cd80 con 0x7f46a8005a60 2024-09-17T05:22:03.818 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.794+0000 7f14e77fe640 1 -- 172.21.15.98:0/50316275 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f14e80d09b0 msgr2=0x7f14e80b7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.818 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.794+0000 7f14e77fe640 1 --2- 172.21.15.98:0/50316275 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f14e80d09b0 0x7f14e80b7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.818 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.794+0000 7f14e77fe640 1 -- 172.21.15.98:0/50316275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f14e80cf5e0 msgr2=0x7f14e8157570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.818 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.794+0000 7f14e77fe640 1 --2- 172.21.15.98:0/50316275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f14e80cf5e0 0x7f14e8157570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.818 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.794+0000 7f14e77fe640 1 -- 172.21.15.98:0/50316275 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14e81f9020 con 0x7f14e80b3f40 2024-09-17T05:22:03.818 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.794+0000 7f0ce12d0640 1 --2- 172.21.15.98:0/4068792808 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0cdc15ec00 0x7f0cdc0b6e10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc08d420 tx=0x7f0ccc001800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:03.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.794+0000 7f83c6b4b640 1 -- 172.21.15.98:0/4082222264 >> 172.21.15.98:0/4082222264 conn(0x7f83c00b15f0 msgr2=0x7f83c00b19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:03.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.794+0000 7f83c6b4b640 1 -- 172.21.15.98:0/4082222264 shutdown_connections 2024-09-17T05:22:03.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.794+0000 7f83c6b4b640 1 -- 172.21.15.98:0/4082222264 wait complete. 2024-09-17T05:22:03.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.794+0000 7f14e77fe640 1 --2- 172.21.15.98:0/50316275 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14e80b3f40 0x7f14e80b7270 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f14d800bd80 tx=0x7f14d800be70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:03.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.794+0000 7f14e4ff9640 1 -- 172.21.15.98:0/50316275 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d8019070 con 0x7f14e80b3f40 2024-09-17T05:22:03.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.794+0000 7f14e4ff9640 1 -- 172.21.15.98:0/50316275 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f14d8014440 con 0x7f14e80b3f40 2024-09-17T05:22:03.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.794+0000 7f14e4ff9640 1 -- 172.21.15.98:0/50316275 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d80148b0 con 0x7f14e80b3f40 2024-09-17T05:22:03.820 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.794+0000 7f0cd97fa640 1 -- 172.21.15.98:0/4068792808 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc015070 con 0x7f0cdc15ec00 2024-09-17T05:22:03.820 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.795+0000 7f0ce2d33640 1 -- 172.21.15.98:0/4068792808 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cdc0b7b90 con 0x7f0cdc15ec00 2024-09-17T05:22:03.820 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.795+0000 7f0ce2d33640 1 -- 172.21.15.98:0/4068792808 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cdc1f04e0 con 0x7f0cdc15ec00 2024-09-17T05:22:03.820 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.795+0000 7f767966b640 1 Processor -- start 2024-09-17T05:22:03.820 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.795+0000 7fbc6fd3d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc54003aa0 0x7fbc6814c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:03.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.795+0000 7f3a6d5a6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a500039f0 0x7f3a680b2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:03.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.795+0000 7fbc6dad9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc54003aa0 0x7fbc6814c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:03.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.795+0000 7f3a6d5a6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3a68157320 0x7f3a680c7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:03.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.795+0000 7f3a6d5a6640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a681569a0 0x7f3a680ca080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:03.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.794+0000 7f46b5580640 1 -- 172.21.15.98:0/4193904244 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46a8036260 con 0x7f46a8005a60 2024-09-17T05:22:03.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.794+0000 7f46b5580640 1 -- 172.21.15.98:0/4193904244 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46a804c4f0 con 0x7f46a8005a60 2024-09-17T05:22:03.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.795+0000 7f3a6d5a6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3a680d48e0 con 0x7f3a68157320 2024-09-17T05:22:03.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.795+0000 7f46acff9640 1 -- 172.21.15.98:0/4193904244 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f469c010430 con 0x7f46a8005a60 2024-09-17T05:22:03.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.795+0000 7f140affd640 1 -- 172.21.15.98:0/3039161559 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f141001a070 con 0x7f140c04eb20 2024-09-17T05:22:03.823 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.796+0000 7f3a6d5a6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3a68161990 con 0x7f3a500039f0 2024-09-17T05:22:03.823 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.796+0000 7f3a6d5a6640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f3a680d4a60 con 0x7f3a681569a0 2024-09-17T05:22:03.823 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.796+0000 7f46acff9640 1 -- 172.21.15.98:0/4193904244 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f469c010840 con 0x7f46a8005a60 2024-09-17T05:22:03.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.796+0000 7f3a6cda5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a681569a0 0x7f3a680ca080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:03.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.796+0000 7f3a6cda5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a681569a0 0x7f3a680ca080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.98:37892/0 (socket says 172.21.15.98:37892) 2024-09-17T05:22:03.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.796+0000 7f3a6cda5640 1 -- 172.21.15.98:0/1579807980 learned_addr learned my addr 172.21.15.98:0/1579807980 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:03.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.796+0000 7fbc6dad9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc54003aa0 0x7fbc6814c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47656/0 (socket says 172.21.15.98:47656) 2024-09-17T05:22:03.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.796+0000 7f83c6b4b640 1 Processor -- start 2024-09-17T05:22:03.825 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.796+0000 7f46b5580640 1 -- 172.21.15.98:0/4193904244 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4690001030 con 0x7f46a8005a60 2024-09-17T05:22:03.825 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.795+0000 7f14ede71640 1 -- 172.21.15.98:0/50316275 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14e81f9300 con 0x7f14e80b3f40 2024-09-17T05:22:03.825 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.796+0000 7fbc6dad9640 1 -- 172.21.15.98:0/118657557 learned_addr learned my addr 172.21.15.98:0/118657557 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:03.825 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.796+0000 7fbc6fd3d640 1 --2- 172.21.15.98:0/118657557 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc681565a0 0x7fbc680c65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:03.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.795+0000 7f14ede71640 1 -- 172.21.15.98:0/50316275 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14e80ccf30 con 0x7f14e80b3f40 2024-09-17T05:22:03.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.796+0000 7fbc6fd3d640 1 --2- 172.21.15.98:0/118657557 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc680b64a0 0x7fbc680c6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:03.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.796+0000 7f0cd97fa640 1 -- 172.21.15.98:0/4068792808 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0ccc003e50 con 0x7f0cdc15ec00 2024-09-17T05:22:03.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.796+0000 7fbc6d2d8640 1 --2- 172.21.15.98:0/118657557 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc681565a0 0x7fbc680c65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:03.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.796+0000 7fbc6fd3d640 1 -- 172.21.15.98:0/118657557 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fbc681581e0 con 0x7fbc54003aa0 2024-09-17T05:22:03.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.796+0000 7fbc6fd3d640 1 -- 172.21.15.98:0/118657557 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbc68158060 con 0x7fbc680b64a0 2024-09-17T05:22:03.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.796+0000 7fbc6fd3d640 1 -- 172.21.15.98:0/118657557 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fbc68158360 con 0x7fbc681565a0 2024-09-17T05:22:03.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.796+0000 7f140affd640 1 --2- 172.21.15.98:0/3039161559 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f13f8078c60 0x7f13f807b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:03.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.796+0000 7f140affd640 1 -- 172.21.15.98:0/3039161559 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f141009a3d0 con 0x7f140c04eb20 2024-09-17T05:22:03.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.796+0000 7f140affd640 1 --2- 172.21.15.98:0/3039161559 >> [v2:172.21.15.98:6800/1518887101,v1:172.21.15.98:6801/1518887101] conn(0x7f13f8080e80 0x7f13f80832a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:03.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.796+0000 7f140affd640 1 -- 172.21.15.98:0/3039161559 --> [v2:172.21.15.98:6800/1518887101,v1:172.21.15.98:6801/1518887101] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1410016ec0 con 0x7f13f8080e80 2024-09-17T05:22:03.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.796+0000 7f140affd640 1 -- 172.21.15.98:0/3039161559 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f141009a7c0 con 0x7f140c04eb20 2024-09-17T05:22:03.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.796+0000 7f141988a640 1 --2- 172.21.15.98:0/3039161559 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f13f8078c60 0x7f13f807b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:03.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.797+0000 7fbc6e2da640 1 --2- 172.21.15.98:0/118657557 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc680b64a0 0x7fbc680c6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:03.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.797+0000 7f0cd97fa640 1 -- 172.21.15.98:0/4068792808 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc011b00 con 0x7f0cdc15ec00 2024-09-17T05:22:03.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.796+0000 7f83c6b4b640 1 -- start start 2024-09-17T05:22:03.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.798+0000 7f83c6b4b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83ac004800 0x7f83c0153540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:03.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.798+0000 7f83c6b4b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83c014d4a0 0x7f83c01529b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:03.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.798+0000 7f83c6b4b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83c014d920 0x7f83c0152ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:03.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.798+0000 7f83c6b4b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f83c00cc750 con 0x7f83c014d920 2024-09-17T05:22:03.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.798+0000 7f83c6b4b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f83c00cc5d0 con 0x7f83c014d4a0 2024-09-17T05:22:03.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.798+0000 7f83c6b4b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f83c00cc8d0 con 0x7f83ac004800 2024-09-17T05:22:03.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.796+0000 7f767966b640 1 -- start start 2024-09-17T05:22:03.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.798+0000 7f767966b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f766c005a60 0x7f766c04e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:03.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.798+0000 7f767966b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f766c01c890 0x7f766c048000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:03.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.798+0000 7f767966b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f766c0366f0 0x7f766c04cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:03.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.798+0000 7f767966b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f766c009f90 con 0x7f766c005a60 2024-09-17T05:22:03.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.798+0000 7f767966b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f766c00bc10 con 0x7f766c01c890 2024-09-17T05:22:03.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.798+0000 7f767966b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f766c00a110 con 0x7f766c0366f0 2024-09-17T05:22:03.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.796+0000 7f3a67fff640 1 --2- 172.21.15.98:0/1579807980 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a500039f0 0x7f3a680b2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:03.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.796+0000 7f3a677fe640 1 --2- 172.21.15.98:0/1579807980 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3a68157320 0x7f3a680c7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:03.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.798+0000 7f0cc2ffd640 1 -- 172.21.15.98:0/4068792808 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0cbc001030 con 0x7f0cdc15ec00 2024-09-17T05:22:03.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.797+0000 7f3a677fe640 1 -- 172.21.15.98:0/1579807980 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a681569a0 msgr2=0x7f3a680ca080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.797+0000 7f3a677fe640 1 --2- 172.21.15.98:0/1579807980 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a681569a0 0x7f3a680ca080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.797+0000 7f3a677fe640 1 -- 172.21.15.98:0/1579807980 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a500039f0 msgr2=0x7f3a680b2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.797+0000 7f3a677fe640 1 --2- 172.21.15.98:0/1579807980 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a500039f0 0x7f3a680b2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.797+0000 7f3a677fe640 1 -- 172.21.15.98:0/1579807980 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a680b8f60 con 0x7f3a68157320 2024-09-17T05:22:03.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.797+0000 7f3a677fe640 1 --2- 172.21.15.98:0/1579807980 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3a68157320 0x7f3a680c7860 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3a6806aa30 tx=0x7f3a5800dd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:03.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.798+0000 7f3a64ff9640 1 -- 172.21.15.98:0/1579807980 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a58006e60 con 0x7f3a68157320 2024-09-17T05:22:03.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.798+0000 7f3a6d5a6640 1 -- 172.21.15.98:0/1579807980 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a680b9240 con 0x7f3a68157320 2024-09-17T05:22:03.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.798+0000 7f3a6d5a6640 1 -- 172.21.15.98:0/1579807980 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a680b9800 con 0x7f3a68157320 2024-09-17T05:22:03.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.798+0000 7f76737fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f766c01c890 0x7f766c048000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:03.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.798+0000 7f76737fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f766c01c890 0x7f766c048000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.98:45554/0 (socket says 172.21.15.98:45554) 2024-09-17T05:22:03.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.798+0000 7f83c5b49640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83ac004800 0x7f83c0153540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:03.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.798+0000 7f83c5348640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83c014d4a0 0x7f83c01529b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:03.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.798+0000 7f76737fe640 1 -- 172.21.15.98:0/1347096498 learned_addr learned my addr 172.21.15.98:0/1347096498 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:03.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.798+0000 7f7678e6a640 1 --2- 172.21.15.98:0/1347096498 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f766c0366f0 0x7f766c04cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:03.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.797+0000 7f14e4ff9640 1 -- 172.21.15.98:0/50316275 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f14d801c070 con 0x7f14e80b3f40 2024-09-17T05:22:03.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.798+0000 7f14e4ff9640 1 --2- 172.21.15.98:0/50316275 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f14c8078c60 0x7f14c807b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:03.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.798+0000 7f14e4ff9640 1 -- 172.21.15.98:0/50316275 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f14d809abe0 con 0x7f14e80b3f40 2024-09-17T05:22:03.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.798+0000 7f14deffd640 1 --2- 172.21.15.98:0/50316275 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f14c8078c60 0x7f14c807b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:03.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.797+0000 7fbc6d2d8640 1 -- 172.21.15.98:0/118657557 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc680b64a0 msgr2=0x7fbc680c6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.797+0000 7fbc6d2d8640 1 --2- 172.21.15.98:0/118657557 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc680b64a0 0x7fbc680c6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.797+0000 7fbc6d2d8640 1 -- 172.21.15.98:0/118657557 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc54003aa0 msgr2=0x7fbc6814c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.797+0000 7fbc6d2d8640 1 --2- 172.21.15.98:0/118657557 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc54003aa0 0x7fbc6814c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.797+0000 7fbc6d2d8640 1 -- 172.21.15.98:0/118657557 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc680c8dd0 con 0x7fbc681565a0 2024-09-17T05:22:03.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.798+0000 7fbc6dad9640 1 --2- 172.21.15.98:0/118657557 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc54003aa0 0x7fbc6814c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:22:03.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.798+0000 7fbc6d2d8640 1 --2- 172.21.15.98:0/118657557 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc681565a0 0x7fbc680c65e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbc580106e0 tx=0x7fbc58010ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:03.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.798+0000 7f14ddffb640 1 --2- 172.21.15.98:0/50316275 >> [v2:172.21.15.98:6808/4125246091,v1:172.21.15.98:6809/4125246091] conn(0x7f14c0001650 0x7f14c0003b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:03.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.798+0000 7f14ddffb640 1 -- 172.21.15.98:0/50316275 --> [v2:172.21.15.98:6808/4125246091,v1:172.21.15.98:6809/4125246091] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f14c0006bb0 con 0x7f14c0001650 2024-09-17T05:22:03.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.798+0000 7f83c634a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83c014d920 0x7f83c0152ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:03.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.798+0000 7f3a6cda5640 1 --2- 172.21.15.98:0/1579807980 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a681569a0 0x7f3a680ca080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:22:03.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.798+0000 7f141988a640 1 --2- 172.21.15.98:0/3039161559 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f13f8078c60 0x7f13f807b120 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1414051c90 tx=0x7f14140a8070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:03.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.798+0000 7f141a88c640 1 --2- 172.21.15.98:0/3039161559 >> [v2:172.21.15.98:6800/1518887101,v1:172.21.15.98:6801/1518887101] conn(0x7f13f8080e80 0x7f13f80832a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:03.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.798+0000 7f83c634a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83c014d920 0x7f83c0152ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47666/0 (socket says 172.21.15.98:47666) 2024-09-17T05:22:03.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.798+0000 7f83c634a640 1 -- 172.21.15.98:0/3805815050 learned_addr learned my addr 172.21.15.98:0/3805815050 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:03.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.798+0000 7f76737fe640 1 -- 172.21.15.98:0/1347096498 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f766c0366f0 msgr2=0x7f766c04cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.798+0000 7f76737fe640 1 --2- 172.21.15.98:0/1347096498 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f766c0366f0 0x7f766c04cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.798+0000 7f76737fe640 1 -- 172.21.15.98:0/1347096498 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f766c005a60 msgr2=0x7f766c04e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.798+0000 7f76737fe640 1 --2- 172.21.15.98:0/1347096498 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f766c005a60 0x7f766c04e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.798+0000 7f76737fe640 1 -- 172.21.15.98:0/1347096498 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f766c180e90 con 0x7f766c01c890 2024-09-17T05:22:03.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.798+0000 7f14e7fff640 1 --2- 172.21.15.98:0/50316275 >> [v2:172.21.15.98:6808/4125246091,v1:172.21.15.98:6809/4125246091] conn(0x7f14c0001650 0x7f14c0003b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:03.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.799+0000 7f3a64ff9640 1 -- 172.21.15.98:0/1579807980 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3a5800b830 con 0x7f3a68157320 2024-09-17T05:22:03.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.799+0000 7f3a64ff9640 1 -- 172.21.15.98:0/1579807980 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a5800bc80 con 0x7f3a68157320 2024-09-17T05:22:03.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.799+0000 7fbc5e7fc640 1 -- 172.21.15.98:0/118657557 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc58004220 con 0x7fbc681565a0 2024-09-17T05:22:03.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.799+0000 7f46acff9640 1 -- 172.21.15.98:0/4193904244 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f469c0109e0 con 0x7f46a8005a60 2024-09-17T05:22:03.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.799+0000 7fbc5e7fc640 1 -- 172.21.15.98:0/118657557 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbc580044b0 con 0x7fbc681565a0 2024-09-17T05:22:03.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.799+0000 7fbc5e7fc640 1 -- 172.21.15.98:0/118657557 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc5800eb10 con 0x7fbc681565a0 2024-09-17T05:22:03.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.799+0000 7f76737fe640 1 --2- 172.21.15.98:0/1347096498 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f766c01c890 0x7f766c048000 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f766000c450 tx=0x7f766000c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:03.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.799+0000 7f7670ff9640 1 -- 172.21.15.98:0/1347096498 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7660007030 con 0x7f766c01c890 2024-09-17T05:22:03.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.799+0000 7f14deffd640 1 --2- 172.21.15.98:0/50316275 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f14c8078c60 0x7f14c807b120 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f14e81f69e0 tx=0x7f14d0007ef0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:03.842 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.799+0000 7fbc6fd3d640 1 -- 172.21.15.98:0/118657557 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc680b4c10 con 0x7fbc681565a0 2024-09-17T05:22:03.842 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.799+0000 7f767966b640 1 -- 172.21.15.98:0/1347096498 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f766c181170 con 0x7f766c01c890 2024-09-17T05:22:03.842 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.799+0000 7f767966b640 1 -- 172.21.15.98:0/1347096498 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f766c181730 con 0x7f766c01c890 2024-09-17T05:22:03.842 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.799+0000 7f14e7fff640 1 --2- 172.21.15.98:0/50316275 >> [v2:172.21.15.98:6808/4125246091,v1:172.21.15.98:6809/4125246091] conn(0x7f14c0001650 0x7f14c0003b10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:03.843 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.799+0000 7f7670ff9640 1 -- 172.21.15.98:0/1347096498 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f76600071f0 con 0x7f766c01c890 2024-09-17T05:22:03.843 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.799+0000 7fbc6fd3d640 1 -- 172.21.15.98:0/118657557 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc680b51d0 con 0x7fbc681565a0 2024-09-17T05:22:03.843 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.800+0000 7f46acff9640 1 --2- 172.21.15.98:0/4193904244 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f4694078c60 0x7f469407b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:03.843 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.800+0000 7f46acff9640 1 -- 172.21.15.98:0/4193904244 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f469c09c3b0 con 0x7f46a8005a60 2024-09-17T05:22:03.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.800+0000 7f3a6d5a6640 1 -- 172.21.15.98:0/1579807980 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3a48001030 con 0x7f3a68157320 2024-09-17T05:22:03.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.800+0000 7f46acff9640 1 --2- 172.21.15.98:0/4193904244 >> [v2:172.21.15.98:6824/3644101529,v1:172.21.15.98:6825/3644101529] conn(0x7f4694080ee0 0x7f4694083300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:03.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.800+0000 7f141a88c640 1 --2- 172.21.15.98:0/3039161559 >> [v2:172.21.15.98:6800/1518887101,v1:172.21.15.98:6801/1518887101] conn(0x7f13f8080e80 0x7f13f80832a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:03.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.800+0000 7f7670ff9640 1 -- 172.21.15.98:0/1347096498 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7660007640 con 0x7f766c01c890 2024-09-17T05:22:03.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.800+0000 7f0cd97fa640 1 -- 172.21.15.98:0/4068792808 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0ccc018070 con 0x7f0cdc15ec00 2024-09-17T05:22:03.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.800+0000 7f46b4d7f640 1 --2- 172.21.15.98:0/4193904244 >> [v2:172.21.15.98:6824/3644101529,v1:172.21.15.98:6825/3644101529] conn(0x7f4694080ee0 0x7f4694083300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:03.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.801+0000 7f46acff9640 1 -- 172.21.15.98:0/4193904244 --> [v2:172.21.15.98:6824/3644101529,v1:172.21.15.98:6825/3644101529] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f46940839b0 con 0x7f4694080ee0 2024-09-17T05:22:03.846 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.800+0000 7f767966b640 1 -- 172.21.15.98:0/1347096498 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7654001030 con 0x7f766c01c890 2024-09-17T05:22:03.846 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.801+0000 7f46acff9640 1 -- 172.21.15.98:0/4193904244 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f469c09c7a0 con 0x7f46a8005a60 2024-09-17T05:22:03.846 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.799+0000 7f83c5348640 1 -- 172.21.15.98:0/3805815050 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83ac004800 msgr2=0x7f83c0153540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.846 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.799+0000 7f83c5348640 1 --2- 172.21.15.98:0/3805815050 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83ac004800 0x7f83c0153540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.846 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.799+0000 7f83c5348640 1 -- 172.21.15.98:0/3805815050 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83c014d920 msgr2=0x7f83c0152ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.846 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.799+0000 7f83c5348640 1 --2- 172.21.15.98:0/3805815050 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83c014d920 0x7f83c0152ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.799+0000 7f83c5348640 1 -- 172.21.15.98:0/3805815050 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83c01f9020 con 0x7f83c014d4a0 2024-09-17T05:22:03.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.799+0000 7f83c634a640 1 --2- 172.21.15.98:0/3805815050 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83c014d920 0x7f83c0152ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:22:03.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.801+0000 7fbc4bfff640 1 -- 172.21.15.98:0/118657557 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbc44001030 con 0x7fbc681565a0 2024-09-17T05:22:03.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.801+0000 7f0cd97fa640 1 --2- 172.21.15.98:0/4068792808 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f0cc8078c60 0x7f0cc807b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:03.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.801+0000 7f83c5348640 1 --2- 172.21.15.98:0/3805815050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83c014d4a0 0x7f83c01529b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f83b0032000 tx=0x7f83b00336f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:03.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.801+0000 7f46b4d7f640 1 --2- 172.21.15.98:0/4193904244 >> [v2:172.21.15.98:6824/3644101529,v1:172.21.15.98:6825/3644101529] conn(0x7f4694080ee0 0x7f4694083300 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:03.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.801+0000 7f46af7fe640 1 --2- 172.21.15.98:0/4193904244 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f4694078c60 0x7f469407b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:03.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.801+0000 7f0ce0acf640 1 --2- 172.21.15.98:0/4068792808 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f0cc8078c60 0x7f0cc807b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:03.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.802+0000 7f0cd97fa640 1 -- 172.21.15.98:0/4068792808 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0ccc09b6d0 con 0x7f0cdc15ec00 2024-09-17T05:22:03.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.802+0000 7f14e4ff9640 1 -- 172.21.15.98:0/50316275 <== osd.3 v2:172.21.15.98:6808/4125246091 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f14c0006bb0 con 0x7f14c0001650 2024-09-17T05:22:03.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.802+0000 7f83b67fc640 1 -- 172.21.15.98:0/3805815050 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b0038040 con 0x7f83c014d4a0 2024-09-17T05:22:03.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.802+0000 7f83b67fc640 1 -- 172.21.15.98:0/3805815050 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f83b00338e0 con 0x7f83c014d4a0 2024-09-17T05:22:03.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.802+0000 7f83c6b4b640 1 -- 172.21.15.98:0/3805815050 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83c006e770 con 0x7f83c014d4a0 2024-09-17T05:22:03.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.802+0000 7f140affd640 1 -- 172.21.15.98:0/3039161559 <== osd.2 v2:172.21.15.98:6800/1518887101 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1410016ec0 con 0x7f13f8080e80 2024-09-17T05:22:03.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.802+0000 7f83c6b4b640 1 -- 172.21.15.98:0/3805815050 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83c006ed30 con 0x7f83c014d4a0 2024-09-17T05:22:03.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.802+0000 7f46acff9640 1 -- 172.21.15.98:0/4193904244 <== osd.0 v2:172.21.15.98:6824/3644101529 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f46940839b0 con 0x7f4694080ee0 2024-09-17T05:22:03.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.802+0000 7f0ce0acf640 1 --2- 172.21.15.98:0/4068792808 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f0cc8078c60 0x7f0cc807b120 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0005b60 tx=0x7f0cd0005ab0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:03.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.802+0000 7f0cd97fa640 1 --2- 172.21.15.98:0/4068792808 >> [v2:172.21.15.167:6810/765789888,v1:172.21.15.167:6811/765789888] conn(0x7f0cc8080e00 0x7f0cc8083220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:03.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.802+0000 7f0cd97fa640 1 -- 172.21.15.98:0/4068792808 --> [v2:172.21.15.167:6810/765789888,v1:172.21.15.167:6811/765789888] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0ccc003e50 con 0x7f0cc8080e00 2024-09-17T05:22:03.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.802+0000 7fbc5e7fc640 1 -- 172.21.15.98:0/118657557 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbc5800ecb0 con 0x7fbc681565a0 2024-09-17T05:22:03.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.802+0000 7f0cd97fa640 1 -- 172.21.15.98:0/4068792808 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f0ccc0a2050 con 0x7f0cdc15ec00 2024-09-17T05:22:03.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.802+0000 7f3a64ff9640 1 -- 172.21.15.98:0/1579807980 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3a580035f0 con 0x7f3a68157320 2024-09-17T05:22:03.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.802+0000 7f46af7fe640 1 --2- 172.21.15.98:0/4193904244 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f4694078c60 0x7f469407b120 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f46b00527e0 tx=0x7f46b0077000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:03.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.802+0000 7f83b67fc640 1 -- 172.21.15.98:0/3805815050 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b0033d30 con 0x7f83c014d4a0 2024-09-17T05:22:03.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.803+0000 7f83c6b4b640 1 -- 172.21.15.98:0/3805815050 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f83a8001030 con 0x7f83c014d4a0 2024-09-17T05:22:03.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.803+0000 7f3a64ff9640 1 --2- 172.21.15.98:0/1579807980 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f3a54078c60 0x7f3a5407b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:03.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.803+0000 7fbc5e7fc640 1 --2- 172.21.15.98:0/118657557 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fbc4c078c60 0x7fbc4c07b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:03.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.802+0000 7f7670ff9640 1 -- 172.21.15.98:0/1347096498 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7660011070 con 0x7f766c01c890 2024-09-17T05:22:03.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.803+0000 7f7670ff9640 1 --2- 172.21.15.98:0/1347096498 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f7658078b90 0x7f765807b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:03.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.803+0000 7fbc5e7fc640 1 -- 172.21.15.98:0/118657557 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fbc5809b490 con 0x7fbc681565a0 2024-09-17T05:22:03.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.803+0000 7f3a64ff9640 1 -- 172.21.15.98:0/1579807980 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3a5809b3f0 con 0x7f3a68157320 2024-09-17T05:22:03.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.803+0000 7f3a67fff640 1 --2- 172.21.15.98:0/1579807980 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f3a54078c60 0x7f3a5407b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:03.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.803+0000 7f3a64ff9640 1 --2- 172.21.15.98:0/1579807980 >> [v2:172.21.15.167:6818/96262631,v1:172.21.15.167:6819/96262631] conn(0x7f3a54080e80 0x7f3a540832a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:03.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.803+0000 7f7670ff9640 1 -- 172.21.15.98:0/1347096498 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f766009aa40 con 0x7f766c01c890 2024-09-17T05:22:03.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.803+0000 7f7673fff640 1 --2- 172.21.15.98:0/1347096498 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f7658078b90 0x7f765807b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:03.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.803+0000 7f7670ff9640 1 --2- 172.21.15.98:0/1347096498 >> [v2:172.21.15.98:6816/3902180920,v1:172.21.15.98:6817/3902180920] conn(0x7f7658080db0 0x7f76580831d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:03.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.803+0000 7f7670ff9640 1 -- 172.21.15.98:0/1347096498 --> [v2:172.21.15.98:6816/3902180920,v1:172.21.15.98:6817/3902180920] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f766001ee70 con 0x7f7658080db0 2024-09-17T05:22:03.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.803+0000 7f7670ff9640 1 -- 172.21.15.98:0/1347096498 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f766009ae30 con 0x7f766c01c890 2024-09-17T05:22:03.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.802+0000 7f0cdbfff640 1 --2- 172.21.15.98:0/4068792808 >> [v2:172.21.15.167:6810/765789888,v1:172.21.15.167:6811/765789888] conn(0x7f0cc8080e00 0x7f0cc8083220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:03.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.803+0000 7f3a64ff9640 1 -- 172.21.15.98:0/1579807980 --> [v2:172.21.15.167:6818/96262631,v1:172.21.15.167:6819/96262631] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3a58012ec0 con 0x7f3a54080e80 2024-09-17T05:22:03.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.803+0000 7f3a64ff9640 1 -- 172.21.15.98:0/1579807980 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f3a580a2050 con 0x7f3a68157320 2024-09-17T05:22:03.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.804+0000 7f0cdbfff640 1 --2- 172.21.15.98:0/4068792808 >> [v2:172.21.15.167:6810/765789888,v1:172.21.15.167:6811/765789888] conn(0x7f0cc8080e00 0x7f0cc8083220 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:03.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.804+0000 7f7678e6a640 1 --2- 172.21.15.98:0/1347096498 >> [v2:172.21.15.98:6816/3902180920,v1:172.21.15.98:6817/3902180920] conn(0x7f7658080db0 0x7f76580831d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:03.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.803+0000 7fbc6dad9640 1 --2- 172.21.15.98:0/118657557 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fbc4c078c60 0x7fbc4c07b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:03.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.804+0000 7fbc6dad9640 1 --2- 172.21.15.98:0/118657557 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fbc4c078c60 0x7fbc4c07b120 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbc64006ed0 tx=0x7fbc64001890 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:03.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.804+0000 7fbc5e7fc640 1 --2- 172.21.15.98:0/118657557 >> [v2:172.21.15.167:6802/2567019914,v1:172.21.15.167:6803/2567019914] conn(0x7fbc4c080ee0 0x7fbc4c083300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:03.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.804+0000 7fbc5e7fc640 1 -- 172.21.15.98:0/118657557 --> [v2:172.21.15.167:6802/2567019914,v1:172.21.15.167:6803/2567019914] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbc58005700 con 0x7fbc4c080ee0 2024-09-17T05:22:03.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.804+0000 7fbc5e7fc640 1 -- 172.21.15.98:0/118657557 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fbc580a2050 con 0x7fbc681565a0 2024-09-17T05:22:03.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.804+0000 7f3a6cda5640 1 --2- 172.21.15.98:0/1579807980 >> [v2:172.21.15.167:6818/96262631,v1:172.21.15.167:6819/96262631] conn(0x7f3a54080e80 0x7f3a540832a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:03.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.804+0000 7f7673fff640 1 --2- 172.21.15.98:0/1347096498 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f7658078b90 0x7f765807b050 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7668009b50 tx=0x7f7668009610 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:03.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.804+0000 7f3a67fff640 1 --2- 172.21.15.98:0/1579807980 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f3a54078c60 0x7f3a5407b120 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c046000 tx=0x7f3a5c004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:03.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.804+0000 7f83b67fc640 1 -- 172.21.15.98:0/3805815050 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f83b0043020 con 0x7f83c014d4a0 2024-09-17T05:22:03.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.804+0000 7f7678e6a640 1 --2- 172.21.15.98:0/1347096498 >> [v2:172.21.15.98:6816/3902180920,v1:172.21.15.98:6817/3902180920] conn(0x7f7658080db0 0x7f76580831d0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:03.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.804+0000 7fbc6e2da640 1 --2- 172.21.15.98:0/118657557 >> [v2:172.21.15.167:6802/2567019914,v1:172.21.15.167:6803/2567019914] conn(0x7fbc4c080ee0 0x7fbc4c083300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:03.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.804+0000 7f3a6cda5640 1 --2- 172.21.15.98:0/1579807980 >> [v2:172.21.15.167:6818/96262631,v1:172.21.15.167:6819/96262631] conn(0x7f3a54080e80 0x7f3a540832a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:03.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.805+0000 7f0cd97fa640 1 -- 172.21.15.98:0/4068792808 <== osd.4 v2:172.21.15.167:6810/765789888 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0ccc003e50 con 0x7f0cc8080e00 2024-09-17T05:22:03.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.805+0000 7f83b67fc640 1 --2- 172.21.15.98:0/3805815050 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f83a4078be0 0x7f83a407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:03.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.805+0000 7f83b67fc640 1 -- 172.21.15.98:0/3805815050 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f83b00bab80 con 0x7f83c014d4a0 2024-09-17T05:22:03.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.805+0000 7fbc6e2da640 1 --2- 172.21.15.98:0/118657557 >> [v2:172.21.15.167:6802/2567019914,v1:172.21.15.167:6803/2567019914] conn(0x7fbc4c080ee0 0x7fbc4c083300 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:03.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.805+0000 7f83c5b49640 1 --2- 172.21.15.98:0/3805815050 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f83a4078be0 0x7f83a407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:03.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.805+0000 7f83b67fc640 1 --2- 172.21.15.98:0/3805815050 >> [v2:172.21.15.167:6826/4169560909,v1:172.21.15.167:6827/4169560909] conn(0x7f83a4080e00 0x7f83a4083220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:03.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.805+0000 7f83b67fc640 1 -- 172.21.15.98:0/3805815050 --> [v2:172.21.15.167:6826/4169560909,v1:172.21.15.167:6827/4169560909] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f83b0004470 con 0x7f83a4080e00 2024-09-17T05:22:03.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.805+0000 7f83b67fc640 1 -- 172.21.15.98:0/3805815050 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f83b00bb060 con 0x7f83c014d4a0 2024-09-17T05:22:03.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.805+0000 7f83c634a640 1 --2- 172.21.15.98:0/3805815050 >> [v2:172.21.15.167:6826/4169560909,v1:172.21.15.167:6827/4169560909] conn(0x7f83a4080e00 0x7f83a4083220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:03.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.805+0000 7f7670ff9640 1 -- 172.21.15.98:0/1347096498 <== osd.1 v2:172.21.15.98:6816/3902180920 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f766001ee70 con 0x7f7658080db0 2024-09-17T05:22:03.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.805+0000 7f3a64ff9640 1 -- 172.21.15.98:0/1579807980 <== osd.6 v2:172.21.15.167:6818/96262631 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3a58012ec0 con 0x7f3a54080e80 2024-09-17T05:22:03.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.805+0000 7f83c5b49640 1 --2- 172.21.15.98:0/3805815050 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f83a4078be0 0x7f83a407b0a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f83bc001b40 tx=0x7f83bc001a80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:03.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.806+0000 7f83c634a640 1 --2- 172.21.15.98:0/3805815050 >> [v2:172.21.15.167:6826/4169560909,v1:172.21.15.167:6827/4169560909] conn(0x7f83a4080e00 0x7f83a4083220 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:03.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.806+0000 7fbc5e7fc640 1 -- 172.21.15.98:0/118657557 <== osd.5 v2:172.21.15.167:6802/2567019914 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbc58005700 con 0x7fbc4c080ee0 2024-09-17T05:22:03.863 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.807+0000 7f83b67fc640 1 -- 172.21.15.98:0/3805815050 <== osd.7 v2:172.21.15.167:6826/4169560909 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f83b0004470 con 0x7f83a4080e00 2024-09-17T05:22:03.863 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.832+0000 7f14ddffb640 1 -- 172.21.15.98:0/50316275 --> [v2:172.21.15.98:6808/4125246091,v1:172.21.15.98:6809/4125246091] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f14c0005c40 con 0x7f14c0001650 2024-09-17T05:22:03.864 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.832+0000 7f1408ff9640 1 -- 172.21.15.98:0/3039161559 --> [v2:172.21.15.98:6800/1518887101,v1:172.21.15.98:6801/1518887101] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f140c0e7610 con 0x7f13f8080e80 2024-09-17T05:22:03.864 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.834+0000 7f14e4ff9640 1 -- 172.21.15.98:0/50316275 <== osd.3 v2:172.21.15.98:6808/4125246091 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f14c0005c40 con 0x7f14c0001650 2024-09-17T05:22:03.864 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.834+0000 7f140affd640 1 -- 172.21.15.98:0/3039161559 <== osd.2 v2:172.21.15.98:6800/1518887101 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f140c0e7610 con 0x7f13f8080e80 2024-09-17T05:22:03.865 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.834+0000 7f14ede71640 1 -- 172.21.15.98:0/50316275 >> [v2:172.21.15.98:6808/4125246091,v1:172.21.15.98:6809/4125246091] conn(0x7f14c0001650 msgr2=0x7f14c0003b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.865 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.834+0000 7f14ede71640 1 --2- 172.21.15.98:0/50316275 >> [v2:172.21.15.98:6808/4125246091,v1:172.21.15.98:6809/4125246091] conn(0x7f14c0001650 0x7f14c0003b10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.865 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.834+0000 7f46b5580640 1 -- 172.21.15.98:0/4193904244 --> [v2:172.21.15.98:6824/3644101529,v1:172.21.15.98:6825/3644101529] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4690002dd0 con 0x7f4694080ee0 2024-09-17T05:22:03.866 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.834+0000 7f14ede71640 1 -- 172.21.15.98:0/50316275 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f14c8078c60 msgr2=0x7f14c807b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.866 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.834+0000 7f14ede71640 1 --2- 172.21.15.98:0/50316275 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f14c8078c60 0x7f14c807b120 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f14e81f69e0 tx=0x7f14d0007ef0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.866 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.834+0000 7f14ede71640 1 -- 172.21.15.98:0/50316275 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14e80b3f40 msgr2=0x7f14e80b7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.866 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.834+0000 7f14ede71640 1 --2- 172.21.15.98:0/50316275 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14e80b3f40 0x7f14e80b7270 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f14d800bd80 tx=0x7f14d800be70 comp rx=0 tx=0).stop 2024-09-17T05:22:03.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.834+0000 7f14e7fff640 1 -- 172.21.15.98:0/50316275 reap_dead start 2024-09-17T05:22:03.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.835+0000 7f14ede71640 1 -- 172.21.15.98:0/50316275 shutdown_connections 2024-09-17T05:22:03.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.835+0000 7f14ede71640 1 -- 172.21.15.98:0/50316275 >> 172.21.15.98:0/50316275 conn(0x7f14e80d3fc0 msgr2=0x7f14e80d0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:03.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.835+0000 7f46acff9640 1 -- 172.21.15.98:0/4193904244 <== osd.0 v2:172.21.15.98:6824/3644101529 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4690002dd0 con 0x7f4694080ee0 2024-09-17T05:22:03.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.835+0000 7f1408ff9640 1 -- 172.21.15.98:0/3039161559 >> [v2:172.21.15.98:6800/1518887101,v1:172.21.15.98:6801/1518887101] conn(0x7f13f8080e80 msgr2=0x7f13f80832a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.835+0000 7f1408ff9640 1 --2- 172.21.15.98:0/3039161559 >> [v2:172.21.15.98:6800/1518887101,v1:172.21.15.98:6801/1518887101] conn(0x7f13f8080e80 0x7f13f80832a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.835+0000 7f0cc2ffd640 1 -- 172.21.15.98:0/4068792808 --> [v2:172.21.15.167:6810/765789888,v1:172.21.15.167:6811/765789888] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0cbc002dd0 con 0x7f0cc8080e00 2024-09-17T05:22:03.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.835+0000 7f1408ff9640 1 -- 172.21.15.98:0/3039161559 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f13f8078c60 msgr2=0x7f13f807b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.835+0000 7f1408ff9640 1 --2- 172.21.15.98:0/3039161559 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f13f8078c60 0x7f13f807b120 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1414051c90 tx=0x7f14140a8070 comp rx=0 tx=0).stop 2024-09-17T05:22:03.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.835+0000 7f1408ff9640 1 -- 172.21.15.98:0/3039161559 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f140c04eb20 msgr2=0x7f140c0e3c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.835+0000 7f1408ff9640 1 --2- 172.21.15.98:0/3039161559 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f140c04eb20 0x7f140c0e3c10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f141000c3f0 tx=0x7f141000c8b0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.834+0000 7f767966b640 1 -- 172.21.15.98:0/1347096498 --> [v2:172.21.15.98:6816/3902180920,v1:172.21.15.98:6817/3902180920] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7654002dd0 con 0x7f7658080db0 2024-09-17T05:22:03.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.835+0000 7f7670ff9640 1 -- 172.21.15.98:0/1347096498 <== osd.1 v2:172.21.15.98:6816/3902180920 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7654002dd0 con 0x7f7658080db0 2024-09-17T05:22:03.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.835+0000 7f141a88c640 1 -- 172.21.15.98:0/3039161559 reap_dead start 2024-09-17T05:22:03.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.835+0000 7f1408ff9640 1 -- 172.21.15.98:0/3039161559 shutdown_connections 2024-09-17T05:22:03.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.835+0000 7f14ede71640 1 -- 172.21.15.98:0/50316275 shutdown_connections 2024-09-17T05:22:03.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.835+0000 7f14ede71640 1 -- 172.21.15.98:0/50316275 wait complete. 2024-09-17T05:22:03.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.835+0000 7f767966b640 1 -- 172.21.15.98:0/1347096498 >> [v2:172.21.15.98:6816/3902180920,v1:172.21.15.98:6817/3902180920] conn(0x7f7658080db0 msgr2=0x7f76580831d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.835+0000 7f0cd97fa640 1 -- 172.21.15.98:0/4068792808 <== osd.4 v2:172.21.15.167:6810/765789888 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0cbc002dd0 con 0x7f0cc8080e00 2024-09-17T05:22:03.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.835+0000 7f767966b640 1 --2- 172.21.15.98:0/1347096498 >> [v2:172.21.15.98:6816/3902180920,v1:172.21.15.98:6817/3902180920] conn(0x7f7658080db0 0x7f76580831d0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.835+0000 7f767966b640 1 -- 172.21.15.98:0/1347096498 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f7658078b90 msgr2=0x7f765807b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.835+0000 7f767966b640 1 --2- 172.21.15.98:0/1347096498 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f7658078b90 0x7f765807b050 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7668009b50 tx=0x7f7668009610 comp rx=0 tx=0).stop 2024-09-17T05:22:03.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.836+0000 7f767966b640 1 -- 172.21.15.98:0/1347096498 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f766c01c890 msgr2=0x7f766c048000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.836+0000 7f767966b640 1 --2- 172.21.15.98:0/1347096498 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f766c01c890 0x7f766c048000 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f766000c450 tx=0x7f766000c910 comp rx=0 tx=0).stop 2024-09-17T05:22:03.874 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.835+0000 7f1408ff9640 1 -- 172.21.15.98:0/3039161559 >> 172.21.15.98:0/3039161559 conn(0x7f140c01d770 msgr2=0x7f140c052f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:03.874 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.836+0000 7f7678e6a640 1 -- 172.21.15.98:0/1347096498 reap_dead start 2024-09-17T05:22:03.874 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.836+0000 7f1408ff9640 1 -- 172.21.15.98:0/3039161559 shutdown_connections 2024-09-17T05:22:03.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.836+0000 7f767966b640 1 -- 172.21.15.98:0/1347096498 shutdown_connections 2024-09-17T05:22:03.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.836+0000 7f767966b640 1 -- 172.21.15.98:0/1347096498 >> 172.21.15.98:0/1347096498 conn(0x7f766c054560 msgr2=0x7f766c053920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:03.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.836+0000 7f1408ff9640 1 -- 172.21.15.98:0/3039161559 wait complete. 2024-09-17T05:22:03.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.836+0000 7f0cc2ffd640 1 -- 172.21.15.98:0/4068792808 >> [v2:172.21.15.167:6810/765789888,v1:172.21.15.167:6811/765789888] conn(0x7f0cc8080e00 msgr2=0x7f0cc8083220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.836+0000 7f0cc2ffd640 1 --2- 172.21.15.98:0/4068792808 >> [v2:172.21.15.167:6810/765789888,v1:172.21.15.167:6811/765789888] conn(0x7f0cc8080e00 0x7f0cc8083220 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.876 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.836+0000 7f767966b640 1 -- 172.21.15.98:0/1347096498 shutdown_connections 2024-09-17T05:22:03.876 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.836+0000 7f767966b640 1 -- 172.21.15.98:0/1347096498 wait complete. 2024-09-17T05:22:03.877 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.836+0000 7f46b5580640 1 -- 172.21.15.98:0/4193904244 >> [v2:172.21.15.98:6824/3644101529,v1:172.21.15.98:6825/3644101529] conn(0x7f4694080ee0 msgr2=0x7f4694083300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.877 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.836+0000 7f46b5580640 1 --2- 172.21.15.98:0/4193904244 >> [v2:172.21.15.98:6824/3644101529,v1:172.21.15.98:6825/3644101529] conn(0x7f4694080ee0 0x7f4694083300 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.877 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.836+0000 7f46b5580640 1 -- 172.21.15.98:0/4193904244 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f4694078c60 msgr2=0x7f469407b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.877 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.836+0000 7f46b5580640 1 --2- 172.21.15.98:0/4193904244 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f4694078c60 0x7f469407b120 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f46b00527e0 tx=0x7f46b0077000 comp rx=0 tx=0).stop 2024-09-17T05:22:03.877 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.836+0000 7f46b5580640 1 -- 172.21.15.98:0/4193904244 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46a8005a60 msgr2=0x7f46a8046e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.877 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.836+0000 7f46b5580640 1 --2- 172.21.15.98:0/4193904244 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46a8005a60 0x7f46a8046e50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f469c00ea20 tx=0x7f469c00eee0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.877 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.836+0000 7f46b4d7f640 1 -- 172.21.15.98:0/4193904244 reap_dead start 2024-09-17T05:22:03.877 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.836+0000 7f0cc2ffd640 1 -- 172.21.15.98:0/4068792808 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f0cc8078c60 msgr2=0x7f0cc807b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.877 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.836+0000 7f0cc2ffd640 1 --2- 172.21.15.98:0/4068792808 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f0cc8078c60 0x7f0cc807b120 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0005b60 tx=0x7f0cd0005ab0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.878 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.836+0000 7f3a6d5a6640 1 -- 172.21.15.98:0/1579807980 --> [v2:172.21.15.167:6818/96262631,v1:172.21.15.167:6819/96262631] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3a48002dd0 con 0x7f3a54080e80 2024-09-17T05:22:03.878 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.836+0000 7f0cc2ffd640 1 -- 172.21.15.98:0/4068792808 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0cdc15ec00 msgr2=0x7f0cdc0b6e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.878 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.836+0000 7f0cc2ffd640 1 --2- 172.21.15.98:0/4068792808 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0cdc15ec00 0x7f0cdc0b6e10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc08d420 tx=0x7f0ccc001800 comp rx=0 tx=0).stop 2024-09-17T05:22:03.878 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.836+0000 7f0ce12d0640 1 -- 172.21.15.98:0/4068792808 reap_dead start 2024-09-17T05:22:03.879 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.837+0000 7f3a64ff9640 1 -- 172.21.15.98:0/1579807980 <== osd.6 v2:172.21.15.167:6818/96262631 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3a48002dd0 con 0x7f3a54080e80 2024-09-17T05:22:03.879 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.837+0000 7f0cc2ffd640 1 -- 172.21.15.98:0/4068792808 shutdown_connections 2024-09-17T05:22:03.879 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.837+0000 7f0cc2ffd640 1 -- 172.21.15.98:0/4068792808 >> 172.21.15.98:0/4068792808 conn(0x7f0cdc0d3fe0 msgr2=0x7f0cdc0b2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:03.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.837+0000 7f46b5580640 1 -- 172.21.15.98:0/4193904244 shutdown_connections 2024-09-17T05:22:03.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.837+0000 7f46b5580640 1 -- 172.21.15.98:0/4193904244 >> 172.21.15.98:0/4193904244 conn(0x7f46a8054560 msgr2=0x7f46a8053550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:03.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.837+0000 7f46b5580640 1 -- 172.21.15.98:0/4193904244 shutdown_connections 2024-09-17T05:22:03.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.837+0000 7f46b5580640 1 -- 172.21.15.98:0/4193904244 wait complete. 2024-09-17T05:22:03.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.837+0000 7f0cc2ffd640 1 -- 172.21.15.98:0/4068792808 shutdown_connections 2024-09-17T05:22:03.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.837+0000 7f83c6b4b640 1 -- 172.21.15.98:0/3805815050 --> [v2:172.21.15.167:6826/4169560909,v1:172.21.15.167:6827/4169560909] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f83a8002dd0 con 0x7f83a4080e00 2024-09-17T05:22:03.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.837+0000 7f3a6d5a6640 1 -- 172.21.15.98:0/1579807980 >> [v2:172.21.15.167:6818/96262631,v1:172.21.15.167:6819/96262631] conn(0x7f3a54080e80 msgr2=0x7f3a540832a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.837+0000 7f3a6d5a6640 1 --2- 172.21.15.98:0/1579807980 >> [v2:172.21.15.167:6818/96262631,v1:172.21.15.167:6819/96262631] conn(0x7f3a54080e80 0x7f3a540832a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.837+0000 7f3a6d5a6640 1 -- 172.21.15.98:0/1579807980 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f3a54078c60 msgr2=0x7f3a5407b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.837+0000 7f3a6d5a6640 1 --2- 172.21.15.98:0/1579807980 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f3a54078c60 0x7f3a5407b120 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c046000 tx=0x7f3a5c004730 comp rx=0 tx=0).stop 2024-09-17T05:22:03.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.837+0000 7f3a6d5a6640 1 -- 172.21.15.98:0/1579807980 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3a68157320 msgr2=0x7f3a680c7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.837+0000 7f3a6d5a6640 1 --2- 172.21.15.98:0/1579807980 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3a68157320 0x7f3a680c7860 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3a6806aa30 tx=0x7f3a5800dd80 comp rx=0 tx=0).stop 2024-09-17T05:22:03.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.837+0000 7f3a6cda5640 1 -- 172.21.15.98:0/1579807980 reap_dead start 2024-09-17T05:22:03.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.837+0000 7f3a6d5a6640 1 -- 172.21.15.98:0/1579807980 shutdown_connections 2024-09-17T05:22:03.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.837+0000 7f3a6d5a6640 1 -- 172.21.15.98:0/1579807980 >> 172.21.15.98:0/1579807980 conn(0x7f3a680d3dc0 msgr2=0x7f3a6815b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:03.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.838+0000 7f0cc2ffd640 1 -- 172.21.15.98:0/4068792808 wait complete. 2024-09-17T05:22:03.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.838+0000 7fbc4bfff640 1 -- 172.21.15.98:0/118657557 --> [v2:172.21.15.167:6802/2567019914,v1:172.21.15.167:6803/2567019914] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbc44002dd0 con 0x7fbc4c080ee0 2024-09-17T05:22:03.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.838+0000 7f83b67fc640 1 -- 172.21.15.98:0/3805815050 <== osd.7 v2:172.21.15.167:6826/4169560909 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f83a8002dd0 con 0x7f83a4080e00 2024-09-17T05:22:03.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.838+0000 7f3a6d5a6640 1 -- 172.21.15.98:0/1579807980 shutdown_connections 2024-09-17T05:22:03.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.838+0000 7f3a6d5a6640 1 -- 172.21.15.98:0/1579807980 wait complete. 2024-09-17T05:22:03.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.838+0000 7fbc5e7fc640 1 -- 172.21.15.98:0/118657557 <== osd.5 v2:172.21.15.167:6802/2567019914 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fbc44002dd0 con 0x7fbc4c080ee0 2024-09-17T05:22:03.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.838+0000 7f83c6b4b640 1 -- 172.21.15.98:0/3805815050 >> [v2:172.21.15.167:6826/4169560909,v1:172.21.15.167:6827/4169560909] conn(0x7f83a4080e00 msgr2=0x7f83a4083220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.838+0000 7f83c6b4b640 1 --2- 172.21.15.98:0/3805815050 >> [v2:172.21.15.167:6826/4169560909,v1:172.21.15.167:6827/4169560909] conn(0x7f83a4080e00 0x7f83a4083220 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.839+0000 7f83c6b4b640 1 -- 172.21.15.98:0/3805815050 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f83a4078be0 msgr2=0x7f83a407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.839+0000 7f83c6b4b640 1 --2- 172.21.15.98:0/3805815050 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f83a4078be0 0x7f83a407b0a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f83bc001b40 tx=0x7f83bc001a80 comp rx=0 tx=0).stop 2024-09-17T05:22:03.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.839+0000 7f83c6b4b640 1 -- 172.21.15.98:0/3805815050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83c014d4a0 msgr2=0x7f83c01529b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.839+0000 7f83c6b4b640 1 --2- 172.21.15.98:0/3805815050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83c014d4a0 0x7f83c01529b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f83b0032000 tx=0x7f83b00336f0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.839+0000 7f83c634a640 1 -- 172.21.15.98:0/3805815050 reap_dead start 2024-09-17T05:22:03.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.839+0000 7f83c6b4b640 1 -- 172.21.15.98:0/3805815050 shutdown_connections 2024-09-17T05:22:03.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.839+0000 7f83c6b4b640 1 -- 172.21.15.98:0/3805815050 >> 172.21.15.98:0/3805815050 conn(0x7f83c00b15f0 msgr2=0x7f83c015f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:03.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.842+0000 7f83c6b4b640 1 -- 172.21.15.98:0/3805815050 shutdown_connections 2024-09-17T05:22:03.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.842+0000 7fbc4bfff640 1 -- 172.21.15.98:0/118657557 >> [v2:172.21.15.167:6802/2567019914,v1:172.21.15.167:6803/2567019914] conn(0x7fbc4c080ee0 msgr2=0x7fbc4c083300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.842+0000 7f83c6b4b640 1 -- 172.21.15.98:0/3805815050 wait complete. 2024-09-17T05:22:03.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.842+0000 7fbc4bfff640 1 --2- 172.21.15.98:0/118657557 >> [v2:172.21.15.167:6802/2567019914,v1:172.21.15.167:6803/2567019914] conn(0x7fbc4c080ee0 0x7fbc4c083300 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.842+0000 7fbc4bfff640 1 -- 172.21.15.98:0/118657557 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fbc4c078c60 msgr2=0x7fbc4c07b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.842+0000 7fbc4bfff640 1 --2- 172.21.15.98:0/118657557 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fbc4c078c60 0x7fbc4c07b120 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbc64006ed0 tx=0x7fbc64001890 comp rx=0 tx=0).stop 2024-09-17T05:22:03.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.842+0000 7fbc4bfff640 1 -- 172.21.15.98:0/118657557 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc681565a0 msgr2=0x7fbc680c65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.889 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.842+0000 7fbc4bfff640 1 --2- 172.21.15.98:0/118657557 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc681565a0 0x7fbc680c65e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbc580106e0 tx=0x7fbc58010ba0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.889 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.842+0000 7fbc6e2da640 1 -- 172.21.15.98:0/118657557 reap_dead start 2024-09-17T05:22:03.889 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.842+0000 7fbc4bfff640 1 -- 172.21.15.98:0/118657557 shutdown_connections 2024-09-17T05:22:03.889 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.842+0000 7fbc4bfff640 1 -- 172.21.15.98:0/118657557 >> 172.21.15.98:0/118657557 conn(0x7fbc680b2670 msgr2=0x7fbc6815a100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:03.889 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.842+0000 7fbc4bfff640 1 -- 172.21.15.98:0/118657557 shutdown_connections 2024-09-17T05:22:03.889 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:03.842+0000 7fbc4bfff640 1 -- 172.21.15.98:0/118657557 wait complete. 2024-09-17T05:22:03.890 INFO:teuthology.orchestra.run.smithi098.stdout:64424509449 2024-09-17T05:22:03.890 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-17T05:22:03.891 INFO:teuthology.orchestra.run.smithi098.stdout:64424509449 2024-09-17T05:22:03.891 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-17T05:22:03.892 INFO:teuthology.orchestra.run.smithi098.stdout:55834574854 2024-09-17T05:22:03.892 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-17T05:22:03.893 INFO:teuthology.orchestra.run.smithi098.stdout:64424509449 2024-09-17T05:22:03.894 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-17T05:22:03.894 INFO:teuthology.orchestra.run.smithi098.stdout:60129542152 2024-09-17T05:22:03.895 INFO:teuthology.orchestra.run.smithi098.stdout:60129542151 2024-09-17T05:22:03.895 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-17T05:22:03.896 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-17T05:22:03.897 INFO:teuthology.orchestra.run.smithi098.stdout:60129542152 2024-09-17T05:22:03.897 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-17T05:22:03.898 INFO:teuthology.orchestra.run.smithi098.stdout:60129542151 2024-09-17T05:22:03.898 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-17T05:22:04.101 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.099+0000 7f5cfdffb640 1 -- 172.21.15.98:0/450188683 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf802bd60 con 0x7f5d000b4840 2024-09-17T05:22:04.101 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.099+0000 7f5d05403640 1 -- 172.21.15.98:0/450188683 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d000b4840 msgr2=0x7f5d0006fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:04.101 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.099+0000 7f5d05403640 1 --2- 172.21.15.98:0/450188683 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d000b4840 0x7f5d0006fdb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5d000749b0 tx=0x7f5cf802acc0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.101 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.099+0000 7f5d05403640 1 -- 172.21.15.98:0/450188683 shutdown_connections 2024-09-17T05:22:04.101 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.099+0000 7f5d05403640 1 --2- 172.21.15.98:0/450188683 >> v2:172.21.15.167:3300/0 conn(0x7f5d00073540 0x7f5d00073990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.101 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.099+0000 7f5d05403640 1 --2- 172.21.15.98:0/450188683 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d000b2960 0x7f5d000b2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.101 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.099+0000 7f5d05403640 1 --2- 172.21.15.98:0/450188683 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d000b4840 0x7f5d0006fdb0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.102 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.099+0000 7f5d05403640 1 -- 172.21.15.98:0/450188683 >> 172.21.15.98:0/450188683 conn(0x7f5d0006cb70 msgr2=0x7f5d0006cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:04.102 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.099+0000 7f5d05403640 1 -- 172.21.15.98:0/450188683 shutdown_connections 2024-09-17T05:22:04.102 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.099+0000 7f5d05403640 1 -- 172.21.15.98:0/450188683 wait complete. 2024-09-17T05:22:04.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.101+0000 7f5d05403640 1 Processor -- start 2024-09-17T05:22:04.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.101+0000 7f5d05403640 1 -- start start 2024-09-17T05:22:04.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.102+0000 7f221abd3640 1 -- 172.21.15.98:0/3517757224 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22140d1b70 msgr2=0x7f22140d2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:04.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.102+0000 7f221abd3640 1 --2- 172.21.15.98:0/3517757224 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22140d1b70 0x7f22140d2560 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f22140d4ff0 tx=0x7f220c02aa30 comp rx=0 tx=0).stop 2024-09-17T05:22:04.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.102+0000 7f221abd3640 1 -- 172.21.15.98:0/3517757224 shutdown_connections 2024-09-17T05:22:04.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.102+0000 7f221abd3640 1 --2- 172.21.15.98:0/3517757224 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22140d1b70 0x7f22140d2560 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.102+0000 7f221abd3640 1 --2- 172.21.15.98:0/3517757224 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22140d2aa0 0x7f22140d0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.102+0000 7f221abd3640 1 --2- 172.21.15.98:0/3517757224 >> v2:172.21.15.98:3300/0 conn(0x7f221415e1b0 0x7f22140d2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.102+0000 7fafb4be1640 1 -- 172.21.15.98:0/1215421627 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb00710d0 con 0x7fafa80366f0 2024-09-17T05:22:04.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.103+0000 7fafb6be5640 1 -- 172.21.15.98:0/1215421627 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafa80366f0 msgr2=0x7fafa80e98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:04.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.103+0000 7f5d05403640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d00073540 0x7f5d001583f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:04.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.103+0000 7fafb6be5640 1 --2- 172.21.15.98:0/1215421627 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafa80366f0 0x7fafa80e98b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fafb006c230 tx=0x7fafb00a9e50 comp rx=0 tx=0).stop 2024-09-17T05:22:04.106 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.103+0000 7f5d05403640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d000b2960 0x7f5d00157da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:04.106 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.103+0000 7fafb6be5640 1 -- 172.21.15.98:0/1215421627 shutdown_connections 2024-09-17T05:22:04.106 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.103+0000 7fafb6be5640 1 --2- 172.21.15.98:0/1215421627 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafa80366f0 0x7fafa80e98b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.106 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.103+0000 7fafb6be5640 1 -- 172.21.15.98:0/1215421627 >> 172.21.15.98:0/1215421627 conn(0x7fafa8054560 msgr2=0x7fafa8054940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:04.106 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.103+0000 7f5d05403640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d000b4840 0x7f5d0008a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:04.107 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.103+0000 7f221abd3640 1 -- 172.21.15.98:0/3517757224 >> 172.21.15.98:0/3517757224 conn(0x7f22140d3fa0 msgr2=0x7f22140d43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:04.107 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.103+0000 7fafb6be5640 1 -- 172.21.15.98:0/1215421627 shutdown_connections 2024-09-17T05:22:04.107 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.103+0000 7f5cfeffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d00073540 0x7f5d001583f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:04.108 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.103+0000 7fafb6be5640 1 -- 172.21.15.98:0/1215421627 wait complete. 2024-09-17T05:22:04.109 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.103+0000 7f5d05403640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5d0016ad80 con 0x7f5d00073540 2024-09-17T05:22:04.109 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.103+0000 7f5cfeffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d00073540 0x7f5d001583f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47744/0 (socket says 172.21.15.98:47744) 2024-09-17T05:22:04.109 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.103+0000 7f5cfeffd640 1 -- 172.21.15.98:0/2775185832 learned_addr learned my addr 172.21.15.98:0/2775185832 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:04.109 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.103+0000 7f5cfe7fc640 1 --2- 172.21.15.98:0/2775185832 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d000b2960 0x7f5d00157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:04.109 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.103+0000 7f5d05403640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5d0016f070 con 0x7f5d000b4840 2024-09-17T05:22:04.109 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.103+0000 7f5d05403640 1 -- 172.21.15.98:0/2775185832 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f5d0016af00 con 0x7f5d000b2960 2024-09-17T05:22:04.110 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.104+0000 7f5cff7fe640 1 --2- 172.21.15.98:0/2775185832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d000b4840 0x7f5d0008a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:04.110 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.104+0000 7f207d59a640 1 -- 172.21.15.98:0/595015403 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2078004020 con 0x7f2068004800 2024-09-17T05:22:04.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.104+0000 7f2084f64640 1 -- 172.21.15.98:0/595015403 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2068004800 msgr2=0x7f2068004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:04.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.104+0000 7f2084f64640 1 --2- 172.21.15.98:0/595015403 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2068004800 0x7f2068004c80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2080070850 tx=0x7f2068005830 comp rx=0 tx=0).stop 2024-09-17T05:22:04.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.104+0000 7f207ed9d640 1 -- 172.21.15.98:0/595015403 reap_dead start 2024-09-17T05:22:04.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.104+0000 7f5cfeffd640 1 -- 172.21.15.98:0/2775185832 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d000b2960 msgr2=0x7f5d00157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:04.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.104+0000 7f5cfeffd640 1 --2- 172.21.15.98:0/2775185832 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d000b2960 0x7f5d00157da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.104+0000 7f5cfeffd640 1 -- 172.21.15.98:0/2775185832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d000b4840 msgr2=0x7f5d0008a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:04.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.104+0000 7f5cfeffd640 1 --2- 172.21.15.98:0/2775185832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d000b4840 0x7f5d0008a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.104+0000 7f5cfeffd640 1 -- 172.21.15.98:0/2775185832 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d002090c0 con 0x7f5d00073540 2024-09-17T05:22:04.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.104+0000 7f221abd3640 1 -- 172.21.15.98:0/3517757224 shutdown_connections 2024-09-17T05:22:04.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.104+0000 7f221abd3640 1 -- 172.21.15.98:0/3517757224 wait complete. 2024-09-17T05:22:04.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.104+0000 7f2084f64640 1 -- 172.21.15.98:0/595015403 shutdown_connections 2024-09-17T05:22:04.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.104+0000 7f2084f64640 1 -- 172.21.15.98:0/595015403 >> 172.21.15.98:0/595015403 conn(0x7f20800b1950 msgr2=0x7f20800b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:04.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.104+0000 7f5cfeffd640 1 --2- 172.21.15.98:0/2775185832 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d00073540 0x7f5d001583f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8009e50 tx=0x7f5cf8003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:04.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.105+0000 7f2084f64640 1 -- 172.21.15.98:0/595015403 shutdown_connections 2024-09-17T05:22:04.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.104+0000 7fc7be7fc640 1 -- 172.21.15.98:0/3526243498 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b8036400 con 0x7fc7c0161ce0 2024-09-17T05:22:04.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.105+0000 7fc7c5c01640 1 -- 172.21.15.98:0/3526243498 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7c0161ce0 msgr2=0x7fc7c01620c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:04.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.105+0000 7fc7c5c01640 1 --2- 172.21.15.98:0/3526243498 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7c0161ce0 0x7fc7c01620c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8005fd0 tx=0x7fc7b802aaa0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.105+0000 7fafb6be5640 1 Processor -- start 2024-09-17T05:22:04.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.105+0000 7fafb6be5640 1 -- start start 2024-09-17T05:22:04.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.105+0000 7f5ce77fe640 1 -- 172.21.15.98:0/2775185832 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf8041020 con 0x7f5d00073540 2024-09-17T05:22:04.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.105+0000 7f5d05403640 1 -- 172.21.15.98:0/2775185832 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d002093a0 con 0x7f5d00073540 2024-09-17T05:22:04.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.105+0000 7f5d05403640 1 -- 172.21.15.98:0/2775185832 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d00209960 con 0x7f5d00073540 2024-09-17T05:22:04.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.105+0000 7fc7c5c01640 1 -- 172.21.15.98:0/3526243498 shutdown_connections 2024-09-17T05:22:04.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.105+0000 7fc7c5c01640 1 --2- 172.21.15.98:0/3526243498 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc7c0162600 0x7fc7c015c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.105+0000 7fc7c5c01640 1 --2- 172.21.15.98:0/3526243498 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7c0161ce0 0x7fc7c01620c0 secure :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8005fd0 tx=0x7fc7b802aaa0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.105+0000 7fc7c5c01640 1 -- 172.21.15.98:0/3526243498 >> 172.21.15.98:0/3526243498 conn(0x7fc7c00d1d80 msgr2=0x7fc7c00d2190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:04.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.106+0000 7fc7c5c01640 1 -- 172.21.15.98:0/3526243498 shutdown_connections 2024-09-17T05:22:04.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.105+0000 7f2084f64640 1 -- 172.21.15.98:0/595015403 wait complete. 2024-09-17T05:22:04.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.106+0000 7f221abd3640 1 Processor -- start 2024-09-17T05:22:04.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.106+0000 7f221abd3640 1 -- start start 2024-09-17T05:22:04.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.107+0000 7f2084f64640 1 Processor -- start 2024-09-17T05:22:04.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.107+0000 7fafb6be5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fafa8005a60 0x7fafa80db580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:04.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.107+0000 7fafb6be5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fafa801c890 0x7fafa80dc350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:04.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.107+0000 7fafb6be5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafa80366f0 0x7fafa80dc890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:04.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.107+0000 7f2084f64640 1 -- start start 2024-09-17T05:22:04.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.107+0000 7fafb6be5640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fafa800ac70 con 0x7fafa80366f0 2024-09-17T05:22:04.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.107+0000 7fafb6be5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fafa801d380 con 0x7fafa801c890 2024-09-17T05:22:04.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.107+0000 7fafb6be5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fafa80e9df0 con 0x7fafa8005a60 2024-09-17T05:22:04.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.107+0000 7fafb53e2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fafa801c890 0x7fafa80dc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:04.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.107+0000 7fafb53e2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fafa801c890 0x7fafa80dc350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.98:45636/0 (socket says 172.21.15.98:45636) 2024-09-17T05:22:04.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.107+0000 7fafb53e2640 1 -- 172.21.15.98:0/1060152526 learned_addr learned my addr 172.21.15.98:0/1060152526 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:04.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.107+0000 7fafb5be3640 1 --2- 172.21.15.98:0/1060152526 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fafa8005a60 0x7fafa80db580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:04.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.106+0000 7f5ce77fe640 1 -- 172.21.15.98:0/2775185832 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5cf802bd70 con 0x7f5d00073540 2024-09-17T05:22:04.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.106+0000 7f5ce77fe640 1 -- 172.21.15.98:0/2775185832 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf8041020 con 0x7f5d00073540 2024-09-17T05:22:04.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.107+0000 7f5d05403640 1 -- 172.21.15.98:0/2775185832 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ce0005290 con 0x7f5d00073540 2024-09-17T05:22:04.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.106+0000 7fc7c5c01640 1 -- 172.21.15.98:0/3526243498 wait complete. 2024-09-17T05:22:04.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.107+0000 7f9a667fc640 1 -- 172.21.15.98:0/1160999557 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a58032a90 con 0x7f9a680b3ab0 2024-09-17T05:22:04.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.108+0000 7f265bfff640 1 -- 172.21.15.98:0/2472889491 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f265c02fe30 con 0x7f26640d2050 2024-09-17T05:22:04.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.108+0000 7fc7c5c01640 1 Processor -- start 2024-09-17T05:22:04.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.108+0000 7f2084f64640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2080140c70 0x7f208009b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:04.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.108+0000 7f9a6dd5d640 1 -- 172.21.15.98:0/1160999557 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a680b3ab0 msgr2=0x7f9a68161b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:04.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.108+0000 7f9a6dd5d640 1 --2- 172.21.15.98:0/1160999557 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a680b3ab0 0x7f9a68161b60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9a58005fd0 tx=0x7f9a5802a830 comp rx=0 tx=0).stop 2024-09-17T05:22:04.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.108+0000 7f9a6dd5d640 1 -- 172.21.15.98:0/1160999557 shutdown_connections 2024-09-17T05:22:04.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.108+0000 7f9a6dd5d640 1 --2- 172.21.15.98:0/1160999557 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9a681620a0 0x7f9a6806e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.108+0000 7f9a6dd5d640 1 --2- 172.21.15.98:0/1160999557 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a680b3ab0 0x7f9a68161b60 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.108+0000 7f9a6dd5d640 1 -- 172.21.15.98:0/1160999557 >> 172.21.15.98:0/1160999557 conn(0x7f9a680b1950 msgr2=0x7f9a680b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:04.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.108+0000 7fafb63e4640 1 --2- 172.21.15.98:0/1060152526 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafa80366f0 0x7fafa80dc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:04.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.108+0000 7f2084f64640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20801f42a0 0x7f20800add00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:04.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.108+0000 7f2084f64640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f20801f4720 0x7f20800ae240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:04.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.108+0000 7fc7c5c01640 1 -- start start 2024-09-17T05:22:04.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.108+0000 7f2084f64640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2080070aa0 con 0x7f20801f4720 2024-09-17T05:22:04.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.108+0000 7f2084f64640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2080070920 con 0x7f20801f42a0 2024-09-17T05:22:04.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.108+0000 7f2084f64640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f208006f850 con 0x7f2080140c70 2024-09-17T05:22:04.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.108+0000 7fafb63e4640 1 -- 172.21.15.98:0/1060152526 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fafa8005a60 msgr2=0x7fafa80db580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:04.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.108+0000 7f221abd3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22140d1b70 0x7f22140c9a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:04.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.108+0000 7f221abd3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22140d2aa0 0x7f22141f3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:04.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.108+0000 7f221abd3640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f221415e1b0 0x7f22141f4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:04.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.108+0000 7f221abd3640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f22140d1020 con 0x7f22140d1b70 2024-09-17T05:22:04.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.108+0000 7f221abd3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f22140d0ea0 con 0x7f22140d2aa0 2024-09-17T05:22:04.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.108+0000 7f221abd3640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f22140d11a0 con 0x7f221415e1b0 2024-09-17T05:22:04.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.108+0000 7fafb63e4640 1 --2- 172.21.15.98:0/1060152526 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fafa8005a60 0x7fafa80db580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.109+0000 7f207dd9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20801f42a0 0x7f20800add00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:04.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.109+0000 7f207dd9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20801f42a0 0x7f20800add00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.98:45654/0 (socket says 172.21.15.98:45654) 2024-09-17T05:22:04.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.108+0000 7fafb63e4640 1 -- 172.21.15.98:0/1060152526 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fafa801c890 msgr2=0x7fafa80dc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:04.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.108+0000 7fafb63e4640 1 --2- 172.21.15.98:0/1060152526 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fafa801c890 0x7fafa80dc350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.108+0000 7fafb63e4640 1 -- 172.21.15.98:0/1060152526 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafa8022180 con 0x7fafa80366f0 2024-09-17T05:22:04.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.108+0000 7fafb63e4640 1 --2- 172.21.15.98:0/1060152526 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafa80366f0 0x7fafa80dc890 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fafb0069f40 tx=0x7fafb00aaa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:04.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.109+0000 7f2213fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22140d2aa0 0x7f22141f3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:04.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.109+0000 7f2213fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22140d2aa0 0x7f22141f3c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.98:45646/0 (socket says 172.21.15.98:45646) 2024-09-17T05:22:04.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.109+0000 7f2213fff640 1 -- 172.21.15.98:0/2258394454 learned_addr learned my addr 172.21.15.98:0/2258394454 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:04.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.108+0000 7f266b80c640 1 -- 172.21.15.98:0/2472889491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f26640d2050 msgr2=0x7f26640d0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:04.127 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.109+0000 7f266b80c640 1 --2- 172.21.15.98:0/2472889491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f26640d2050 0x7f26640d0f00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f26640ba010 tx=0x7f265c02aa50 comp rx=0 tx=0).stop 2024-09-17T05:22:04.127 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.109+0000 7f207dd9b640 1 -- 172.21.15.98:0/1634644383 learned_addr learned my addr 172.21.15.98:0/1634644383 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:04.127 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.109+0000 7f207e59c640 1 --2- 172.21.15.98:0/1634644383 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2080140c70 0x7f208009b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:04.127 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.109+0000 7f266b80c640 1 -- 172.21.15.98:0/2472889491 shutdown_connections 2024-09-17T05:22:04.127 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.109+0000 7f266b80c640 1 --2- 172.21.15.98:0/2472889491 >> v2:172.21.15.167:3300/0 conn(0x7f26640d1440 0x7f266415e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.128 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.109+0000 7f266b80c640 1 --2- 172.21.15.98:0/2472889491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f26640d2050 0x7f26640d0f00 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.128 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.109+0000 7f266b80c640 1 --2- 172.21.15.98:0/2472889491 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f266415e0d0 0x7f26640d09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.128 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.109+0000 7f266b80c640 1 -- 172.21.15.98:0/2472889491 >> 172.21.15.98:0/2472889491 conn(0x7f26640d3fe0 msgr2=0x7f26640d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:04.128 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.109+0000 7f221896f640 1 --2- 172.21.15.98:0/2258394454 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22140d1b70 0x7f22140c9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:04.128 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.109+0000 7f2213fff640 1 -- 172.21.15.98:0/2258394454 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f221415e1b0 msgr2=0x7f22141f4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:04.128 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.109+0000 7f2219170640 1 --2- 172.21.15.98:0/2258394454 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f221415e1b0 0x7f22141f4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:04.128 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.109+0000 7f2213fff640 1 --2- 172.21.15.98:0/2258394454 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f221415e1b0 0x7f22141f4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.109+0000 7f5ce77fe640 1 -- 172.21.15.98:0/2775185832 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5cf8044020 con 0x7f5d00073540 2024-09-17T05:22:04.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.109+0000 7f2213fff640 1 -- 172.21.15.98:0/2258394454 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22140d1b70 msgr2=0x7f22140c9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:04.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.109+0000 7f2213fff640 1 --2- 172.21.15.98:0/2258394454 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22140d1b70 0x7f22140c9a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.109+0000 7f2213fff640 1 -- 172.21.15.98:0/2258394454 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22141f4680 con 0x7f22140d2aa0 2024-09-17T05:22:04.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.109+0000 7f2219170640 1 --2- 172.21.15.98:0/2258394454 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f221415e1b0 0x7f22141f4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:22:04.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.109+0000 7f221896f640 1 --2- 172.21.15.98:0/2258394454 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22140d1b70 0x7f22140c9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:22:04.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.109+0000 7fafa67fc640 1 -- 172.21.15.98:0/1060152526 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb00b2600 con 0x7fafa80366f0 2024-09-17T05:22:04.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.109+0000 7fafa67fc640 1 -- 172.21.15.98:0/1060152526 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fafb00b2890 con 0x7fafa80366f0 2024-09-17T05:22:04.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.109+0000 7f9a6dd5d640 1 -- 172.21.15.98:0/1160999557 shutdown_connections 2024-09-17T05:22:04.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.109+0000 7f9a6dd5d640 1 -- 172.21.15.98:0/1160999557 wait complete. 2024-09-17T05:22:04.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.110+0000 7f5ce77fe640 1 --2- 172.21.15.98:0/2775185832 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f5cec078d90 0x7f5cec07b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:04.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.109+0000 7f207ed9d640 1 --2- 172.21.15.98:0/1634644383 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f20801f4720 0x7f20800ae240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:04.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.109+0000 7f207ed9d640 1 -- 172.21.15.98:0/1634644383 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2080140c70 msgr2=0x7f208009b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:04.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.109+0000 7f207ed9d640 1 --2- 172.21.15.98:0/1634644383 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2080140c70 0x7f208009b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.109+0000 7f207ed9d640 1 -- 172.21.15.98:0/1634644383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20801f42a0 msgr2=0x7f20800add00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:04.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.109+0000 7f207ed9d640 1 --2- 172.21.15.98:0/1634644383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20801f42a0 0x7f20800add00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.109+0000 7f207ed9d640 1 -- 172.21.15.98:0/1634644383 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20801f4cf0 con 0x7f20801f4720 2024-09-17T05:22:04.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.110+0000 7f2213fff640 1 --2- 172.21.15.98:0/2258394454 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22140d2aa0 0x7f22141f3c00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f220c000f80 tx=0x7f220c0045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:04.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.110+0000 7f5ce77fe640 1 -- 172.21.15.98:0/2775185832 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5cf80bb440 con 0x7f5d00073540 2024-09-17T05:22:04.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.110+0000 7fc7c5c01640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7c015cf20 0x7fc7c00c9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:04.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.110+0000 7fafb6be5640 1 -- 172.21.15.98:0/1060152526 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafa8021ea0 con 0x7fafa80366f0 2024-09-17T05:22:04.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.110+0000 7fafb6be5640 1 -- 172.21.15.98:0/1060152526 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafa8048130 con 0x7fafa80366f0 2024-09-17T05:22:04.134 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.110+0000 7f5cfe7fc640 1 --2- 172.21.15.98:0/2775185832 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f5cec078d90 0x7f5cec07b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:04.134 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.110+0000 7fc7c5c01640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7c0162600 0x7fc7c01596b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:04.134 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.110+0000 7f266b80c640 1 -- 172.21.15.98:0/2472889491 shutdown_connections 2024-09-17T05:22:04.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.110+0000 7fc7bf7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7c015cf20 0x7fc7c00c9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:04.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.110+0000 7fc7c5c01640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc7c00cbed0 0x7fc7c0157ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:04.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.110+0000 7fc7c5c01640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c00cdcd0 con 0x7fc7c015cf20 2024-09-17T05:22:04.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.110+0000 7fc7c5c01640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c00cdb50 con 0x7fc7c0162600 2024-09-17T05:22:04.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.110+0000 7fc7c5c01640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fc7c00cde50 con 0x7fc7c00cbed0 2024-09-17T05:22:04.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.110+0000 7fc7bf7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7c015cf20 0x7fc7c00c9f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47792/0 (socket says 172.21.15.98:47792) 2024-09-17T05:22:04.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.110+0000 7fc7bf7fe640 1 -- 172.21.15.98:0/858109628 learned_addr learned my addr 172.21.15.98:0/858109628 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:04.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.111+0000 7f9a6dd5d640 1 Processor -- start 2024-09-17T05:22:04.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.111+0000 7fc7bf7fe640 1 -- 172.21.15.98:0/858109628 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc7c00cbed0 msgr2=0x7fc7c0157ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:04.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.111+0000 7fc7bf7fe640 1 --2- 172.21.15.98:0/858109628 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc7c00cbed0 0x7fc7c0157ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.137 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.111+0000 7f9a6dd5d640 1 -- start start 2024-09-17T05:22:04.137 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.111+0000 7fc7bf7fe640 1 -- 172.21.15.98:0/858109628 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7c0162600 msgr2=0x7fc7c01596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:04.137 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.111+0000 7fafa67fc640 1 -- 172.21.15.98:0/1060152526 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb00b2ca0 con 0x7fafa80366f0 2024-09-17T05:22:04.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.111+0000 7fc7bf7fe640 1 --2- 172.21.15.98:0/858109628 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7c0162600 0x7fc7c01596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.110+0000 7f22117fa640 1 -- 172.21.15.98:0/2258394454 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f220c046070 con 0x7f22140d2aa0 2024-09-17T05:22:04.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.110+0000 7f221abd3640 1 -- 172.21.15.98:0/2258394454 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22141f6450 con 0x7f22140d2aa0 2024-09-17T05:22:04.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.110+0000 7f221abd3640 1 -- 172.21.15.98:0/2258394454 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2214205150 con 0x7f22140d2aa0 2024-09-17T05:22:04.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.110+0000 7f22117fa640 1 -- 172.21.15.98:0/2258394454 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f220c02f690 con 0x7f22140d2aa0 2024-09-17T05:22:04.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.110+0000 7f207ed9d640 1 --2- 172.21.15.98:0/1634644383 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f20801f4720 0x7f20800ae240 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2080143ee0 tx=0x7f2074003aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:04.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.111+0000 7fc7bf7fe640 1 -- 172.21.15.98:0/858109628 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7c00c9170 con 0x7fc7c015cf20 2024-09-17T05:22:04.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.110+0000 7f266b80c640 1 -- 172.21.15.98:0/2472889491 wait complete. 2024-09-17T05:22:04.140 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.111+0000 7f22117fa640 1 -- 172.21.15.98:0/2258394454 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f220c033050 con 0x7f22140d2aa0 2024-09-17T05:22:04.140 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.111+0000 7fc7bf7fe640 1 --2- 172.21.15.98:0/858109628 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7c015cf20 0x7fc7c00c9f30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8006010 tx=0x7fc7b8003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:04.141 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.111+0000 7f221abd3640 1 -- 172.21.15.98:0/2258394454 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21f4005290 con 0x7f22140d2aa0 2024-09-17T05:22:04.141 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.112+0000 7f5cfe7fc640 1 --2- 172.21.15.98:0/2775185832 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f5cec078d90 0x7f5cec07b250 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5d000b3110 tx=0x7f5cf0009110 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:04.141 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.112+0000 7fafb6be5640 1 -- 172.21.15.98:0/1060152526 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafa8035fe0 con 0x7fafa80366f0 2024-09-17T05:22:04.142 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.112+0000 7f3c67fff640 1 -- 172.21.15.98:0/2609690584 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c68166770 msgr2=0x7f3c680d2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:04.142 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.112+0000 7f3c67fff640 1 --2- 172.21.15.98:0/2609690584 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c68166770 0x7f3c680d2dd0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3c60005fd0 tx=0x7f3c6002aa00 comp rx=0 tx=0).stop 2024-09-17T05:22:04.142 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.112+0000 7f3c67fff640 1 -- 172.21.15.98:0/2609690584 shutdown_connections 2024-09-17T05:22:04.142 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.112+0000 7f3c67fff640 1 --2- 172.21.15.98:0/2609690584 >> v2:172.21.15.167:3300/0 conn(0x7f3c680d3310 0x7f3c680d1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.112+0000 7f266b80c640 1 Processor -- start 2024-09-17T05:22:04.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.112+0000 7f3c67fff640 1 --2- 172.21.15.98:0/2609690584 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c68166770 0x7f3c680d2dd0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.112+0000 7f266b80c640 1 -- start start 2024-09-17T05:22:04.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.112+0000 7f3c67fff640 1 -- 172.21.15.98:0/2609690584 >> 172.21.15.98:0/2609690584 conn(0x7f3c680b58b0 msgr2=0x7f3c680b5cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:04.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.112+0000 7f3c67fff640 1 -- 172.21.15.98:0/2609690584 shutdown_connections 2024-09-17T05:22:04.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.112+0000 7f3c67fff640 1 -- 172.21.15.98:0/2609690584 wait complete. 2024-09-17T05:22:04.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.112+0000 7f9a6dd5d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a680b3ab0 0x7f9a68156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:04.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.112+0000 7f9a6dd5d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9a6815bbd0 0x7f9a6815c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:04.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.112+0000 7f9a6dd5d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a681620a0 0x7f9a680aed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:04.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.113+0000 7f9a677fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a680b3ab0 0x7f9a68156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:04.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.113+0000 7f9a677fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a680b3ab0 0x7f9a68156580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.98:45664/0 (socket says 172.21.15.98:45664) 2024-09-17T05:22:04.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.113+0000 7f9a67fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a681620a0 0x7f9a680aed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:04.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.113+0000 7f9a67fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a681620a0 0x7f9a680aed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47800/0 (socket says 172.21.15.98:47800) 2024-09-17T05:22:04.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.113+0000 7f9a66ffd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9a6815bbd0 0x7f9a6815c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:04.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.113+0000 7f9a66ffd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9a6815bbd0 0x7f9a6815c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.98:38034/0 (socket says 172.21.15.98:38034) 2024-09-17T05:22:04.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.113+0000 7f266b80c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f26640d1440 0x7f26641ea420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:04.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.113+0000 7f9a677fe640 1 -- 172.21.15.98:0/1673367849 learned_addr learned my addr 172.21.15.98:0/1673367849 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:04.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.113+0000 7f9a6dd5d640 1 -- 172.21.15.98:0/1673367849 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9a6806f280 con 0x7f9a681620a0 2024-09-17T05:22:04.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.113+0000 7f266b80c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f26640d2050 0x7f266415a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:04.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.113+0000 7f266b80c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f266415e0d0 0x7f26641e8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:04.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.113+0000 7f266b80c640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f266415ed80 con 0x7f26640d2050 2024-09-17T05:22:04.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.113+0000 7f266b80c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f266415ec00 con 0x7f266415e0d0 2024-09-17T05:22:04.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.113+0000 7f266b80c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f266415ef00 con 0x7f26640d1440 2024-09-17T05:22:04.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.113+0000 7f22117fa640 1 -- 172.21.15.98:0/2258394454 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f220c049070 con 0x7f22140d2aa0 2024-09-17T05:22:04.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.113+0000 7f9a6dd5d640 1 -- 172.21.15.98:0/1673367849 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9a6806f100 con 0x7f9a680b3ab0 2024-09-17T05:22:04.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.113+0000 7f9a6dd5d640 1 -- 172.21.15.98:0/1673367849 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f9a6806f400 con 0x7f9a6815bbd0 2024-09-17T05:22:04.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.113+0000 7f26695a8640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f26640d1440 0x7f26641ea420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:04.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.113+0000 7f26695a8640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f26640d1440 0x7f26641ea420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.98:38046/0 (socket says 172.21.15.98:38046) 2024-09-17T05:22:04.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.113+0000 7f26695a8640 1 -- 172.21.15.98:0/2862489951 learned_addr learned my addr 172.21.15.98:0/2862489951 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:04.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.113+0000 7f2669da9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f266415e0d0 0x7f26641e8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:04.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.113+0000 7f2668da7640 1 --2- 172.21.15.98:0/2862489951 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f26640d2050 0x7f266415a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:04.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.114+0000 7f22117fa640 1 --2- 172.21.15.98:0/2258394454 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f2200078be0 0x7f220007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:04.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.114+0000 7f26695a8640 1 -- 172.21.15.98:0/2862489951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f266415e0d0 msgr2=0x7f26641e8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:04.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.114+0000 7f26695a8640 1 --2- 172.21.15.98:0/2862489951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f266415e0d0 0x7f26641e8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.114+0000 7f9a67fff640 1 -- 172.21.15.98:0/1673367849 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9a6815bbd0 msgr2=0x7f9a6815c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:04.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.114+0000 7f9a67fff640 1 --2- 172.21.15.98:0/1673367849 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9a6815bbd0 0x7f9a6815c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.114+0000 7f9a67fff640 1 -- 172.21.15.98:0/1673367849 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a680b3ab0 msgr2=0x7f9a68156580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:04.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.114+0000 7f9a67fff640 1 --2- 172.21.15.98:0/1673367849 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a680b3ab0 0x7f9a68156580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.151 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.114+0000 7f9a67fff640 1 -- 172.21.15.98:0/1673367849 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a680adf90 con 0x7f9a681620a0 2024-09-17T05:22:04.151 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.114+0000 7f3c67fff640 1 Processor -- start 2024-09-17T05:22:04.151 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.114+0000 7f22117fa640 1 -- 172.21.15.98:0/2258394454 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f220c0bc0e0 con 0x7f22140d2aa0 2024-09-17T05:22:04.152 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.114+0000 7f221896f640 1 --2- 172.21.15.98:0/2258394454 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f2200078be0 0x7f220007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:04.153 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.114+0000 7f26695a8640 1 -- 172.21.15.98:0/2862489951 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f26640d2050 msgr2=0x7f266415a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:04.153 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.114+0000 7f26695a8640 1 --2- 172.21.15.98:0/2862489951 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f26640d2050 0x7f266415a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.156 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.114+0000 7f9a67fff640 1 --2- 172.21.15.98:0/1673367849 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a681620a0 0x7f9a680aed50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9a6000e6a0 tx=0x7f9a6000eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:04.156 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.114+0000 7f26695a8640 1 -- 172.21.15.98:0/2862489951 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26641e9180 con 0x7f26640d1440 2024-09-17T05:22:04.156 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.114+0000 7f26695a8640 1 --2- 172.21.15.98:0/2862489951 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f26640d1440 0x7f26641ea420 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f266000d740 tx=0x7f266000dc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:04.157 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.114+0000 7f3c67fff640 1 -- start start 2024-09-17T05:22:04.157 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.114+0000 7f2659ffb640 1 -- 172.21.15.98:0/2862489951 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2660017070 con 0x7f26640d1440 2024-09-17T05:22:04.157 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.114+0000 7f2659ffb640 1 -- 172.21.15.98:0/2862489951 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2660009d20 con 0x7f26640d1440 2024-09-17T05:22:04.157 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.114+0000 7f2659ffb640 1 -- 172.21.15.98:0/2862489951 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26600106c0 con 0x7f26640d1440 2024-09-17T05:22:04.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.114+0000 7f266b80c640 1 -- 172.21.15.98:0/2862489951 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2664152250 con 0x7f26640d1440 2024-09-17T05:22:04.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.114+0000 7f221896f640 1 --2- 172.21.15.98:0/2258394454 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f2200078be0 0x7f220007b0a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f22141f5fa0 tx=0x7f2204005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:04.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.115+0000 7f266b80c640 1 -- 172.21.15.98:0/2862489951 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2664152810 con 0x7f26640d1440 2024-09-17T05:22:04.159 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.115+0000 7f3c67fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c6809cd10 0x7f3c68162a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:04.159 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.115+0000 7f3c67fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c680d3310 0x7f3c680c7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:04.159 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.115+0000 7f3c67fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c68166770 0x7f3c680c9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:04.160 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.115+0000 7f3c67fff640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3c680d1fc0 con 0x7f3c6809cd10 2024-09-17T05:22:04.160 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.115+0000 7f3c67fff640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3c680d1e40 con 0x7f3c680d3310 2024-09-17T05:22:04.160 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.115+0000 7f3c67fff640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f3c680d2140 con 0x7f3c68166770 2024-09-17T05:22:04.160 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.115+0000 7f3c66ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c6809cd10 0x7f3c68162a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:04.160 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.115+0000 7f3c66ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c6809cd10 0x7f3c68162a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47816/0 (socket says 172.21.15.98:47816) 2024-09-17T05:22:04.160 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.115+0000 7f3c66ffd640 1 -- 172.21.15.98:0/3740115769 learned_addr learned my addr 172.21.15.98:0/3740115769 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:04.160 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.115+0000 7f3c667fc640 1 --2- 172.21.15.98:0/3740115769 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c680d3310 0x7f3c680c7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:04.160 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.115+0000 7f3c677fe640 1 --2- 172.21.15.98:0/3740115769 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c68166770 0x7f3c680c9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:04.160 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.115+0000 7f3c66ffd640 1 -- 172.21.15.98:0/3740115769 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c68166770 msgr2=0x7f3c680c9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:04.160 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.115+0000 7f3c66ffd640 1 --2- 172.21.15.98:0/3740115769 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c68166770 0x7f3c680c9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.160 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.115+0000 7f3c66ffd640 1 -- 172.21.15.98:0/3740115769 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c680d3310 msgr2=0x7f3c680c7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:04.160 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.115+0000 7f3c66ffd640 1 --2- 172.21.15.98:0/3740115769 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c680d3310 0x7f3c680c7820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.161 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.115+0000 7f3c66ffd640 1 -- 172.21.15.98:0/3740115769 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c680ca3f0 con 0x7f3c6809cd10 2024-09-17T05:22:04.161 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.116+0000 7f206effd640 1 -- 172.21.15.98:0/1634644383 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20740119c0 con 0x7f20801f4720 2024-09-17T05:22:04.161 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.116+0000 7f2084f64640 1 -- 172.21.15.98:0/1634644383 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20801f4fd0 con 0x7f20801f4720 2024-09-17T05:22:04.161 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.116+0000 7f9a5ffff640 1 -- 172.21.15.98:0/1673367849 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a60004220 con 0x7f9a681620a0 2024-09-17T05:22:04.161 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.116+0000 7fc7a7fff640 1 -- 172.21.15.98:0/858109628 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b8004450 con 0x7fc7c015cf20 2024-09-17T05:22:04.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.116+0000 7f2084f64640 1 -- 172.21.15.98:0/1634644383 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f208009b8c0 con 0x7f20801f4720 2024-09-17T05:22:04.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.116+0000 7fc7c5c01640 1 -- 172.21.15.98:0/858109628 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7c00c9450 con 0x7fc7c015cf20 2024-09-17T05:22:04.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.116+0000 7fc7c5c01640 1 -- 172.21.15.98:0/858109628 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7c00c9a10 con 0x7fc7c015cf20 2024-09-17T05:22:04.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.116+0000 7fc7a7fff640 1 -- 172.21.15.98:0/858109628 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc7b8044070 con 0x7fc7c015cf20 2024-09-17T05:22:04.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.116+0000 7fc7a7fff640 1 -- 172.21.15.98:0/858109628 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b8004810 con 0x7fc7c015cf20 2024-09-17T05:22:04.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.117+0000 7fc7c5c01640 1 -- 172.21.15.98:0/858109628 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7a0005290 con 0x7fc7c015cf20 2024-09-17T05:22:04.163 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.116+0000 7f5ce77fe640 1 -- 172.21.15.98:0/2775185832 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f5cf804b020 con 0x7f5d00073540 2024-09-17T05:22:04.163 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.116+0000 7f9a6dd5d640 1 -- 172.21.15.98:0/1673367849 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a680ae270 con 0x7f9a681620a0 2024-09-17T05:22:04.163 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.116+0000 7f9a6dd5d640 1 -- 172.21.15.98:0/1673367849 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a680ae830 con 0x7f9a681620a0 2024-09-17T05:22:04.163 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.117+0000 7f9a6dd5d640 1 -- 172.21.15.98:0/1673367849 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a680aea30 con 0x7f9a681620a0 2024-09-17T05:22:04.163 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.116+0000 7f266b80c640 1 -- 172.21.15.98:0/2862489951 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f266415f3d0 con 0x7f26640d1440 2024-09-17T05:22:04.164 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.117+0000 7f2659ffb640 1 -- 172.21.15.98:0/2862489951 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f266001a070 con 0x7f26640d1440 2024-09-17T05:22:04.164 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.116+0000 7f3c66ffd640 1 --2- 172.21.15.98:0/3740115769 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c6809cd10 0x7f3c68162a60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3c5800c410 tx=0x7f3c5800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:04.164 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.118+0000 7f206effd640 1 -- 172.21.15.98:0/1634644383 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2074018070 con 0x7f20801f4720 2024-09-17T05:22:04.164 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.118+0000 7f22117fa640 1 -- 172.21.15.98:0/2258394454 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f220c050020 con 0x7f22140d2aa0 2024-09-17T05:22:04.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.117+0000 7f2659ffb640 1 --2- 172.21.15.98:0/2862489951 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f2648078bc0 0x7f264807b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:04.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.117+0000 7f2668da7640 1 --2- 172.21.15.98:0/2862489951 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f2648078bc0 0x7f264807b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:04.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.118+0000 7f206effd640 1 -- 172.21.15.98:0/1634644383 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2074011da0 con 0x7f20801f4720 2024-09-17T05:22:04.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.117+0000 7f2659ffb640 1 -- 172.21.15.98:0/2862489951 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2660099280 con 0x7f26640d1440 2024-09-17T05:22:04.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.118+0000 7f2668da7640 1 --2- 172.21.15.98:0/2862489951 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f2648078bc0 0x7f264807b080 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f265c035000 tx=0x7f265c03a040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:04.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.119+0000 7f2084f64640 1 -- 172.21.15.98:0/1634644383 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2064005290 con 0x7f20801f4720 2024-09-17T05:22:04.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.119+0000 7f9a5ffff640 1 -- 172.21.15.98:0/1673367849 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9a600044b0 con 0x7f9a681620a0 2024-09-17T05:22:04.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.119+0000 7f9a5ffff640 1 -- 172.21.15.98:0/1673367849 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6001c070 con 0x7f9a681620a0 2024-09-17T05:22:04.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.119+0000 7fafa67fc640 1 -- 172.21.15.98:0/1060152526 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fafb00c6420 con 0x7fafa80366f0 2024-09-17T05:22:04.168 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.119+0000 7f9a5ffff640 1 -- 172.21.15.98:0/1673367849 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9a6000cb90 con 0x7f9a681620a0 2024-09-17T05:22:04.168 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.120+0000 7fafa67fc640 1 --2- 172.21.15.98:0/1060152526 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7faf94078c60 0x7faf9407b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:04.168 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.120+0000 7f9a5ffff640 1 --2- 172.21.15.98:0/1673367849 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f9a48078bc0 0x7f9a4807b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:04.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.120+0000 7fafa67fc640 1 -- 172.21.15.98:0/1060152526 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fafb013ae80 con 0x7fafa80366f0 2024-09-17T05:22:04.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.120+0000 7fafb5be3640 1 --2- 172.21.15.98:0/1060152526 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7faf94078c60 0x7faf9407b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:04.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.120+0000 7f9a677fe640 1 --2- 172.21.15.98:0/1673367849 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f9a48078bc0 0x7f9a4807b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:04.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.120+0000 7f9a677fe640 1 --2- 172.21.15.98:0/1673367849 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f9a48078bc0 0x7f9a4807b080 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9a500046b0 tx=0x7f9a50009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:04.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.120+0000 7fafb5be3640 1 --2- 172.21.15.98:0/1060152526 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7faf94078c60 0x7faf9407b120 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fafa00017b0 tx=0x7fafa0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:04.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.123+0000 7fafa67fc640 1 -- 172.21.15.98:0/1060152526 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fafb0102d70 con 0x7fafa80366f0 2024-09-17T05:22:04.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.123+0000 7f9a5ffff640 1 -- 172.21.15.98:0/1673367849 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9a60016da0 con 0x7f9a681620a0 2024-09-17T05:22:04.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.123+0000 7f2659ffb640 1 -- 172.21.15.98:0/2862489951 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f2660067600 con 0x7f26640d1440 2024-09-17T05:22:04.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.125+0000 7f206effd640 1 -- 172.21.15.98:0/1634644383 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f20740263d0 con 0x7f20801f4720 2024-09-17T05:22:04.172 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.125+0000 7f3c4ffff640 1 -- 172.21.15.98:0/3740115769 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c58017070 con 0x7f3c6809cd10 2024-09-17T05:22:04.172 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.125+0000 7f3c67fff640 1 -- 172.21.15.98:0/3740115769 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c680ca6d0 con 0x7f3c6809cd10 2024-09-17T05:22:04.172 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.125+0000 7f3c67fff640 1 -- 172.21.15.98:0/3740115769 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c680cb210 con 0x7f3c6809cd10 2024-09-17T05:22:04.172 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.126+0000 7f206effd640 1 --2- 172.21.15.98:0/1634644383 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f2060078bc0 0x7f206007b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:04.173 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.125+0000 7fc7a7fff640 1 -- 172.21.15.98:0/858109628 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc7b803e070 con 0x7fc7c015cf20 2024-09-17T05:22:04.173 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.125+0000 7fc7a7fff640 1 --2- 172.21.15.98:0/858109628 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fc7ac078b90 0x7fc7ac07b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:04.173 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.126+0000 7fc7a7fff640 1 -- 172.21.15.98:0/858109628 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc7b80bc4d0 con 0x7fc7c015cf20 2024-09-17T05:22:04.173 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.126+0000 7fc7beffd640 1 --2- 172.21.15.98:0/858109628 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fc7ac078b90 0x7fc7ac07b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:04.174 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.126+0000 7f207e59c640 1 --2- 172.21.15.98:0/1634644383 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f2060078bc0 0x7f206007b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:04.174 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.126+0000 7f3c4dffb640 1 -- 172.21.15.98:0/3740115769 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c48005290 con 0x7f3c6809cd10 2024-09-17T05:22:04.174 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.127+0000 7fc7beffd640 1 --2- 172.21.15.98:0/858109628 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fc7ac078b90 0x7fc7ac07b050 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc7b40058c0 tx=0x7fc7b4005850 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:04.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.127+0000 7f207e59c640 1 --2- 172.21.15.98:0/1634644383 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f2060078bc0 0x7f206007b080 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f20800ae9e0 tx=0x7f2070005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:04.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.129+0000 7f3c4ffff640 1 -- 172.21.15.98:0/3740115769 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3c580035f0 con 0x7f3c6809cd10 2024-09-17T05:22:04.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.129+0000 7f3c4ffff640 1 -- 172.21.15.98:0/3740115769 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c58021060 con 0x7f3c6809cd10 2024-09-17T05:22:04.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.129+0000 7f9a5ffff640 1 -- 172.21.15.98:0/1673367849 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f9a680aea30 con 0x7f9a681620a0 2024-09-17T05:22:04.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.129+0000 7f206effd640 1 -- 172.21.15.98:0/1634644383 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2074026d50 con 0x7f20801f4720 2024-09-17T05:22:04.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.134+0000 7fc7a7fff640 1 -- 172.21.15.98:0/858109628 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fc7b803c040 con 0x7fc7c015cf20 2024-09-17T05:22:04.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.136+0000 7f3c4ffff640 1 -- 172.21.15.98:0/3740115769 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3c5801a070 con 0x7f3c6809cd10 2024-09-17T05:22:04.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.137+0000 7f3c4ffff640 1 --2- 172.21.15.98:0/3740115769 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f3c54078b90 0x7f3c5407b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:04.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.137+0000 7f3c667fc640 1 --2- 172.21.15.98:0/3740115769 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f3c54078b90 0x7f3c5407b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:04.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.138+0000 7f3c667fc640 1 --2- 172.21.15.98:0/3740115769 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f3c54078b90 0x7f3c5407b050 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3c60035000 tx=0x7f3c6003b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:04.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.143+0000 7f206effd640 1 -- 172.21.15.98:0/1634644383 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f20800cdae0 con 0x7f20801f4720 2024-09-17T05:22:04.178 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.143+0000 7f3c4ffff640 1 -- 172.21.15.98:0/3740115769 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3c5805e840 con 0x7f3c6809cd10 2024-09-17T05:22:04.178 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.152+0000 7f3c4ffff640 1 -- 172.21.15.98:0/3740115769 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f3c580010c0 con 0x7f3c6809cd10 2024-09-17T05:22:04.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.533+0000 7fafb6be5640 1 -- 172.21.15.98:0/1060152526 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fafa8035fe0 con 0x7fafa80366f0 2024-09-17T05:22:04.536 INFO:teuthology.orchestra.run.smithi098.stdout:55834574854 2024-09-17T05:22:04.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.533+0000 7fafa67fc640 1 -- 172.21.15.98:0/1060152526 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fafb01077a0 con 0x7fafa80366f0 2024-09-17T05:22:04.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.536+0000 7f5d05403640 1 -- 172.21.15.98:0/2775185832 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f5ce0005850 con 0x7f5d00073540 2024-09-17T05:22:04.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.537+0000 7f5ce77fe640 1 -- 172.21.15.98:0/2775185832 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5cf80839a0 con 0x7f5d00073540 2024-09-17T05:22:04.538 INFO:teuthology.orchestra.run.smithi098.stdout:64424509449 2024-09-17T05:22:04.539 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.537+0000 7fafb6be5640 1 -- 172.21.15.98:0/1060152526 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7faf94078c60 msgr2=0x7faf9407b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:04.539 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.537+0000 7fafb6be5640 1 --2- 172.21.15.98:0/1060152526 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7faf94078c60 0x7faf9407b120 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fafa00017b0 tx=0x7fafa0009040 comp rx=0 tx=0).stop 2024-09-17T05:22:04.539 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.537+0000 7fafb6be5640 1 -- 172.21.15.98:0/1060152526 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafa80366f0 msgr2=0x7fafa80dc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:04.539 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.538+0000 7fafb6be5640 1 --2- 172.21.15.98:0/1060152526 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafa80366f0 0x7fafa80dc890 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fafb0069f40 tx=0x7fafb00aaa60 comp rx=0 tx=0).stop 2024-09-17T05:22:04.539 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.538+0000 7fafb6be5640 1 -- 172.21.15.98:0/1060152526 shutdown_connections 2024-09-17T05:22:04.539 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.538+0000 7fafb6be5640 1 --2- 172.21.15.98:0/1060152526 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7faf94078c60 0x7faf9407b120 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.539 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.538+0000 7fafb6be5640 1 --2- 172.21.15.98:0/1060152526 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafa80366f0 0x7fafa80dc890 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.538+0000 7fafb6be5640 1 --2- 172.21.15.98:0/1060152526 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fafa801c890 0x7fafa80dc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.538+0000 7fafb6be5640 1 --2- 172.21.15.98:0/1060152526 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fafa8005a60 0x7fafa80db580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.538+0000 7fafb6be5640 1 -- 172.21.15.98:0/1060152526 >> 172.21.15.98:0/1060152526 conn(0x7fafa8054560 msgr2=0x7fafa8053410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:04.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.538+0000 7fafb6be5640 1 -- 172.21.15.98:0/1060152526 shutdown_connections 2024-09-17T05:22:04.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.538+0000 7fafb6be5640 1 -- 172.21.15.98:0/1060152526 wait complete. 2024-09-17T05:22:04.544 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.543+0000 7f5ce57fa640 1 -- 172.21.15.98:0/2775185832 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f5cec078d90 msgr2=0x7f5cec07b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:04.544 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.543+0000 7f5ce57fa640 1 --2- 172.21.15.98:0/2775185832 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f5cec078d90 0x7f5cec07b250 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5d000b3110 tx=0x7f5cf0009110 comp rx=0 tx=0).stop 2024-09-17T05:22:04.545 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.543+0000 7f5ce57fa640 1 -- 172.21.15.98:0/2775185832 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d00073540 msgr2=0x7f5d001583f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:04.545 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.543+0000 7f5ce57fa640 1 --2- 172.21.15.98:0/2775185832 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d00073540 0x7f5d001583f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8009e50 tx=0x7f5cf8003f10 comp rx=0 tx=0).stop 2024-09-17T05:22:04.545 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.543+0000 7f5ce57fa640 1 -- 172.21.15.98:0/2775185832 shutdown_connections 2024-09-17T05:22:04.545 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.543+0000 7f5ce57fa640 1 --2- 172.21.15.98:0/2775185832 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f5cec078d90 0x7f5cec07b250 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.545 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.543+0000 7f5ce57fa640 1 --2- 172.21.15.98:0/2775185832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d000b4840 0x7f5d0008a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.545 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.543+0000 7f5ce57fa640 1 --2- 172.21.15.98:0/2775185832 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d000b2960 0x7f5d00157da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.545 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.543+0000 7f5ce57fa640 1 --2- 172.21.15.98:0/2775185832 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d00073540 0x7f5d001583f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.545 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.543+0000 7f5ce57fa640 1 -- 172.21.15.98:0/2775185832 >> 172.21.15.98:0/2775185832 conn(0x7f5d0006cb70 msgr2=0x7f5d0016e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:04.545 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.543+0000 7f5ce57fa640 1 -- 172.21.15.98:0/2775185832 shutdown_connections 2024-09-17T05:22:04.545 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.543+0000 7f5ce57fa640 1 -- 172.21.15.98:0/2775185832 wait complete. 2024-09-17T05:22:04.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.549+0000 7f221abd3640 1 -- 172.21.15.98:0/2258394454 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f21f4005850 con 0x7f22140d2aa0 2024-09-17T05:22:04.551 INFO:teuthology.orchestra.run.smithi098.stdout:60129542151 2024-09-17T05:22:04.551 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.550+0000 7f22117fa640 1 -- 172.21.15.98:0/2258394454 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f220c084690 con 0x7f22140d2aa0 2024-09-17T05:22:04.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.550+0000 7f266b80c640 1 -- 172.21.15.98:0/2862489951 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f2664152fc0 con 0x7f26640d1440 2024-09-17T05:22:04.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.551+0000 7f9a6dd5d640 1 -- 172.21.15.98:0/1673367849 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f9a6806f990 con 0x7f9a681620a0 2024-09-17T05:22:04.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.551+0000 7f9a5ffff640 1 -- 172.21.15.98:0/1673367849 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9a600639f0 con 0x7f9a681620a0 2024-09-17T05:22:04.552 INFO:teuthology.orchestra.run.smithi098.stdout:60129542152 2024-09-17T05:22:04.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.552+0000 7f2659ffb640 1 -- 172.21.15.98:0/2862489951 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f266006c4b0 con 0x7f26640d1440 2024-09-17T05:22:04.553 INFO:teuthology.orchestra.run.smithi098.stdout:60129542152 2024-09-17T05:22:04.555 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.553+0000 7f221abd3640 1 -- 172.21.15.98:0/2258394454 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f2200078be0 msgr2=0x7f220007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:04.555 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.553+0000 7f221abd3640 1 --2- 172.21.15.98:0/2258394454 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f2200078be0 0x7f220007b0a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f22141f5fa0 tx=0x7f2204005f90 comp rx=0 tx=0).stop 2024-09-17T05:22:04.555 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.553+0000 7f221abd3640 1 -- 172.21.15.98:0/2258394454 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22140d2aa0 msgr2=0x7f22141f3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:04.555 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.553+0000 7f221abd3640 1 --2- 172.21.15.98:0/2258394454 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22140d2aa0 0x7f22141f3c00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f220c000f80 tx=0x7f220c0045e0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.555 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.554+0000 7f221abd3640 1 -- 172.21.15.98:0/2258394454 shutdown_connections 2024-09-17T05:22:04.555 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.554+0000 7f221abd3640 1 --2- 172.21.15.98:0/2258394454 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f2200078be0 0x7f220007b0a0 secure :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f22141f5fa0 tx=0x7f2204005f90 comp rx=0 tx=0).stop 2024-09-17T05:22:04.555 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.554+0000 7f221abd3640 1 --2- 172.21.15.98:0/2258394454 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f221415e1b0 0x7f22141f4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.555 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.554+0000 7f221abd3640 1 --2- 172.21.15.98:0/2258394454 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22140d2aa0 0x7f22141f3c00 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.556 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.554+0000 7f221abd3640 1 --2- 172.21.15.98:0/2258394454 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22140d1b70 0x7f22140c9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.556 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.554+0000 7f221abd3640 1 -- 172.21.15.98:0/2258394454 >> 172.21.15.98:0/2258394454 conn(0x7f22140d3fa0 msgr2=0x7f221406dfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:04.556 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.554+0000 7f221abd3640 1 -- 172.21.15.98:0/2258394454 shutdown_connections 2024-09-17T05:22:04.556 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.554+0000 7f221abd3640 1 -- 172.21.15.98:0/2258394454 wait complete. 2024-09-17T05:22:04.557 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.555+0000 7f9a6dd5d640 1 -- 172.21.15.98:0/1673367849 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f9a48078bc0 msgr2=0x7f9a4807b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:04.557 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.555+0000 7f9a6dd5d640 1 --2- 172.21.15.98:0/1673367849 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f9a48078bc0 0x7f9a4807b080 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9a500046b0 tx=0x7f9a50009040 comp rx=0 tx=0).stop 2024-09-17T05:22:04.557 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.555+0000 7f9a6dd5d640 1 -- 172.21.15.98:0/1673367849 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a681620a0 msgr2=0x7f9a680aed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:04.557 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.555+0000 7f9a6dd5d640 1 --2- 172.21.15.98:0/1673367849 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a681620a0 0x7f9a680aed50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9a6000e6a0 tx=0x7f9a6000eb60 comp rx=0 tx=0).stop 2024-09-17T05:22:04.557 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.555+0000 7f9a6dd5d640 1 -- 172.21.15.98:0/1673367849 shutdown_connections 2024-09-17T05:22:04.557 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.555+0000 7f9a6dd5d640 1 --2- 172.21.15.98:0/1673367849 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f9a48078bc0 0x7f9a4807b080 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.557 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.555+0000 7f9a6dd5d640 1 --2- 172.21.15.98:0/1673367849 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a681620a0 0x7f9a680aed50 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.557 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.555+0000 7f9a6dd5d640 1 --2- 172.21.15.98:0/1673367849 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9a6815bbd0 0x7f9a6815c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.557 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.555+0000 7f9a6dd5d640 1 --2- 172.21.15.98:0/1673367849 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a680b3ab0 0x7f9a68156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.557 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.555+0000 7f9a6dd5d640 1 -- 172.21.15.98:0/1673367849 >> 172.21.15.98:0/1673367849 conn(0x7f9a680b1950 msgr2=0x7f9a681598f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:04.557 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.556+0000 7f9a6dd5d640 1 -- 172.21.15.98:0/1673367849 shutdown_connections 2024-09-17T05:22:04.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.556+0000 7f266b80c640 1 -- 172.21.15.98:0/2862489951 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f2648078bc0 msgr2=0x7f264807b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:04.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.556+0000 7f266b80c640 1 --2- 172.21.15.98:0/2862489951 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f2648078bc0 0x7f264807b080 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f265c035000 tx=0x7f265c03a040 comp rx=0 tx=0).stop 2024-09-17T05:22:04.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.556+0000 7f9a6dd5d640 1 -- 172.21.15.98:0/1673367849 wait complete. 2024-09-17T05:22:04.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.556+0000 7f266b80c640 1 -- 172.21.15.98:0/2862489951 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f26640d1440 msgr2=0x7f26641ea420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:04.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.556+0000 7f266b80c640 1 --2- 172.21.15.98:0/2862489951 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f26640d1440 0x7f26641ea420 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f266000d740 tx=0x7f266000dc00 comp rx=0 tx=0).stop 2024-09-17T05:22:04.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.556+0000 7f266b80c640 1 -- 172.21.15.98:0/2862489951 shutdown_connections 2024-09-17T05:22:04.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.556+0000 7f266b80c640 1 --2- 172.21.15.98:0/2862489951 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f2648078bc0 0x7f264807b080 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.556+0000 7f266b80c640 1 --2- 172.21.15.98:0/2862489951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f266415e0d0 0x7f26641e8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.560 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.556+0000 7f266b80c640 1 --2- 172.21.15.98:0/2862489951 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f26640d2050 0x7f266415a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.560 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.556+0000 7f266b80c640 1 --2- 172.21.15.98:0/2862489951 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f26640d1440 0x7f26641ea420 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.560 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.556+0000 7f266b80c640 1 -- 172.21.15.98:0/2862489951 >> 172.21.15.98:0/2862489951 conn(0x7f26640d3fe0 msgr2=0x7f2664161020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:04.560 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.556+0000 7f266b80c640 1 -- 172.21.15.98:0/2862489951 shutdown_connections 2024-09-17T05:22:04.560 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.556+0000 7f266b80c640 1 -- 172.21.15.98:0/2862489951 wait complete. 2024-09-17T05:22:04.561 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2024-09-17T05:22:04.564 DEBUG:teuthology.parallel:result is None 2024-09-17T05:22:04.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.560+0000 7f2084f64640 1 -- 172.21.15.98:0/1634644383 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f2064005850 con 0x7f20801f4720 2024-09-17T05:22:04.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.561+0000 7f206effd640 1 -- 172.21.15.98:0/1634644383 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2074064290 con 0x7f20801f4720 2024-09-17T05:22:04.565 INFO:teuthology.orchestra.run.smithi098.stdout:64424509449 2024-09-17T05:22:04.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.562+0000 7fc7c5c01640 1 -- 172.21.15.98:0/858109628 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fc7a0005850 con 0x7fc7c015cf20 2024-09-17T05:22:04.566 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.0 2024-09-17T05:22:04.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.563+0000 7fc7a7fff640 1 -- 172.21.15.98:0/858109628 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc7b8032030 con 0x7fc7c015cf20 2024-09-17T05:22:04.566 INFO:teuthology.orchestra.run.smithi098.stdout:64424509449 2024-09-17T05:22:04.567 DEBUG:teuthology.parallel:result is None 2024-09-17T05:22:04.567 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.564+0000 7f2084f64640 1 -- 172.21.15.98:0/1634644383 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f2060078bc0 msgr2=0x7f206007b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:04.567 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.564+0000 7f2084f64640 1 --2- 172.21.15.98:0/1634644383 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f2060078bc0 0x7f206007b080 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f20800ae9e0 tx=0x7f2070005f90 comp rx=0 tx=0).stop 2024-09-17T05:22:04.568 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.564+0000 7f2084f64640 1 -- 172.21.15.98:0/1634644383 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f20801f4720 msgr2=0x7f20800ae240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:04.568 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.564+0000 7f2084f64640 1 --2- 172.21.15.98:0/1634644383 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f20801f4720 0x7f20800ae240 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2080143ee0 tx=0x7f2074003aa0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.568 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.564+0000 7f2084f64640 1 -- 172.21.15.98:0/1634644383 shutdown_connections 2024-09-17T05:22:04.568 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.564+0000 7f2084f64640 1 --2- 172.21.15.98:0/1634644383 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f2060078bc0 0x7f206007b080 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.568 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.564+0000 7f2084f64640 1 --2- 172.21.15.98:0/1634644383 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f20801f4720 0x7f20800ae240 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.568 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.564+0000 7f2084f64640 1 --2- 172.21.15.98:0/1634644383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20801f42a0 0x7f20800add00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.568 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.564+0000 7f2084f64640 1 --2- 172.21.15.98:0/1634644383 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2080140c70 0x7f208009b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.568 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.564+0000 7f2084f64640 1 -- 172.21.15.98:0/1634644383 >> 172.21.15.98:0/1634644383 conn(0x7f20800b1950 msgr2=0x7f20800cfba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:04.568 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.564+0000 7f2084f64640 1 -- 172.21.15.98:0/1634644383 shutdown_connections 2024-09-17T05:22:04.568 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.564+0000 7f2084f64640 1 -- 172.21.15.98:0/1634644383 wait complete. 2024-09-17T05:22:04.569 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.566+0000 7fc7c5c01640 1 -- 172.21.15.98:0/858109628 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fc7ac078b90 msgr2=0x7fc7ac07b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:04.569 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.566+0000 7fc7c5c01640 1 --2- 172.21.15.98:0/858109628 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fc7ac078b90 0x7fc7ac07b050 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc7b40058c0 tx=0x7fc7b4005850 comp rx=0 tx=0).stop 2024-09-17T05:22:04.569 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.566+0000 7fc7c5c01640 1 -- 172.21.15.98:0/858109628 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7c015cf20 msgr2=0x7fc7c00c9f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:04.569 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.566+0000 7fc7c5c01640 1 --2- 172.21.15.98:0/858109628 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7c015cf20 0x7fc7c00c9f30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8006010 tx=0x7fc7b8003ce0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.569 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.567+0000 7fc7c5c01640 1 -- 172.21.15.98:0/858109628 shutdown_connections 2024-09-17T05:22:04.569 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.567+0000 7fc7c5c01640 1 --2- 172.21.15.98:0/858109628 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fc7ac078b90 0x7fc7ac07b050 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.570 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.567+0000 7fc7c5c01640 1 --2- 172.21.15.98:0/858109628 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc7c00cbed0 0x7fc7c0157ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.570 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.567+0000 7fc7c5c01640 1 --2- 172.21.15.98:0/858109628 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7c0162600 0x7fc7c01596b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.570 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.567+0000 7fc7c5c01640 1 --2- 172.21.15.98:0/858109628 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7c015cf20 0x7fc7c00c9f30 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.570 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.567+0000 7fc7c5c01640 1 -- 172.21.15.98:0/858109628 >> 172.21.15.98:0/858109628 conn(0x7fc7c00d1d80 msgr2=0x7fc7c00b73c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:04.570 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.567+0000 7fc7c5c01640 1 -- 172.21.15.98:0/858109628 shutdown_connections 2024-09-17T05:22:04.570 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.567+0000 7fc7c5c01640 1 -- 172.21.15.98:0/858109628 wait complete. 2024-09-17T05:22:04.572 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.6 2024-09-17T05:22:04.573 DEBUG:teuthology.parallel:result is None 2024-09-17T05:22:04.577 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.5 2024-09-17T05:22:04.578 DEBUG:teuthology.parallel:result is None 2024-09-17T05:22:04.578 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.4 2024-09-17T05:22:04.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.577+0000 7f3c4dffb640 1 -- 172.21.15.98:0/3740115769 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f3c48005850 con 0x7f3c6809cd10 2024-09-17T05:22:04.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.577+0000 7f3c4ffff640 1 -- 172.21.15.98:0/3740115769 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3c580625d0 con 0x7f3c6809cd10 2024-09-17T05:22:04.579 DEBUG:teuthology.parallel:result is None 2024-09-17T05:22:04.579 INFO:teuthology.orchestra.run.smithi098.stdout:60129542151 2024-09-17T05:22:04.580 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.2 2024-09-17T05:22:04.580 DEBUG:teuthology.parallel:result is None 2024-09-17T05:22:04.582 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.581+0000 7f3c4dffb640 1 -- 172.21.15.98:0/3740115769 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f3c54078b90 msgr2=0x7f3c5407b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:04.582 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.581+0000 7f3c4dffb640 1 --2- 172.21.15.98:0/3740115769 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f3c54078b90 0x7f3c5407b050 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3c60035000 tx=0x7f3c6003b040 comp rx=0 tx=0).stop 2024-09-17T05:22:04.582 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.581+0000 7f3c4dffb640 1 -- 172.21.15.98:0/3740115769 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c6809cd10 msgr2=0x7f3c68162a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:04.582 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.581+0000 7f3c4dffb640 1 --2- 172.21.15.98:0/3740115769 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c6809cd10 0x7f3c68162a60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3c5800c410 tx=0x7f3c5800c8d0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.582 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.581+0000 7f3c4dffb640 1 -- 172.21.15.98:0/3740115769 shutdown_connections 2024-09-17T05:22:04.582 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.581+0000 7f3c4dffb640 1 --2- 172.21.15.98:0/3740115769 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f3c54078b90 0x7f3c5407b050 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.583 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.581+0000 7f3c4dffb640 1 --2- 172.21.15.98:0/3740115769 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c68166770 0x7f3c680c9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.583 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.581+0000 7f3c4dffb640 1 --2- 172.21.15.98:0/3740115769 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c680d3310 0x7f3c680c7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.583 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.581+0000 7f3c4dffb640 1 --2- 172.21.15.98:0/3740115769 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c6809cd10 0x7f3c68162a60 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.583 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.581+0000 7f3c4dffb640 1 -- 172.21.15.98:0/3740115769 >> 172.21.15.98:0/3740115769 conn(0x7f3c680b58b0 msgr2=0x7f3c681647f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:04.583 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.581+0000 7f3c4dffb640 1 -- 172.21.15.98:0/3740115769 shutdown_connections 2024-09-17T05:22:04.583 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.581+0000 7f3c4dffb640 1 -- 172.21.15.98:0/3740115769 wait complete. 2024-09-17T05:22:04.584 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.3 2024-09-17T05:22:04.584 DEBUG:teuthology.parallel:result is None 2024-09-17T05:22:04.592 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.7 2024-09-17T05:22:04.592 DEBUG:teuthology.parallel:result is None 2024-09-17T05:22:04.592 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T05:22:04.593 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:22:04.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.732+0000 7f5f7f28c640 1 -- 172.21.15.98:0/518129671 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f7815e0d0 msgr2=0x7f5f780d09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:04.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.732+0000 7f5f7f28c640 1 --2- 172.21.15.98:0/518129671 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f7815e0d0 0x7f5f780d09c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5f74005fd0 tx=0x7f5f7402a530 comp rx=0 tx=0).stop 2024-09-17T05:22:04.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.732+0000 7f5f7f28c640 1 -- 172.21.15.98:0/518129671 shutdown_connections 2024-09-17T05:22:04.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.732+0000 7f5f7f28c640 1 --2- 172.21.15.98:0/518129671 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f780d2050 0x7f5f780d0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.732+0000 7f5f7f28c640 1 --2- 172.21.15.98:0/518129671 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f7815e0d0 0x7f5f780d09c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.732+0000 7f5f7f28c640 1 -- 172.21.15.98:0/518129671 >> 172.21.15.98:0/518129671 conn(0x7f5f780d3fe0 msgr2=0x7f5f780d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:04.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.732+0000 7f5f7f28c640 1 -- 172.21.15.98:0/518129671 shutdown_connections 2024-09-17T05:22:04.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.732+0000 7f5f7f28c640 1 -- 172.21.15.98:0/518129671 wait complete. 2024-09-17T05:22:04.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.733+0000 7f5f7f28c640 1 Processor -- start 2024-09-17T05:22:04.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.734+0000 7f5f7f28c640 1 -- start start 2024-09-17T05:22:04.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.734+0000 7f5f7f28c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f780d1440 0x7f5f781f5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:04.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.734+0000 7f5f7f28c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f780d2050 0x7f5f7809eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:04.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.734+0000 7f5f7f28c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f7815e0d0 0x7f5f781f7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:04.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.734+0000 7f5f7f28c640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5f7815ebc0 con 0x7f5f780d1440 2024-09-17T05:22:04.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.734+0000 7f5f7f28c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5f780cfee0 con 0x7f5f780d2050 2024-09-17T05:22:04.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.734+0000 7f5f7f28c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f5f7815ed40 con 0x7f5f7815e0d0 2024-09-17T05:22:04.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.734+0000 7f5f7d028640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f780d1440 0x7f5f781f5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:04.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.734+0000 7f5f7d028640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f780d1440 0x7f5f781f5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47840/0 (socket says 172.21.15.98:47840) 2024-09-17T05:22:04.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.734+0000 7f5f7d028640 1 -- 172.21.15.98:0/1666683416 learned_addr learned my addr 172.21.15.98:0/1666683416 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:04.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.734+0000 7f5f7d829640 1 --2- 172.21.15.98:0/1666683416 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f7815e0d0 0x7f5f781f7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:04.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.734+0000 7f5f7c827640 1 --2- 172.21.15.98:0/1666683416 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f780d2050 0x7f5f7809eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:04.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.735+0000 7f5f7d028640 1 -- 172.21.15.98:0/1666683416 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f7815e0d0 msgr2=0x7f5f781f7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:04.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.735+0000 7f5f7d028640 1 --2- 172.21.15.98:0/1666683416 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f7815e0d0 0x7f5f781f7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.735+0000 7f5f7d028640 1 -- 172.21.15.98:0/1666683416 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f780d2050 msgr2=0x7f5f7809eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:04.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.735+0000 7f5f7d028640 1 --2- 172.21.15.98:0/1666683416 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f780d2050 0x7f5f7809eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.735+0000 7f5f7d028640 1 -- 172.21.15.98:0/1666683416 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f781f8c50 con 0x7f5f780d1440 2024-09-17T05:22:04.738 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.735+0000 7f5f7d829640 1 --2- 172.21.15.98:0/1666683416 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f7815e0d0 0x7f5f781f7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:22:04.738 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.735+0000 7f5f7d028640 1 --2- 172.21.15.98:0/1666683416 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f780d1440 0x7f5f781f5400 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5f74034040 tx=0x7f5f740038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:04.738 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.735+0000 7f5f69ffb640 1 -- 172.21.15.98:0/1666683416 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f7403e030 con 0x7f5f780d1440 2024-09-17T05:22:04.738 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.735+0000 7f5f69ffb640 1 -- 172.21.15.98:0/1666683416 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f74003d90 con 0x7f5f780d1440 2024-09-17T05:22:04.738 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.735+0000 7f5f7f28c640 1 -- 172.21.15.98:0/1666683416 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f780c9030 con 0x7f5f780d1440 2024-09-17T05:22:04.738 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.735+0000 7f5f69ffb640 1 -- 172.21.15.98:0/1666683416 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f74035040 con 0x7f5f780d1440 2024-09-17T05:22:04.738 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.735+0000 7f5f7f28c640 1 -- 172.21.15.98:0/1666683416 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f781f4920 con 0x7f5f780d1440 2024-09-17T05:22:04.739 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.736+0000 7f5f7f28c640 1 -- 172.21.15.98:0/1666683416 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f7815f260 con 0x7f5f780d1440 2024-09-17T05:22:04.739 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.737+0000 7f5f69ffb640 1 -- 172.21.15.98:0/1666683416 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5f74041030 con 0x7f5f780d1440 2024-09-17T05:22:04.739 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.737+0000 7f5f69ffb640 1 --2- 172.21.15.98:0/1666683416 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f5f5c078bc0 0x7f5f5c07b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:04.739 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.737+0000 7f5f69ffb640 1 -- 172.21.15.98:0/1666683416 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5f740bb760 con 0x7f5f780d1440 2024-09-17T05:22:04.739 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.737+0000 7f5f7c827640 1 --2- 172.21.15.98:0/1666683416 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f5f5c078bc0 0x7f5f5c07b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:04.739 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.738+0000 7f5f7c827640 1 --2- 172.21.15.98:0/1666683416 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f5f5c078bc0 0x7f5f5c07b080 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c005fd0 tx=0x7f5f6c005850 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:04.742 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.741+0000 7f5f69ffb640 1 -- 172.21.15.98:0/1666683416 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f5f74083c30 con 0x7f5f780d1440 2024-09-17T05:22:04.914 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.914+0000 7f5f7f28c640 1 -- 172.21.15.98:0/1666683416 --> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5f781f5080 con 0x7f5f5c078bc0 2024-09-17T05:22:04.919 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.918+0000 7f5f69ffb640 1 -- 172.21.15.98:0/1666683416 <== mgr.4103 v2:172.21.15.167:6800/610796449 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251825 (secure 0 0 0) 0x7f5f781f5080 con 0x7f5f5c078bc0 2024-09-17T05:22:04.921 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:22:04.922 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-17T05:22:04.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.921+0000 7f5f7f28c640 1 -- 172.21.15.98:0/1666683416 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f5f5c078bc0 msgr2=0x7f5f5c07b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:04.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.921+0000 7f5f7f28c640 1 --2- 172.21.15.98:0/1666683416 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f5f5c078bc0 0x7f5f5c07b080 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c005fd0 tx=0x7f5f6c005850 comp rx=0 tx=0).stop 2024-09-17T05:22:04.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.921+0000 7f5f7f28c640 1 -- 172.21.15.98:0/1666683416 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f780d1440 msgr2=0x7f5f781f5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:04.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.921+0000 7f5f7f28c640 1 --2- 172.21.15.98:0/1666683416 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f780d1440 0x7f5f781f5400 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5f74034040 tx=0x7f5f740038a0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.921+0000 7f5f7f28c640 1 -- 172.21.15.98:0/1666683416 shutdown_connections 2024-09-17T05:22:04.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.921+0000 7f5f7f28c640 1 --2- 172.21.15.98:0/1666683416 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f5f5c078bc0 0x7f5f5c07b080 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.925 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.921+0000 7f5f7f28c640 1 --2- 172.21.15.98:0/1666683416 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f7815e0d0 0x7f5f781f7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.925 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.921+0000 7f5f7f28c640 1 --2- 172.21.15.98:0/1666683416 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f780d2050 0x7f5f7809eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.925 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.921+0000 7f5f7f28c640 1 --2- 172.21.15.98:0/1666683416 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f780d1440 0x7f5f781f5400 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.925 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.921+0000 7f5f7f28c640 1 -- 172.21.15.98:0/1666683416 >> 172.21.15.98:0/1666683416 conn(0x7f5f780d3fe0 msgr2=0x7f5f7815f470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:04.925 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.922+0000 7f5f7f28c640 1 -- 172.21.15.98:0/1666683416 shutdown_connections 2024-09-17T05:22:04.925 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:04.922+0000 7f5f7f28c640 1 -- 172.21.15.98:0/1666683416 wait complete. 2024-09-17T05:22:04.933 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-09-17T05:22:04.250041+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219108,"kb_used_data":2856,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755612,"statfs":{"total":773094113280,"available":772869746688,"internally_reserved":0,"allocated":2924544,"data_stored":1772604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.764349"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.497272+0000","last_change":"2024-09-17T05:21:54.501153+0000","last_active":"2024-09-17T05:21:55.497272+0000","last_peered":"2024-09-17T05:21:55.497272+0000","last_clean":"2024-09-17T05:21:55.497272+0000","last_became_active":"2024-09-17T05:21:54.500904+0000","last_became_peered":"2024-09-17T05:21:54.500904+0000","last_unstale":"2024-09-17T05:21:55.497272+0000","last_undegraded":"2024-09-17T05:21:55.497272+0000","last_fullsized":"2024-09-17T05:21:55.497272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:52:10.150875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499897+0000","last_change":"2024-09-17T05:21:54.494958+0000","last_active":"2024-09-17T05:21:55.499897+0000","last_peered":"2024-09-17T05:21:55.499897+0000","last_clean":"2024-09-17T05:21:55.499897+0000","last_became_active":"2024-09-17T05:21:54.494510+0000","last_became_peered":"2024-09-17T05:21:54.494510+0000","last_unstale":"2024-09-17T05:21:55.499897+0000","last_undegraded":"2024-09-17T05:21:55.499897+0000","last_fullsized":"2024-09-17T05:21:55.499897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:12:27.112041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.747693+0000","last_change":"2024-09-17T05:21:54.500430+0000","last_active":"2024-09-17T05:21:55.747693+0000","last_peered":"2024-09-17T05:21:55.747693+0000","last_clean":"2024-09-17T05:21:55.747693+0000","last_became_active":"2024-09-17T05:21:54.496869+0000","last_became_peered":"2024-09-17T05:21:54.496869+0000","last_unstale":"2024-09-17T05:21:55.747693+0000","last_undegraded":"2024-09-17T05:21:55.747693+0000","last_fullsized":"2024-09-17T05:21:55.747693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:56.018245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.497441+0000","last_change":"2024-09-17T05:21:54.508228+0000","last_active":"2024-09-17T05:21:55.497441+0000","last_peered":"2024-09-17T05:21:55.497441+0000","last_clean":"2024-09-17T05:21:55.497441+0000","last_became_active":"2024-09-17T05:21:54.507980+0000","last_became_peered":"2024-09-17T05:21:54.507980+0000","last_unstale":"2024-09-17T05:21:55.497441+0000","last_undegraded":"2024-09-17T05:21:55.497441+0000","last_fullsized":"2024-09-17T05:21:55.497441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:59:07.965886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.496599+0000","last_change":"2024-09-17T05:21:54.495253+0000","last_active":"2024-09-17T05:21:55.496599+0000","last_peered":"2024-09-17T05:21:55.496599+0000","last_clean":"2024-09-17T05:21:55.496599+0000","last_became_active":"2024-09-17T05:21:54.494929+0000","last_became_peered":"2024-09-17T05:21:54.494929+0000","last_unstale":"2024-09-17T05:21:55.496599+0000","last_undegraded":"2024-09-17T05:21:55.496599+0000","last_fullsized":"2024-09-17T05:21:55.496599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:38.013877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.498278+0000","last_change":"2024-09-17T05:21:54.509547+0000","last_active":"2024-09-17T05:21:55.498278+0000","last_peered":"2024-09-17T05:21:55.498278+0000","last_clean":"2024-09-17T05:21:55.498278+0000","last_became_active":"2024-09-17T05:21:54.509223+0000","last_became_peered":"2024-09-17T05:21:54.509223+0000","last_unstale":"2024-09-17T05:21:55.498278+0000","last_undegraded":"2024-09-17T05:21:55.498278+0000","last_fullsized":"2024-09-17T05:21:55.498278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:51.043848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.496253+0000","last_change":"2024-09-17T05:21:54.497328+0000","last_active":"2024-09-17T05:21:55.496253+0000","last_peered":"2024-09-17T05:21:55.496253+0000","last_clean":"2024-09-17T05:21:55.496253+0000","last_became_active":"2024-09-17T05:21:54.497033+0000","last_became_peered":"2024-09-17T05:21:54.497033+0000","last_unstale":"2024-09-17T05:21:55.496253+0000","last_undegraded":"2024-09-17T05:21:55.496253+0000","last_fullsized":"2024-09-17T05:21:55.496253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:35:45.144313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.748425+0000","last_change":"2024-09-17T05:21:54.512052+0000","last_active":"2024-09-17T05:21:55.748425+0000","last_peered":"2024-09-17T05:21:55.748425+0000","last_clean":"2024-09-17T05:21:55.748425+0000","last_became_active":"2024-09-17T05:21:54.509795+0000","last_became_peered":"2024-09-17T05:21:54.509795+0000","last_unstale":"2024-09-17T05:21:55.748425+0000","last_undegraded":"2024-09-17T05:21:55.748425+0000","last_fullsized":"2024-09-17T05:21:55.748425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:00.308980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.497784+0000","last_change":"2024-09-17T05:21:54.511143+0000","last_active":"2024-09-17T05:21:55.497784+0000","last_peered":"2024-09-17T05:21:55.497784+0000","last_clean":"2024-09-17T05:21:55.497784+0000","last_became_active":"2024-09-17T05:21:54.510864+0000","last_became_peered":"2024-09-17T05:21:54.510864+0000","last_unstale":"2024-09-17T05:21:55.497784+0000","last_undegraded":"2024-09-17T05:21:55.497784+0000","last_fullsized":"2024-09-17T05:21:55.497784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:22:47.632841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.502509+0000","last_change":"2024-09-17T05:21:54.512618+0000","last_active":"2024-09-17T05:21:55.502509+0000","last_peered":"2024-09-17T05:21:55.502509+0000","last_clean":"2024-09-17T05:21:55.502509+0000","last_became_active":"2024-09-17T05:21:54.512003+0000","last_became_peered":"2024-09-17T05:21:54.512003+0000","last_unstale":"2024-09-17T05:21:55.502509+0000","last_undegraded":"2024-09-17T05:21:55.502509+0000","last_fullsized":"2024-09-17T05:21:55.502509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:28:33.399315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.502291+0000","last_change":"2024-09-17T05:21:54.512890+0000","last_active":"2024-09-17T05:21:55.502291+0000","last_peered":"2024-09-17T05:21:55.502291+0000","last_clean":"2024-09-17T05:21:55.502291+0000","last_became_active":"2024-09-17T05:21:54.511924+0000","last_became_peered":"2024-09-17T05:21:54.511924+0000","last_unstale":"2024-09-17T05:21:55.502291+0000","last_undegraded":"2024-09-17T05:21:55.502291+0000","last_fullsized":"2024-09-17T05:21:55.502291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:41.750971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499252+0000","last_change":"2024-09-17T05:21:54.501003+0000","last_active":"2024-09-17T05:21:55.499252+0000","last_peered":"2024-09-17T05:21:55.499252+0000","last_clean":"2024-09-17T05:21:55.499252+0000","last_became_active":"2024-09-17T05:21:54.500716+0000","last_became_peered":"2024-09-17T05:21:54.500716+0000","last_unstale":"2024-09-17T05:21:55.499252+0000","last_undegraded":"2024-09-17T05:21:55.499252+0000","last_fullsized":"2024-09-17T05:21:55.499252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:03.364449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.749495+0000","last_change":"2024-09-17T05:21:54.507932+0000","last_active":"2024-09-17T05:21:55.749495+0000","last_peered":"2024-09-17T05:21:55.749495+0000","last_clean":"2024-09-17T05:21:55.749495+0000","last_became_active":"2024-09-17T05:21:54.507619+0000","last_became_peered":"2024-09-17T05:21:54.507619+0000","last_unstale":"2024-09-17T05:21:55.749495+0000","last_undegraded":"2024-09-17T05:21:55.749495+0000","last_fullsized":"2024-09-17T05:21:55.749495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:05:41.748842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.747964+0000","last_change":"2024-09-17T05:21:54.500967+0000","last_active":"2024-09-17T05:21:55.747964+0000","last_peered":"2024-09-17T05:21:55.747964+0000","last_clean":"2024-09-17T05:21:55.747964+0000","last_became_active":"2024-09-17T05:21:54.500667+0000","last_became_peered":"2024-09-17T05:21:54.500667+0000","last_unstale":"2024-09-17T05:21:55.747964+0000","last_undegraded":"2024-09-17T05:21:55.747964+0000","last_fullsized":"2024-09-17T05:21:55.747964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:20:13.444228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499687+0000","last_change":"2024-09-17T05:21:54.499559+0000","last_active":"2024-09-17T05:21:55.499687+0000","last_peered":"2024-09-17T05:21:55.499687+0000","last_clean":"2024-09-17T05:21:55.499687+0000","last_became_active":"2024-09-17T05:21:54.498587+0000","last_became_peered":"2024-09-17T05:21:54.498587+0000","last_unstale":"2024-09-17T05:21:55.499687+0000","last_undegraded":"2024-09-17T05:21:55.499687+0000","last_fullsized":"2024-09-17T05:21:55.499687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:18.824693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.498770+0000","last_change":"2024-09-17T05:21:54.511036+0000","last_active":"2024-09-17T05:21:55.498770+0000","last_peered":"2024-09-17T05:21:55.498770+0000","last_clean":"2024-09-17T05:21:55.498770+0000","last_became_active":"2024-09-17T05:21:54.510599+0000","last_became_peered":"2024-09-17T05:21:54.510599+0000","last_unstale":"2024-09-17T05:21:55.498770+0000","last_undegraded":"2024-09-17T05:21:55.498770+0000","last_fullsized":"2024-09-17T05:21:55.498770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:29.213187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.498235+0000","last_change":"2024-09-17T05:21:54.510133+0000","last_active":"2024-09-17T05:21:55.498235+0000","last_peered":"2024-09-17T05:21:55.498235+0000","last_clean":"2024-09-17T05:21:55.498235+0000","last_became_active":"2024-09-17T05:21:54.509861+0000","last_became_peered":"2024-09-17T05:21:54.509861+0000","last_unstale":"2024-09-17T05:21:55.498235+0000","last_undegraded":"2024-09-17T05:21:55.498235+0000","last_fullsized":"2024-09-17T05:21:55.498235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:35:45.144313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.749782+0000","last_change":"2024-09-17T05:21:54.498112+0000","last_active":"2024-09-17T05:21:55.749782+0000","last_peered":"2024-09-17T05:21:55.749782+0000","last_clean":"2024-09-17T05:21:55.749782+0000","last_became_active":"2024-09-17T05:21:54.497838+0000","last_became_peered":"2024-09-17T05:21:54.497838+0000","last_unstale":"2024-09-17T05:21:55.749782+0000","last_undegraded":"2024-09-17T05:21:55.749782+0000","last_fullsized":"2024-09-17T05:21:55.749782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:53:18.926924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.497008+0000","last_change":"2024-09-17T05:21:54.497275+0000","last_active":"2024-09-17T05:21:55.497008+0000","last_peered":"2024-09-17T05:21:55.497008+0000","last_clean":"2024-09-17T05:21:55.497008+0000","last_became_active":"2024-09-17T05:21:54.495616+0000","last_became_peered":"2024-09-17T05:21:54.495616+0000","last_unstale":"2024-09-17T05:21:55.497008+0000","last_undegraded":"2024-09-17T05:21:55.497008+0000","last_fullsized":"2024-09-17T05:21:55.497008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:29.213187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.502388+0000","last_change":"2024-09-17T05:21:54.504915+0000","last_active":"2024-09-17T05:21:55.502388+0000","last_peered":"2024-09-17T05:21:55.502388+0000","last_clean":"2024-09-17T05:21:55.502388+0000","last_became_active":"2024-09-17T05:21:54.503778+0000","last_became_peered":"2024-09-17T05:21:54.503778+0000","last_unstale":"2024-09-17T05:21:55.502388+0000","last_undegraded":"2024-09-17T05:21:55.502388+0000","last_fullsized":"2024-09-17T05:21:55.502388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:45.560083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.748111+0000","last_change":"2024-09-17T05:21:54.504130+0000","last_active":"2024-09-17T05:21:55.748111+0000","last_peered":"2024-09-17T05:21:55.748111+0000","last_clean":"2024-09-17T05:21:55.748111+0000","last_became_active":"2024-09-17T05:21:54.503843+0000","last_became_peered":"2024-09-17T05:21:54.503843+0000","last_unstale":"2024-09-17T05:21:55.748111+0000","last_undegraded":"2024-09-17T05:21:55.748111+0000","last_fullsized":"2024-09-17T05:21:55.748111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:41.750971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.498656+0000","last_change":"2024-09-17T05:21:54.509569+0000","last_active":"2024-09-17T05:21:55.498656+0000","last_peered":"2024-09-17T05:21:55.498656+0000","last_clean":"2024-09-17T05:21:55.498656+0000","last_became_active":"2024-09-17T05:21:54.508928+0000","last_became_peered":"2024-09-17T05:21:54.508928+0000","last_unstale":"2024-09-17T05:21:55.498656+0000","last_undegraded":"2024-09-17T05:21:55.498656+0000","last_fullsized":"2024-09-17T05:21:55.498656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:12:31.977218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.749141+0000","last_change":"2024-09-17T05:21:54.497160+0000","last_active":"2024-09-17T05:21:55.749141+0000","last_peered":"2024-09-17T05:21:55.749141+0000","last_clean":"2024-09-17T05:21:55.749141+0000","last_became_active":"2024-09-17T05:21:54.496885+0000","last_became_peered":"2024-09-17T05:21:54.496885+0000","last_unstale":"2024-09-17T05:21:55.749141+0000","last_undegraded":"2024-09-17T05:21:55.749141+0000","last_fullsized":"2024-09-17T05:21:55.749141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:59:59.386632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499016+0000","last_change":"2024-09-17T05:21:54.510866+0000","last_active":"2024-09-17T05:21:55.499016+0000","last_peered":"2024-09-17T05:21:55.499016+0000","last_clean":"2024-09-17T05:21:55.499016+0000","last_became_active":"2024-09-17T05:21:54.510301+0000","last_became_peered":"2024-09-17T05:21:54.510301+0000","last_unstale":"2024-09-17T05:21:55.499016+0000","last_undegraded":"2024-09-17T05:21:55.499016+0000","last_fullsized":"2024-09-17T05:21:55.499016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:52:10.150875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.748057+0000","last_change":"2024-09-17T05:21:54.501814+0000","last_active":"2024-09-17T05:21:55.748057+0000","last_peered":"2024-09-17T05:21:55.748057+0000","last_clean":"2024-09-17T05:21:55.748057+0000","last_became_active":"2024-09-17T05:21:54.501512+0000","last_became_peered":"2024-09-17T05:21:54.501512+0000","last_unstale":"2024-09-17T05:21:55.748057+0000","last_undegraded":"2024-09-17T05:21:55.748057+0000","last_fullsized":"2024-09-17T05:21:55.748057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:26.479441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.502586+0000","last_change":"2024-09-17T05:21:54.497869+0000","last_active":"2024-09-17T05:21:55.502586+0000","last_peered":"2024-09-17T05:21:55.502586+0000","last_clean":"2024-09-17T05:21:55.502586+0000","last_became_active":"2024-09-17T05:21:54.497583+0000","last_became_peered":"2024-09-17T05:21:54.497583+0000","last_unstale":"2024-09-17T05:21:55.502586+0000","last_undegraded":"2024-09-17T05:21:55.502586+0000","last_fullsized":"2024-09-17T05:21:55.502586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:42:01.373169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499859+0000","last_change":"2024-09-17T05:21:54.493860+0000","last_active":"2024-09-17T05:21:55.499859+0000","last_peered":"2024-09-17T05:21:55.499859+0000","last_clean":"2024-09-17T05:21:55.499859+0000","last_became_active":"2024-09-17T05:21:54.493554+0000","last_became_peered":"2024-09-17T05:21:54.493554+0000","last_unstale":"2024-09-17T05:21:55.499859+0000","last_undegraded":"2024-09-17T05:21:55.499859+0000","last_fullsized":"2024-09-17T05:21:55.499859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:30:58.548877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.748653+0000","last_change":"2024-09-17T05:21:54.498320+0000","last_active":"2024-09-17T05:21:55.748653+0000","last_peered":"2024-09-17T05:21:55.748653+0000","last_clean":"2024-09-17T05:21:55.748653+0000","last_became_active":"2024-09-17T05:21:54.498002+0000","last_became_peered":"2024-09-17T05:21:54.498002+0000","last_unstale":"2024-09-17T05:21:55.748653+0000","last_undegraded":"2024-09-17T05:21:55.748653+0000","last_fullsized":"2024-09-17T05:21:55.748653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:56:30.051932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.748189+0000","last_change":"2024-09-17T05:21:54.500883+0000","last_active":"2024-09-17T05:21:55.748189+0000","last_peered":"2024-09-17T05:21:55.748189+0000","last_clean":"2024-09-17T05:21:55.748189+0000","last_became_active":"2024-09-17T05:21:54.500587+0000","last_became_peered":"2024-09-17T05:21:54.500587+0000","last_unstale":"2024-09-17T05:21:55.748189+0000","last_undegraded":"2024-09-17T05:21:55.748189+0000","last_fullsized":"2024-09-17T05:21:55.748189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:45.560083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.498946+0000","last_change":"2024-09-17T05:21:54.508790+0000","last_active":"2024-09-17T05:21:55.498946+0000","last_peered":"2024-09-17T05:21:55.498946+0000","last_clean":"2024-09-17T05:21:55.498946+0000","last_became_active":"2024-09-17T05:21:54.508431+0000","last_became_peered":"2024-09-17T05:21:54.508431+0000","last_unstale":"2024-09-17T05:21:55.498946+0000","last_undegraded":"2024-09-17T05:21:55.498946+0000","last_fullsized":"2024-09-17T05:21:55.498946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:26:25.545759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.748213+0000","last_change":"2024-09-17T05:21:54.506270+0000","last_active":"2024-09-17T05:21:55.748213+0000","last_peered":"2024-09-17T05:21:55.748213+0000","last_clean":"2024-09-17T05:21:55.748213+0000","last_became_active":"2024-09-17T05:21:54.505940+0000","last_became_peered":"2024-09-17T05:21:54.505940+0000","last_unstale":"2024-09-17T05:21:55.748213+0000","last_undegraded":"2024-09-17T05:21:55.748213+0000","last_fullsized":"2024-09-17T05:21:55.748213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:50:43.095802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.502048+0000","last_change":"2024-09-17T05:21:54.505209+0000","last_active":"2024-09-17T05:21:55.502048+0000","last_peered":"2024-09-17T05:21:55.502048+0000","last_clean":"2024-09-17T05:21:55.502048+0000","last_became_active":"2024-09-17T05:21:54.504601+0000","last_became_peered":"2024-09-17T05:21:54.504601+0000","last_unstale":"2024-09-17T05:21:55.502048+0000","last_undegraded":"2024-09-17T05:21:55.502048+0000","last_fullsized":"2024-09-17T05:21:55.502048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:32.727377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.498911+0000","last_change":"2024-09-17T05:21:54.495748+0000","last_active":"2024-09-17T05:21:55.498911+0000","last_peered":"2024-09-17T05:21:55.498911+0000","last_clean":"2024-09-17T05:21:55.498911+0000","last_became_active":"2024-09-17T05:21:54.494696+0000","last_became_peered":"2024-09-17T05:21:54.494696+0000","last_unstale":"2024-09-17T05:21:55.498911+0000","last_undegraded":"2024-09-17T05:21:55.498911+0000","last_fullsized":"2024-09-17T05:21:55.498911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:02.422828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.749565+0000","last_change":"2024-09-17T05:21:53.484897+0000","last_active":"2024-09-17T05:21:55.749565+0000","last_peered":"2024-09-17T05:21:55.749565+0000","last_clean":"2024-09-17T05:21:55.749565+0000","last_became_active":"2024-09-17T05:21:53.484370+0000","last_became_peered":"2024-09-17T05:21:53.484370+0000","last_unstale":"2024-09-17T05:21:55.749565+0000","last_undegraded":"2024-09-17T05:21:55.749565+0000","last_fullsized":"2024-09-17T05:21:55.749565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:26:33.902720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.748296+0000","last_change":"2024-09-17T05:21:54.502294+0000","last_active":"2024-09-17T05:21:55.748296+0000","last_peered":"2024-09-17T05:21:55.748296+0000","last_clean":"2024-09-17T05:21:55.748296+0000","last_became_active":"2024-09-17T05:21:54.501214+0000","last_became_peered":"2024-09-17T05:21:54.501214+0000","last_unstale":"2024-09-17T05:21:55.748296+0000","last_undegraded":"2024-09-17T05:21:55.748296+0000","last_fullsized":"2024-09-17T05:21:55.748296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:42:01.373169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.502078+0000","last_change":"2024-09-17T05:21:53.493253+0000","last_active":"2024-09-17T05:21:55.502078+0000","last_peered":"2024-09-17T05:21:55.502078+0000","last_clean":"2024-09-17T05:21:55.502078+0000","last_became_active":"2024-09-17T05:21:53.492943+0000","last_became_peered":"2024-09-17T05:21:53.492943+0000","last_unstale":"2024-09-17T05:21:55.502078+0000","last_undegraded":"2024-09-17T05:21:55.502078+0000","last_fullsized":"2024-09-17T05:21:55.502078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:53:55.808093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.749171+0000","last_change":"2024-09-17T05:21:53.491206+0000","last_active":"2024-09-17T05:21:55.749171+0000","last_peered":"2024-09-17T05:21:55.749171+0000","last_clean":"2024-09-17T05:21:55.749171+0000","last_became_active":"2024-09-17T05:21:53.490940+0000","last_became_peered":"2024-09-17T05:21:53.490940+0000","last_unstale":"2024-09-17T05:21:55.749171+0000","last_undegraded":"2024-09-17T05:21:55.749171+0000","last_fullsized":"2024-09-17T05:21:55.749171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:39.425517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.748603+0000","last_change":"2024-09-17T05:21:54.504258+0000","last_active":"2024-09-17T05:21:55.748603+0000","last_peered":"2024-09-17T05:21:55.748603+0000","last_clean":"2024-09-17T05:21:55.748603+0000","last_became_active":"2024-09-17T05:21:54.503974+0000","last_became_peered":"2024-09-17T05:21:54.503974+0000","last_unstale":"2024-09-17T05:21:55.748603+0000","last_undegraded":"2024-09-17T05:21:55.748603+0000","last_fullsized":"2024-09-17T05:21:55.748603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:10.923504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499004+0000","last_change":"2024-09-17T05:21:53.489575+0000","last_active":"2024-09-17T05:21:55.499004+0000","last_peered":"2024-09-17T05:21:55.499004+0000","last_clean":"2024-09-17T05:21:55.499004+0000","last_became_active":"2024-09-17T05:21:53.489294+0000","last_became_peered":"2024-09-17T05:21:53.489294+0000","last_unstale":"2024-09-17T05:21:55.499004+0000","last_undegraded":"2024-09-17T05:21:55.499004+0000","last_fullsized":"2024-09-17T05:21:55.499004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:28.463818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499674+0000","last_change":"2024-09-17T05:21:54.494216+0000","last_active":"2024-09-17T05:21:55.499674+0000","last_peered":"2024-09-17T05:21:55.499674+0000","last_clean":"2024-09-17T05:21:55.499674+0000","last_became_active":"2024-09-17T05:21:54.492853+0000","last_became_peered":"2024-09-17T05:21:54.492853+0000","last_unstale":"2024-09-17T05:21:55.499674+0000","last_undegraded":"2024-09-17T05:21:55.499674+0000","last_fullsized":"2024-09-17T05:21:55.499674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:01:15.655368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.502262+0000","last_change":"2024-09-17T05:21:53.494796+0000","last_active":"2024-09-17T05:21:55.502262+0000","last_peered":"2024-09-17T05:21:55.502262+0000","last_clean":"2024-09-17T05:21:55.502262+0000","last_became_active":"2024-09-17T05:21:53.494486+0000","last_became_peered":"2024-09-17T05:21:53.494486+0000","last_unstale":"2024-09-17T05:21:55.502262+0000","last_undegraded":"2024-09-17T05:21:55.502262+0000","last_fullsized":"2024-09-17T05:21:55.502262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:59.914761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.497597+0000","last_change":"2024-09-17T05:21:54.509807+0000","last_active":"2024-09-17T05:21:55.497597+0000","last_peered":"2024-09-17T05:21:55.497597+0000","last_clean":"2024-09-17T05:21:55.497597+0000","last_became_active":"2024-09-17T05:21:54.509245+0000","last_became_peered":"2024-09-17T05:21:54.509245+0000","last_unstale":"2024-09-17T05:21:55.497597+0000","last_undegraded":"2024-09-17T05:21:55.497597+0000","last_fullsized":"2024-09-17T05:21:55.497597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:38:26.480830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.497949+0000","last_change":"2024-09-17T05:21:53.491049+0000","last_active":"2024-09-17T05:21:55.497949+0000","last_peered":"2024-09-17T05:21:55.497949+0000","last_clean":"2024-09-17T05:21:55.497949+0000","last_became_active":"2024-09-17T05:21:53.490795+0000","last_became_peered":"2024-09-17T05:21:53.490795+0000","last_unstale":"2024-09-17T05:21:55.497949+0000","last_undegraded":"2024-09-17T05:21:55.497949+0000","last_fullsized":"2024-09-17T05:21:55.497949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:03:21.023914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.748065+0000","last_change":"2024-09-17T05:21:54.512151+0000","last_active":"2024-09-17T05:21:55.748065+0000","last_peered":"2024-09-17T05:21:55.748065+0000","last_clean":"2024-09-17T05:21:55.748065+0000","last_became_active":"2024-09-17T05:21:54.511204+0000","last_became_peered":"2024-09-17T05:21:54.511204+0000","last_unstale":"2024-09-17T05:21:55.748065+0000","last_undegraded":"2024-09-17T05:21:55.748065+0000","last_fullsized":"2024-09-17T05:21:55.748065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:06:40.408782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499832+0000","last_change":"2024-09-17T05:21:53.493370+0000","last_active":"2024-09-17T05:21:55.499832+0000","last_peered":"2024-09-17T05:21:55.499832+0000","last_clean":"2024-09-17T05:21:55.499832+0000","last_became_active":"2024-09-17T05:21:53.493010+0000","last_became_peered":"2024-09-17T05:21:53.493010+0000","last_unstale":"2024-09-17T05:21:55.499832+0000","last_undegraded":"2024-09-17T05:21:55.499832+0000","last_fullsized":"2024-09-17T05:21:55.499832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:21.689266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499435+0000","last_change":"2024-09-17T05:21:54.499432+0000","last_active":"2024-09-17T05:21:55.499435+0000","last_peered":"2024-09-17T05:21:55.499435+0000","last_clean":"2024-09-17T05:21:55.499435+0000","last_became_active":"2024-09-17T05:21:54.499133+0000","last_became_peered":"2024-09-17T05:21:54.499133+0000","last_unstale":"2024-09-17T05:21:55.499435+0000","last_undegraded":"2024-09-17T05:21:55.499435+0000","last_fullsized":"2024-09-17T05:21:55.499435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:53:18.926924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.502291+0000","last_change":"2024-09-17T05:21:53.491745+0000","last_active":"2024-09-17T05:21:55.502291+0000","last_peered":"2024-09-17T05:21:55.502291+0000","last_clean":"2024-09-17T05:21:55.502291+0000","last_became_active":"2024-09-17T05:21:53.491464+0000","last_became_peered":"2024-09-17T05:21:53.491464+0000","last_unstale":"2024-09-17T05:21:55.502291+0000","last_undegraded":"2024-09-17T05:21:55.502291+0000","last_fullsized":"2024-09-17T05:21:55.502291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:03:27.097328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.496199+0000","last_change":"2024-09-17T05:21:54.493190+0000","last_active":"2024-09-17T05:21:55.496199+0000","last_peered":"2024-09-17T05:21:55.496199+0000","last_clean":"2024-09-17T05:21:55.496199+0000","last_became_active":"2024-09-17T05:21:54.492889+0000","last_became_peered":"2024-09-17T05:21:54.492889+0000","last_unstale":"2024-09-17T05:21:55.496199+0000","last_undegraded":"2024-09-17T05:21:55.496199+0000","last_fullsized":"2024-09-17T05:21:55.496199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:40.851639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.748250+0000","last_change":"2024-09-17T05:21:53.487462+0000","last_active":"2024-09-17T05:21:55.748250+0000","last_peered":"2024-09-17T05:21:55.748250+0000","last_clean":"2024-09-17T05:21:55.748250+0000","last_became_active":"2024-09-17T05:21:53.487189+0000","last_became_peered":"2024-09-17T05:21:53.487189+0000","last_unstale":"2024-09-17T05:21:55.748250+0000","last_undegraded":"2024-09-17T05:21:55.748250+0000","last_fullsized":"2024-09-17T05:21:55.748250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:37:20.042353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.748230+0000","last_change":"2024-09-17T05:21:54.500759+0000","last_active":"2024-09-17T05:21:55.748230+0000","last_peered":"2024-09-17T05:21:55.748230+0000","last_clean":"2024-09-17T05:21:55.748230+0000","last_became_active":"2024-09-17T05:21:54.500480+0000","last_became_peered":"2024-09-17T05:21:54.500480+0000","last_unstale":"2024-09-17T05:21:55.748230+0000","last_undegraded":"2024-09-17T05:21:55.748230+0000","last_fullsized":"2024-09-17T05:21:55.748230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:28:33.399315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499013+0000","last_change":"2024-09-17T05:21:53.489506+0000","last_active":"2024-09-17T05:21:55.499013+0000","last_peered":"2024-09-17T05:21:55.499013+0000","last_clean":"2024-09-17T05:21:55.499013+0000","last_became_active":"2024-09-17T05:21:53.488663+0000","last_became_peered":"2024-09-17T05:21:53.488663+0000","last_unstale":"2024-09-17T05:21:55.499013+0000","last_undegraded":"2024-09-17T05:21:55.499013+0000","last_fullsized":"2024-09-17T05:21:55.499013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:58:35.674900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.496782+0000","last_change":"2024-09-17T05:21:54.495318+0000","last_active":"2024-09-17T05:21:55.496782+0000","last_peered":"2024-09-17T05:21:55.496782+0000","last_clean":"2024-09-17T05:21:55.496782+0000","last_became_active":"2024-09-17T05:21:54.495022+0000","last_became_peered":"2024-09-17T05:21:54.495022+0000","last_unstale":"2024-09-17T05:21:55.496782+0000","last_undegraded":"2024-09-17T05:21:55.496782+0000","last_fullsized":"2024-09-17T05:21:55.496782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:12:31.977218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.501937+0000","last_change":"2024-09-17T05:21:53.493137+0000","last_active":"2024-09-17T05:21:55.501937+0000","last_peered":"2024-09-17T05:21:55.501937+0000","last_clean":"2024-09-17T05:21:55.501937+0000","last_became_active":"2024-09-17T05:21:53.492861+0000","last_became_peered":"2024-09-17T05:21:53.492861+0000","last_unstale":"2024-09-17T05:21:55.501937+0000","last_undegraded":"2024-09-17T05:21:55.501937+0000","last_fullsized":"2024-09-17T05:21:55.501937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:26:33.902720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.502039+0000","last_change":"2024-09-17T05:21:54.504481+0000","last_active":"2024-09-17T05:21:55.502039+0000","last_peered":"2024-09-17T05:21:55.502039+0000","last_clean":"2024-09-17T05:21:55.502039+0000","last_became_active":"2024-09-17T05:21:54.504110+0000","last_became_peered":"2024-09-17T05:21:54.504110+0000","last_unstale":"2024-09-17T05:21:55.502039+0000","last_undegraded":"2024-09-17T05:21:55.502039+0000","last_fullsized":"2024-09-17T05:21:55.502039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:06.884350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.748146+0000","last_change":"2024-09-17T05:21:53.487613+0000","last_active":"2024-09-17T05:21:55.748146+0000","last_peered":"2024-09-17T05:21:55.748146+0000","last_clean":"2024-09-17T05:21:55.748146+0000","last_became_active":"2024-09-17T05:21:53.487341+0000","last_became_peered":"2024-09-17T05:21:53.487341+0000","last_unstale":"2024-09-17T05:21:55.748146+0000","last_undegraded":"2024-09-17T05:21:55.748146+0000","last_fullsized":"2024-09-17T05:21:55.748146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:26:33.902720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.496294+0000","last_change":"2024-09-17T05:21:54.500288+0000","last_active":"2024-09-17T05:21:55.496294+0000","last_peered":"2024-09-17T05:21:55.496294+0000","last_clean":"2024-09-17T05:21:55.496294+0000","last_became_active":"2024-09-17T05:21:54.499508+0000","last_became_peered":"2024-09-17T05:21:54.499508+0000","last_unstale":"2024-09-17T05:21:55.496294+0000","last_undegraded":"2024-09-17T05:21:55.496294+0000","last_fullsized":"2024-09-17T05:21:55.496294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:51.043848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499138+0000","last_change":"2024-09-17T05:21:53.486134+0000","last_active":"2024-09-17T05:21:55.499138+0000","last_peered":"2024-09-17T05:21:55.499138+0000","last_clean":"2024-09-17T05:21:55.499138+0000","last_became_active":"2024-09-17T05:21:53.485804+0000","last_became_peered":"2024-09-17T05:21:53.485804+0000","last_unstale":"2024-09-17T05:21:55.499138+0000","last_undegraded":"2024-09-17T05:21:55.499138+0000","last_fullsized":"2024-09-17T05:21:55.499138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:34:05.720343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.497407+0000","last_change":"2024-09-17T05:21:54.499818+0000","last_active":"2024-09-17T05:21:55.497407+0000","last_peered":"2024-09-17T05:21:55.497407+0000","last_clean":"2024-09-17T05:21:55.497407+0000","last_became_active":"2024-09-17T05:21:54.499298+0000","last_became_peered":"2024-09-17T05:21:54.499298+0000","last_unstale":"2024-09-17T05:21:55.497407+0000","last_undegraded":"2024-09-17T05:21:55.497407+0000","last_fullsized":"2024-09-17T05:21:55.497407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:26:25.545759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.749690+0000","last_change":"2024-09-17T05:21:53.487000+0000","last_active":"2024-09-17T05:21:55.749690+0000","last_peered":"2024-09-17T05:21:55.749690+0000","last_clean":"2024-09-17T05:21:55.749690+0000","last_became_active":"2024-09-17T05:21:53.486705+0000","last_became_peered":"2024-09-17T05:21:53.486705+0000","last_unstale":"2024-09-17T05:21:55.749690+0000","last_undegraded":"2024-09-17T05:21:55.749690+0000","last_fullsized":"2024-09-17T05:21:55.749690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:53:55.808093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.497849+0000","last_change":"2024-09-17T05:21:54.499532+0000","last_active":"2024-09-17T05:21:55.497849+0000","last_peered":"2024-09-17T05:21:55.497849+0000","last_clean":"2024-09-17T05:21:55.497849+0000","last_became_active":"2024-09-17T05:21:54.499228+0000","last_became_peered":"2024-09-17T05:21:54.499228+0000","last_unstale":"2024-09-17T05:21:55.497849+0000","last_undegraded":"2024-09-17T05:21:55.497849+0000","last_fullsized":"2024-09-17T05:21:55.497849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:34:49.600804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499922+0000","last_change":"2024-09-17T05:21:53.481560+0000","last_active":"2024-09-17T05:21:55.499922+0000","last_peered":"2024-09-17T05:21:55.499922+0000","last_clean":"2024-09-17T05:21:55.499922+0000","last_became_active":"2024-09-17T05:21:53.481288+0000","last_became_peered":"2024-09-17T05:21:53.481288+0000","last_unstale":"2024-09-17T05:21:55.499922+0000","last_undegraded":"2024-09-17T05:21:55.499922+0000","last_fullsized":"2024-09-17T05:21:55.499922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:14:54.894468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.498134+0000","last_change":"2024-09-17T05:21:54.507480+0000","last_active":"2024-09-17T05:21:55.498134+0000","last_peered":"2024-09-17T05:21:55.498134+0000","last_clean":"2024-09-17T05:21:55.498134+0000","last_became_active":"2024-09-17T05:21:54.507184+0000","last_became_peered":"2024-09-17T05:21:54.507184+0000","last_unstale":"2024-09-17T05:21:55.498134+0000","last_undegraded":"2024-09-17T05:21:55.498134+0000","last_fullsized":"2024-09-17T05:21:55.498134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:40.851639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.749572+0000","last_change":"2024-09-17T05:21:53.493592+0000","last_active":"2024-09-17T05:21:55.749572+0000","last_peered":"2024-09-17T05:21:55.749572+0000","last_clean":"2024-09-17T05:21:55.749572+0000","last_became_active":"2024-09-17T05:21:53.492958+0000","last_became_peered":"2024-09-17T05:21:53.492958+0000","last_unstale":"2024-09-17T05:21:55.749572+0000","last_undegraded":"2024-09-17T05:21:55.749572+0000","last_fullsized":"2024-09-17T05:21:55.749572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:25.985141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.496458+0000","last_change":"2024-09-17T05:21:54.509525+0000","last_active":"2024-09-17T05:21:55.496458+0000","last_peered":"2024-09-17T05:21:55.496458+0000","last_clean":"2024-09-17T05:21:55.496458+0000","last_became_active":"2024-09-17T05:21:54.509257+0000","last_became_peered":"2024-09-17T05:21:54.509257+0000","last_unstale":"2024-09-17T05:21:55.496458+0000","last_undegraded":"2024-09-17T05:21:55.496458+0000","last_fullsized":"2024-09-17T05:21:55.496458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:34:47.447957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.495985+0000","last_change":"2024-09-17T05:21:44.086098+0000","last_active":"2024-09-17T05:21:55.495985+0000","last_peered":"2024-09-17T05:21:55.495985+0000","last_clean":"2024-09-17T05:21:55.495985+0000","last_became_active":"2024-09-17T05:21:44.083477+0000","last_became_peered":"2024-09-17T05:21:44.083477+0000","last_unstale":"2024-09-17T05:21:55.495985+0000","last_undegraded":"2024-09-17T05:21:55.495985+0000","last_fullsized":"2024-09-17T05:21:55.495985+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:42.925756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:42.925756+0000","last_clean_scrub_stamp":"2024-09-17T05:21:42.925756+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:11.410250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.497233+0000","last_change":"2024-09-17T05:21:53.490183+0000","last_active":"2024-09-17T05:21:55.497233+0000","last_peered":"2024-09-17T05:21:55.497233+0000","last_clean":"2024-09-17T05:21:55.497233+0000","last_became_active":"2024-09-17T05:21:53.489914+0000","last_became_peered":"2024-09-17T05:21:53.489914+0000","last_unstale":"2024-09-17T05:21:55.497233+0000","last_undegraded":"2024-09-17T05:21:55.497233+0000","last_fullsized":"2024-09-17T05:21:55.497233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:55:15.542710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.749341+0000","last_change":"2024-09-17T05:21:54.510457+0000","last_active":"2024-09-17T05:21:55.749341+0000","last_peered":"2024-09-17T05:21:55.749341+0000","last_clean":"2024-09-17T05:21:55.749341+0000","last_became_active":"2024-09-17T05:21:54.510191+0000","last_became_peered":"2024-09-17T05:21:54.510191+0000","last_unstale":"2024-09-17T05:21:55.749341+0000","last_undegraded":"2024-09-17T05:21:55.749341+0000","last_fullsized":"2024-09-17T05:21:55.749341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:54:11.270930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.495899+0000","last_change":"2024-09-17T05:21:53.484333+0000","last_active":"2024-09-17T05:21:55.495899+0000","last_peered":"2024-09-17T05:21:55.495899+0000","last_clean":"2024-09-17T05:21:55.495899+0000","last_became_active":"2024-09-17T05:21:53.483640+0000","last_became_peered":"2024-09-17T05:21:53.483640+0000","last_unstale":"2024-09-17T05:21:55.495899+0000","last_undegraded":"2024-09-17T05:21:55.495899+0000","last_fullsized":"2024-09-17T05:21:55.495899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:37:47.645603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.747762+0000","last_change":"2024-09-17T05:21:54.501913+0000","last_active":"2024-09-17T05:21:55.747762+0000","last_peered":"2024-09-17T05:21:55.747762+0000","last_clean":"2024-09-17T05:21:55.747762+0000","last_became_active":"2024-09-17T05:21:54.501513+0000","last_became_peered":"2024-09-17T05:21:54.501513+0000","last_unstale":"2024-09-17T05:21:55.747762+0000","last_undegraded":"2024-09-17T05:21:55.747762+0000","last_fullsized":"2024-09-17T05:21:55.747762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:41.511545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.748269+0000","last_change":"2024-09-17T05:21:53.487710+0000","last_active":"2024-09-17T05:21:55.748269+0000","last_peered":"2024-09-17T05:21:55.748269+0000","last_clean":"2024-09-17T05:21:55.748269+0000","last_became_active":"2024-09-17T05:21:53.487436+0000","last_became_peered":"2024-09-17T05:21:53.487436+0000","last_unstale":"2024-09-17T05:21:55.748269+0000","last_undegraded":"2024-09-17T05:21:55.748269+0000","last_fullsized":"2024-09-17T05:21:55.748269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:03:27.097328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499651+0000","last_change":"2024-09-17T05:21:54.497084+0000","last_active":"2024-09-17T05:21:55.499651+0000","last_peered":"2024-09-17T05:21:55.499651+0000","last_clean":"2024-09-17T05:21:55.499651+0000","last_became_active":"2024-09-17T05:21:54.495742+0000","last_became_peered":"2024-09-17T05:21:54.495742+0000","last_unstale":"2024-09-17T05:21:55.499651+0000","last_undegraded":"2024-09-17T05:21:55.499651+0000","last_fullsized":"2024-09-17T05:21:55.499651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:27:18.182327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499082+0000","last_change":"2024-09-17T05:21:53.490161+0000","last_active":"2024-09-17T05:21:55.499082+0000","last_peered":"2024-09-17T05:21:55.499082+0000","last_clean":"2024-09-17T05:21:55.499082+0000","last_became_active":"2024-09-17T05:21:53.489883+0000","last_became_peered":"2024-09-17T05:21:53.489883+0000","last_unstale":"2024-09-17T05:21:55.499082+0000","last_undegraded":"2024-09-17T05:21:55.499082+0000","last_fullsized":"2024-09-17T05:21:55.499082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:08.690514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499340+0000","last_change":"2024-09-17T05:21:54.503475+0000","last_active":"2024-09-17T05:21:55.499340+0000","last_peered":"2024-09-17T05:21:55.499340+0000","last_clean":"2024-09-17T05:21:55.499340+0000","last_became_active":"2024-09-17T05:21:54.503198+0000","last_became_peered":"2024-09-17T05:21:54.503198+0000","last_unstale":"2024-09-17T05:21:55.499340+0000","last_undegraded":"2024-09-17T05:21:55.499340+0000","last_fullsized":"2024-09-17T05:21:55.499340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:50:43.095802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499769+0000","last_change":"2024-09-17T05:21:53.484383+0000","last_active":"2024-09-17T05:21:55.499769+0000","last_peered":"2024-09-17T05:21:55.499769+0000","last_clean":"2024-09-17T05:21:55.499769+0000","last_became_active":"2024-09-17T05:21:53.484071+0000","last_became_peered":"2024-09-17T05:21:53.484071+0000","last_unstale":"2024-09-17T05:21:55.499769+0000","last_undegraded":"2024-09-17T05:21:55.499769+0000","last_fullsized":"2024-09-17T05:21:55.499769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:35:29.473422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.498541+0000","last_change":"2024-09-17T05:21:54.514953+0000","last_active":"2024-09-17T05:21:55.498541+0000","last_peered":"2024-09-17T05:21:55.498541+0000","last_clean":"2024-09-17T05:21:55.498541+0000","last_became_active":"2024-09-17T05:21:54.514665+0000","last_became_peered":"2024-09-17T05:21:54.514665+0000","last_unstale":"2024-09-17T05:21:55.498541+0000","last_undegraded":"2024-09-17T05:21:55.498541+0000","last_fullsized":"2024-09-17T05:21:55.498541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:38.013877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.497013+0000","last_change":"2024-09-17T05:21:53.489197+0000","last_active":"2024-09-17T05:21:55.497013+0000","last_peered":"2024-09-17T05:21:55.497013+0000","last_clean":"2024-09-17T05:21:55.497013+0000","last_became_active":"2024-09-17T05:21:53.484928+0000","last_became_peered":"2024-09-17T05:21:53.484928+0000","last_unstale":"2024-09-17T05:21:55.497013+0000","last_undegraded":"2024-09-17T05:21:55.497013+0000","last_fullsized":"2024-09-17T05:21:55.497013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:28.936504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499864+0000","last_change":"2024-09-17T05:21:54.497779+0000","last_active":"2024-09-17T05:21:55.499864+0000","last_peered":"2024-09-17T05:21:55.499864+0000","last_clean":"2024-09-17T05:21:55.499864+0000","last_became_active":"2024-09-17T05:21:54.497343+0000","last_became_peered":"2024-09-17T05:21:54.497343+0000","last_unstale":"2024-09-17T05:21:55.499864+0000","last_undegraded":"2024-09-17T05:21:55.499864+0000","last_fullsized":"2024-09-17T05:21:55.499864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:34:38.737329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.501521+0000","last_change":"2024-09-17T05:21:53.490515+0000","last_active":"2024-09-17T05:21:55.501521+0000","last_peered":"2024-09-17T05:21:55.501521+0000","last_clean":"2024-09-17T05:21:55.501521+0000","last_became_active":"2024-09-17T05:21:53.490173+0000","last_became_peered":"2024-09-17T05:21:53.490173+0000","last_unstale":"2024-09-17T05:21:55.501521+0000","last_undegraded":"2024-09-17T05:21:55.501521+0000","last_fullsized":"2024-09-17T05:21:55.501521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:42.132331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.748234+0000","last_change":"2024-09-17T05:21:54.494254+0000","last_active":"2024-09-17T05:21:55.748234+0000","last_peered":"2024-09-17T05:21:55.748234+0000","last_clean":"2024-09-17T05:21:55.748234+0000","last_became_active":"2024-09-17T05:21:54.493968+0000","last_became_peered":"2024-09-17T05:21:54.493968+0000","last_unstale":"2024-09-17T05:21:55.748234+0000","last_undegraded":"2024-09-17T05:21:55.748234+0000","last_fullsized":"2024-09-17T05:21:55.748234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:06.884350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.502396+0000","last_change":"2024-09-17T05:21:53.494784+0000","last_active":"2024-09-17T05:21:55.502396+0000","last_peered":"2024-09-17T05:21:55.502396+0000","last_clean":"2024-09-17T05:21:55.502396+0000","last_became_active":"2024-09-17T05:21:53.494504+0000","last_became_peered":"2024-09-17T05:21:53.494504+0000","last_unstale":"2024-09-17T05:21:55.502396+0000","last_undegraded":"2024-09-17T05:21:55.502396+0000","last_fullsized":"2024-09-17T05:21:55.502396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:13:50.064294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.747891+0000","last_change":"2024-09-17T05:21:54.493842+0000","last_active":"2024-09-17T05:21:55.747891+0000","last_peered":"2024-09-17T05:21:55.747891+0000","last_clean":"2024-09-17T05:21:55.747891+0000","last_became_active":"2024-09-17T05:21:54.493586+0000","last_became_peered":"2024-09-17T05:21:54.493586+0000","last_unstale":"2024-09-17T05:21:55.747891+0000","last_undegraded":"2024-09-17T05:21:55.747891+0000","last_fullsized":"2024-09-17T05:21:55.747891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:14:39.618479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.495902+0000","last_change":"2024-09-17T05:21:53.484810+0000","last_active":"2024-09-17T05:21:55.495902+0000","last_peered":"2024-09-17T05:21:55.495902+0000","last_clean":"2024-09-17T05:21:55.495902+0000","last_became_active":"2024-09-17T05:21:53.484016+0000","last_became_peered":"2024-09-17T05:21:53.484016+0000","last_unstale":"2024-09-17T05:21:55.495902+0000","last_undegraded":"2024-09-17T05:21:55.495902+0000","last_fullsized":"2024-09-17T05:21:55.495902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:58:35.674900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499028+0000","last_change":"2024-09-17T05:21:54.498171+0000","last_active":"2024-09-17T05:21:55.499028+0000","last_peered":"2024-09-17T05:21:55.499028+0000","last_clean":"2024-09-17T05:21:55.499028+0000","last_became_active":"2024-09-17T05:21:54.497780+0000","last_became_peered":"2024-09-17T05:21:54.497780+0000","last_unstale":"2024-09-17T05:21:55.499028+0000","last_undegraded":"2024-09-17T05:21:55.499028+0000","last_fullsized":"2024-09-17T05:21:55.499028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:53:19.454025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499780+0000","last_change":"2024-09-17T05:21:53.487419+0000","last_active":"2024-09-17T05:21:55.499780+0000","last_peered":"2024-09-17T05:21:55.499780+0000","last_clean":"2024-09-17T05:21:55.499780+0000","last_became_active":"2024-09-17T05:21:53.485874+0000","last_became_peered":"2024-09-17T05:21:53.485874+0000","last_unstale":"2024-09-17T05:21:55.499780+0000","last_undegraded":"2024-09-17T05:21:55.499780+0000","last_fullsized":"2024-09-17T05:21:55.499780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:31.652148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.748779+0000","last_change":"2024-09-17T05:21:54.500587+0000","last_active":"2024-09-17T05:21:55.748779+0000","last_peered":"2024-09-17T05:21:55.748779+0000","last_clean":"2024-09-17T05:21:55.748779+0000","last_became_active":"2024-09-17T05:21:54.500333+0000","last_became_peered":"2024-09-17T05:21:54.500333+0000","last_unstale":"2024-09-17T05:21:55.748779+0000","last_undegraded":"2024-09-17T05:21:55.748779+0000","last_fullsized":"2024-09-17T05:21:55.748779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:53.919157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499720+0000","last_change":"2024-09-17T05:21:53.486091+0000","last_active":"2024-09-17T05:21:55.499720+0000","last_peered":"2024-09-17T05:21:55.499720+0000","last_clean":"2024-09-17T05:21:55.499720+0000","last_became_active":"2024-09-17T05:21:53.485314+0000","last_became_peered":"2024-09-17T05:21:53.485314+0000","last_unstale":"2024-09-17T05:21:55.499720+0000","last_undegraded":"2024-09-17T05:21:55.499720+0000","last_fullsized":"2024-09-17T05:21:55.499720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:53:42.808589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.749674+0000","last_change":"2024-09-17T05:21:54.503373+0000","last_active":"2024-09-17T05:21:55.749674+0000","last_peered":"2024-09-17T05:21:55.749674+0000","last_clean":"2024-09-17T05:21:55.749674+0000","last_became_active":"2024-09-17T05:21:54.503073+0000","last_became_peered":"2024-09-17T05:21:54.503073+0000","last_unstale":"2024-09-17T05:21:55.749674+0000","last_undegraded":"2024-09-17T05:21:55.749674+0000","last_fullsized":"2024-09-17T05:21:55.749674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:28.960088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.496712+0000","last_change":"2024-09-17T05:21:53.489998+0000","last_active":"2024-09-17T05:21:55.496712+0000","last_peered":"2024-09-17T05:21:55.496712+0000","last_clean":"2024-09-17T05:21:55.496712+0000","last_became_active":"2024-09-17T05:21:53.489673+0000","last_became_peered":"2024-09-17T05:21:53.489673+0000","last_unstale":"2024-09-17T05:21:55.496712+0000","last_undegraded":"2024-09-17T05:21:55.496712+0000","last_fullsized":"2024-09-17T05:21:55.496712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:15.739862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.502066+0000","last_change":"2024-09-17T05:21:54.504813+0000","last_active":"2024-09-17T05:21:55.502066+0000","last_peered":"2024-09-17T05:21:55.502066+0000","last_clean":"2024-09-17T05:21:55.502066+0000","last_became_active":"2024-09-17T05:21:54.504086+0000","last_became_peered":"2024-09-17T05:21:54.504086+0000","last_unstale":"2024-09-17T05:21:55.502066+0000","last_undegraded":"2024-09-17T05:21:55.502066+0000","last_fullsized":"2024-09-17T05:21:55.502066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:06:40.408782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.498308+0000","last_change":"2024-09-17T05:21:54.512621+0000","last_active":"2024-09-17T05:21:55.498308+0000","last_peered":"2024-09-17T05:21:55.498308+0000","last_clean":"2024-09-17T05:21:55.498308+0000","last_became_active":"2024-09-17T05:21:54.512256+0000","last_became_peered":"2024-09-17T05:21:54.512256+0000","last_unstale":"2024-09-17T05:21:55.498308+0000","last_undegraded":"2024-09-17T05:21:55.498308+0000","last_fullsized":"2024-09-17T05:21:55.498308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:34:47.447957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.496194+0000","last_change":"2024-09-17T05:21:53.490984+0000","last_active":"2024-09-17T05:21:55.496194+0000","last_peered":"2024-09-17T05:21:55.496194+0000","last_clean":"2024-09-17T05:21:55.496194+0000","last_became_active":"2024-09-17T05:21:53.490001+0000","last_became_peered":"2024-09-17T05:21:53.490001+0000","last_unstale":"2024-09-17T05:21:55.496194+0000","last_undegraded":"2024-09-17T05:21:55.496194+0000","last_fullsized":"2024-09-17T05:21:55.496194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:08.690514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.497721+0000","last_change":"2024-09-17T05:21:54.510777+0000","last_active":"2024-09-17T05:21:55.497721+0000","last_peered":"2024-09-17T05:21:55.497721+0000","last_clean":"2024-09-17T05:21:55.497721+0000","last_became_active":"2024-09-17T05:21:54.510517+0000","last_became_peered":"2024-09-17T05:21:54.510517+0000","last_unstale":"2024-09-17T05:21:55.497721+0000","last_undegraded":"2024-09-17T05:21:55.497721+0000","last_fullsized":"2024-09-17T05:21:55.497721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:49:06.303460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.496892+0000","last_change":"2024-09-17T05:21:53.491157+0000","last_active":"2024-09-17T05:21:55.496892+0000","last_peered":"2024-09-17T05:21:55.496892+0000","last_clean":"2024-09-17T05:21:55.496892+0000","last_became_active":"2024-09-17T05:21:53.490315+0000","last_became_peered":"2024-09-17T05:21:53.490315+0000","last_unstale":"2024-09-17T05:21:55.496892+0000","last_undegraded":"2024-09-17T05:21:55.496892+0000","last_fullsized":"2024-09-17T05:21:55.496892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:58:14.211132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.747944+0000","last_change":"2024-09-17T05:21:54.512428+0000","last_active":"2024-09-17T05:21:55.747944+0000","last_peered":"2024-09-17T05:21:55.747944+0000","last_clean":"2024-09-17T05:21:55.747944+0000","last_became_active":"2024-09-17T05:21:54.511546+0000","last_became_peered":"2024-09-17T05:21:54.511546+0000","last_unstale":"2024-09-17T05:21:55.747944+0000","last_undegraded":"2024-09-17T05:21:55.747944+0000","last_fullsized":"2024-09-17T05:21:55.747944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:32.727377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.749095+0000","last_change":"2024-09-17T05:21:53.483928+0000","last_active":"2024-09-17T05:21:55.749095+0000","last_peered":"2024-09-17T05:21:55.749095+0000","last_clean":"2024-09-17T05:21:55.749095+0000","last_became_active":"2024-09-17T05:21:53.483478+0000","last_became_peered":"2024-09-17T05:21:53.483478+0000","last_unstale":"2024-09-17T05:21:55.749095+0000","last_undegraded":"2024-09-17T05:21:55.749095+0000","last_fullsized":"2024-09-17T05:21:55.749095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:25.985141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.749036+0000","last_change":"2024-09-17T05:21:54.499626+0000","last_active":"2024-09-17T05:21:55.749036+0000","last_peered":"2024-09-17T05:21:55.749036+0000","last_clean":"2024-09-17T05:21:55.749036+0000","last_became_active":"2024-09-17T05:21:54.499321+0000","last_became_peered":"2024-09-17T05:21:54.499321+0000","last_unstale":"2024-09-17T05:21:55.749036+0000","last_undegraded":"2024-09-17T05:21:55.749036+0000","last_fullsized":"2024-09-17T05:21:55.749036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:44:54.516203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.748008+0000","last_change":"2024-09-17T05:21:53.486585+0000","last_active":"2024-09-17T05:21:55.748008+0000","last_peered":"2024-09-17T05:21:55.748008+0000","last_clean":"2024-09-17T05:21:55.748008+0000","last_became_active":"2024-09-17T05:21:53.486306+0000","last_became_peered":"2024-09-17T05:21:53.486306+0000","last_unstale":"2024-09-17T05:21:55.748008+0000","last_undegraded":"2024-09-17T05:21:55.748008+0000","last_fullsized":"2024-09-17T05:21:55.748008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:19.726620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":74993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":73381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":815104,"data_stored":664387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":806912,"data_stored":664331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":74993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":73471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542152,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":73507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":73541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:22:04.937 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:22:05.074 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.073+0000 7f00798f7640 1 -- 172.21.15.98:0/161804320 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f007406d280 msgr2=0x7f0074166a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:05.074 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.073+0000 7f00798f7640 1 --2- 172.21.15.98:0/161804320 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f007406d280 0x7f0074166a90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f006c009830 tx=0x7f006c02a510 comp rx=0 tx=0).stop 2024-09-17T05:22:05.074 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.073+0000 7f00798f7640 1 -- 172.21.15.98:0/161804320 shutdown_connections 2024-09-17T05:22:05.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.073+0000 7f00798f7640 1 --2- 172.21.15.98:0/161804320 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f007406d280 0x7f0074166a90 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:05.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.073+0000 7f00798f7640 1 -- 172.21.15.98:0/161804320 >> 172.21.15.98:0/161804320 conn(0x7f00740d0d40 msgr2=0x7f00740d1120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:05.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.073+0000 7f00798f7640 1 -- 172.21.15.98:0/161804320 shutdown_connections 2024-09-17T05:22:05.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.073+0000 7f00798f7640 1 -- 172.21.15.98:0/161804320 wait complete. 2024-09-17T05:22:05.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.074+0000 7f00798f7640 1 Processor -- start 2024-09-17T05:22:05.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.074+0000 7f00798f7640 1 -- start start 2024-09-17T05:22:05.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.075+0000 7f00798f7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f007406d280 0x7f00741555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:05.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.075+0000 7f00798f7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00740b6290 0x7f00740cb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:05.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.075+0000 7f00798f7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00740cd330 0x7f00740cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:05.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.075+0000 7f00798f7640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0074167150 con 0x7f007406d280 2024-09-17T05:22:05.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.075+0000 7f00798f7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0074166fd0 con 0x7f00740b6290 2024-09-17T05:22:05.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.075+0000 7f00798f7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f00741672d0 con 0x7f00740cd330 2024-09-17T05:22:05.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.075+0000 7f0072ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f007406d280 0x7f00741555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:05.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.075+0000 7f0072ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f007406d280 0x7f00741555f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47862/0 (socket says 172.21.15.98:47862) 2024-09-17T05:22:05.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.075+0000 7f0072ffd640 1 -- 172.21.15.98:0/1696716181 learned_addr learned my addr 172.21.15.98:0/1696716181 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:05.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.075+0000 7f00737fe640 1 --2- 172.21.15.98:0/1696716181 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00740cd330 0x7f00740cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:05.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.075+0000 7f00727fc640 1 --2- 172.21.15.98:0/1696716181 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00740b6290 0x7f00740cb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:05.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.076+0000 7f0072ffd640 1 -- 172.21.15.98:0/1696716181 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00740cd330 msgr2=0x7f00740cbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:05.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.076+0000 7f0072ffd640 1 --2- 172.21.15.98:0/1696716181 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00740cd330 0x7f00740cbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:05.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.076+0000 7f0072ffd640 1 -- 172.21.15.98:0/1696716181 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00740b6290 msgr2=0x7f00740cb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:05.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.076+0000 7f0072ffd640 1 --2- 172.21.15.98:0/1696716181 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00740b6290 0x7f00740cb850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:05.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.076+0000 7f0072ffd640 1 -- 172.21.15.98:0/1696716181 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00740c9ec0 con 0x7f007406d280 2024-09-17T05:22:05.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.076+0000 7f00727fc640 1 --2- 172.21.15.98:0/1696716181 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00740b6290 0x7f00740cb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:22:05.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.076+0000 7f0072ffd640 1 --2- 172.21.15.98:0/1696716181 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f007406d280 0x7f00741555f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f006400c7d0 tx=0x7f006400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:05.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.076+0000 7f006bfff640 1 -- 172.21.15.98:0/1696716181 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0064017070 con 0x7f007406d280 2024-09-17T05:22:05.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.076+0000 7f006bfff640 1 -- 172.21.15.98:0/1696716181 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0064005070 con 0x7f007406d280 2024-09-17T05:22:05.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.076+0000 7f006bfff640 1 -- 172.21.15.98:0/1696716181 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00640054c0 con 0x7f007406d280 2024-09-17T05:22:05.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.076+0000 7f00798f7640 1 -- 172.21.15.98:0/1696716181 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00740ca1a0 con 0x7f007406d280 2024-09-17T05:22:05.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.076+0000 7f00798f7640 1 -- 172.21.15.98:0/1696716181 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0074155b30 con 0x7f007406d280 2024-09-17T05:22:05.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.077+0000 7f00798f7640 1 -- 172.21.15.98:0/1696716181 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f007415aa60 con 0x7f007406d280 2024-09-17T05:22:05.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.077+0000 7f006bfff640 1 -- 172.21.15.98:0/1696716181 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f006401a070 con 0x7f007406d280 2024-09-17T05:22:05.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.078+0000 7f006bfff640 1 --2- 172.21.15.98:0/1696716181 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f0054078bc0 0x7f005407b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:05.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.078+0000 7f006bfff640 1 -- 172.21.15.98:0/1696716181 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f006409a2e0 con 0x7f007406d280 2024-09-17T05:22:05.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.078+0000 7f00727fc640 1 --2- 172.21.15.98:0/1696716181 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f0054078bc0 0x7f005407b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:05.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.079+0000 7f00727fc640 1 --2- 172.21.15.98:0/1696716181 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f0054078bc0 0x7f005407b080 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f00741599c0 tx=0x7f005c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:05.083 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.082+0000 7f006bfff640 1 -- 172.21.15.98:0/1696716181 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f007415aa60 con 0x7f007406d280 2024-09-17T05:22:05.254 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.254+0000 7f00798f7640 1 -- 172.21.15.98:0/1696716181 --> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f00740ca370 con 0x7f0054078bc0 2024-09-17T05:22:05.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.258+0000 7f006bfff640 1 -- 172.21.15.98:0/1696716181 <== mgr.4103 v2:172.21.15.167:6800/610796449 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251825 (secure 0 0 0) 0x7f00740ca370 con 0x7f0054078bc0 2024-09-17T05:22:05.261 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:22:05.263 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-17T05:22:05.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.262+0000 7f00798f7640 1 -- 172.21.15.98:0/1696716181 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f0054078bc0 msgr2=0x7f005407b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:05.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.262+0000 7f00798f7640 1 --2- 172.21.15.98:0/1696716181 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f0054078bc0 0x7f005407b080 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f00741599c0 tx=0x7f005c009040 comp rx=0 tx=0).stop 2024-09-17T05:22:05.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.262+0000 7f00798f7640 1 -- 172.21.15.98:0/1696716181 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f007406d280 msgr2=0x7f00741555f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:05.265 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.262+0000 7f00798f7640 1 --2- 172.21.15.98:0/1696716181 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f007406d280 0x7f00741555f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f006400c7d0 tx=0x7f006400cc90 comp rx=0 tx=0).stop 2024-09-17T05:22:05.265 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.262+0000 7f00798f7640 1 -- 172.21.15.98:0/1696716181 shutdown_connections 2024-09-17T05:22:05.265 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.262+0000 7f00798f7640 1 --2- 172.21.15.98:0/1696716181 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f0054078bc0 0x7f005407b080 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:05.265 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.262+0000 7f00798f7640 1 --2- 172.21.15.98:0/1696716181 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00740cd330 0x7f00740cbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:05.265 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.262+0000 7f00798f7640 1 --2- 172.21.15.98:0/1696716181 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00740b6290 0x7f00740cb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:05.265 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.262+0000 7f00798f7640 1 --2- 172.21.15.98:0/1696716181 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f007406d280 0x7f00741555f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:05.265 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.262+0000 7f00798f7640 1 -- 172.21.15.98:0/1696716181 >> 172.21.15.98:0/1696716181 conn(0x7f00740d0d40 msgr2=0x7f00740ce080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:05.265 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.262+0000 7f00798f7640 1 -- 172.21.15.98:0/1696716181 shutdown_connections 2024-09-17T05:22:05.265 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.262+0000 7f00798f7640 1 -- 172.21.15.98:0/1696716181 wait complete. 2024-09-17T05:22:05.273 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-09-17T05:22:04.250041+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219108,"kb_used_data":2856,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755612,"statfs":{"total":773094113280,"available":772869746688,"internally_reserved":0,"allocated":2924544,"data_stored":1772604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.764349"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.497272+0000","last_change":"2024-09-17T05:21:54.501153+0000","last_active":"2024-09-17T05:21:55.497272+0000","last_peered":"2024-09-17T05:21:55.497272+0000","last_clean":"2024-09-17T05:21:55.497272+0000","last_became_active":"2024-09-17T05:21:54.500904+0000","last_became_peered":"2024-09-17T05:21:54.500904+0000","last_unstale":"2024-09-17T05:21:55.497272+0000","last_undegraded":"2024-09-17T05:21:55.497272+0000","last_fullsized":"2024-09-17T05:21:55.497272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:52:10.150875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499897+0000","last_change":"2024-09-17T05:21:54.494958+0000","last_active":"2024-09-17T05:21:55.499897+0000","last_peered":"2024-09-17T05:21:55.499897+0000","last_clean":"2024-09-17T05:21:55.499897+0000","last_became_active":"2024-09-17T05:21:54.494510+0000","last_became_peered":"2024-09-17T05:21:54.494510+0000","last_unstale":"2024-09-17T05:21:55.499897+0000","last_undegraded":"2024-09-17T05:21:55.499897+0000","last_fullsized":"2024-09-17T05:21:55.499897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:12:27.112041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.747693+0000","last_change":"2024-09-17T05:21:54.500430+0000","last_active":"2024-09-17T05:21:55.747693+0000","last_peered":"2024-09-17T05:21:55.747693+0000","last_clean":"2024-09-17T05:21:55.747693+0000","last_became_active":"2024-09-17T05:21:54.496869+0000","last_became_peered":"2024-09-17T05:21:54.496869+0000","last_unstale":"2024-09-17T05:21:55.747693+0000","last_undegraded":"2024-09-17T05:21:55.747693+0000","last_fullsized":"2024-09-17T05:21:55.747693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:56.018245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.497441+0000","last_change":"2024-09-17T05:21:54.508228+0000","last_active":"2024-09-17T05:21:55.497441+0000","last_peered":"2024-09-17T05:21:55.497441+0000","last_clean":"2024-09-17T05:21:55.497441+0000","last_became_active":"2024-09-17T05:21:54.507980+0000","last_became_peered":"2024-09-17T05:21:54.507980+0000","last_unstale":"2024-09-17T05:21:55.497441+0000","last_undegraded":"2024-09-17T05:21:55.497441+0000","last_fullsized":"2024-09-17T05:21:55.497441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:59:07.965886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.496599+0000","last_change":"2024-09-17T05:21:54.495253+0000","last_active":"2024-09-17T05:21:55.496599+0000","last_peered":"2024-09-17T05:21:55.496599+0000","last_clean":"2024-09-17T05:21:55.496599+0000","last_became_active":"2024-09-17T05:21:54.494929+0000","last_became_peered":"2024-09-17T05:21:54.494929+0000","last_unstale":"2024-09-17T05:21:55.496599+0000","last_undegraded":"2024-09-17T05:21:55.496599+0000","last_fullsized":"2024-09-17T05:21:55.496599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:38.013877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.498278+0000","last_change":"2024-09-17T05:21:54.509547+0000","last_active":"2024-09-17T05:21:55.498278+0000","last_peered":"2024-09-17T05:21:55.498278+0000","last_clean":"2024-09-17T05:21:55.498278+0000","last_became_active":"2024-09-17T05:21:54.509223+0000","last_became_peered":"2024-09-17T05:21:54.509223+0000","last_unstale":"2024-09-17T05:21:55.498278+0000","last_undegraded":"2024-09-17T05:21:55.498278+0000","last_fullsized":"2024-09-17T05:21:55.498278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:51.043848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.496253+0000","last_change":"2024-09-17T05:21:54.497328+0000","last_active":"2024-09-17T05:21:55.496253+0000","last_peered":"2024-09-17T05:21:55.496253+0000","last_clean":"2024-09-17T05:21:55.496253+0000","last_became_active":"2024-09-17T05:21:54.497033+0000","last_became_peered":"2024-09-17T05:21:54.497033+0000","last_unstale":"2024-09-17T05:21:55.496253+0000","last_undegraded":"2024-09-17T05:21:55.496253+0000","last_fullsized":"2024-09-17T05:21:55.496253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:35:45.144313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.748425+0000","last_change":"2024-09-17T05:21:54.512052+0000","last_active":"2024-09-17T05:21:55.748425+0000","last_peered":"2024-09-17T05:21:55.748425+0000","last_clean":"2024-09-17T05:21:55.748425+0000","last_became_active":"2024-09-17T05:21:54.509795+0000","last_became_peered":"2024-09-17T05:21:54.509795+0000","last_unstale":"2024-09-17T05:21:55.748425+0000","last_undegraded":"2024-09-17T05:21:55.748425+0000","last_fullsized":"2024-09-17T05:21:55.748425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:00.308980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.497784+0000","last_change":"2024-09-17T05:21:54.511143+0000","last_active":"2024-09-17T05:21:55.497784+0000","last_peered":"2024-09-17T05:21:55.497784+0000","last_clean":"2024-09-17T05:21:55.497784+0000","last_became_active":"2024-09-17T05:21:54.510864+0000","last_became_peered":"2024-09-17T05:21:54.510864+0000","last_unstale":"2024-09-17T05:21:55.497784+0000","last_undegraded":"2024-09-17T05:21:55.497784+0000","last_fullsized":"2024-09-17T05:21:55.497784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:22:47.632841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.502509+0000","last_change":"2024-09-17T05:21:54.512618+0000","last_active":"2024-09-17T05:21:55.502509+0000","last_peered":"2024-09-17T05:21:55.502509+0000","last_clean":"2024-09-17T05:21:55.502509+0000","last_became_active":"2024-09-17T05:21:54.512003+0000","last_became_peered":"2024-09-17T05:21:54.512003+0000","last_unstale":"2024-09-17T05:21:55.502509+0000","last_undegraded":"2024-09-17T05:21:55.502509+0000","last_fullsized":"2024-09-17T05:21:55.502509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:28:33.399315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.502291+0000","last_change":"2024-09-17T05:21:54.512890+0000","last_active":"2024-09-17T05:21:55.502291+0000","last_peered":"2024-09-17T05:21:55.502291+0000","last_clean":"2024-09-17T05:21:55.502291+0000","last_became_active":"2024-09-17T05:21:54.511924+0000","last_became_peered":"2024-09-17T05:21:54.511924+0000","last_unstale":"2024-09-17T05:21:55.502291+0000","last_undegraded":"2024-09-17T05:21:55.502291+0000","last_fullsized":"2024-09-17T05:21:55.502291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:41.750971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499252+0000","last_change":"2024-09-17T05:21:54.501003+0000","last_active":"2024-09-17T05:21:55.499252+0000","last_peered":"2024-09-17T05:21:55.499252+0000","last_clean":"2024-09-17T05:21:55.499252+0000","last_became_active":"2024-09-17T05:21:54.500716+0000","last_became_peered":"2024-09-17T05:21:54.500716+0000","last_unstale":"2024-09-17T05:21:55.499252+0000","last_undegraded":"2024-09-17T05:21:55.499252+0000","last_fullsized":"2024-09-17T05:21:55.499252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:03.364449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.749495+0000","last_change":"2024-09-17T05:21:54.507932+0000","last_active":"2024-09-17T05:21:55.749495+0000","last_peered":"2024-09-17T05:21:55.749495+0000","last_clean":"2024-09-17T05:21:55.749495+0000","last_became_active":"2024-09-17T05:21:54.507619+0000","last_became_peered":"2024-09-17T05:21:54.507619+0000","last_unstale":"2024-09-17T05:21:55.749495+0000","last_undegraded":"2024-09-17T05:21:55.749495+0000","last_fullsized":"2024-09-17T05:21:55.749495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:05:41.748842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.747964+0000","last_change":"2024-09-17T05:21:54.500967+0000","last_active":"2024-09-17T05:21:55.747964+0000","last_peered":"2024-09-17T05:21:55.747964+0000","last_clean":"2024-09-17T05:21:55.747964+0000","last_became_active":"2024-09-17T05:21:54.500667+0000","last_became_peered":"2024-09-17T05:21:54.500667+0000","last_unstale":"2024-09-17T05:21:55.747964+0000","last_undegraded":"2024-09-17T05:21:55.747964+0000","last_fullsized":"2024-09-17T05:21:55.747964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:20:13.444228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499687+0000","last_change":"2024-09-17T05:21:54.499559+0000","last_active":"2024-09-17T05:21:55.499687+0000","last_peered":"2024-09-17T05:21:55.499687+0000","last_clean":"2024-09-17T05:21:55.499687+0000","last_became_active":"2024-09-17T05:21:54.498587+0000","last_became_peered":"2024-09-17T05:21:54.498587+0000","last_unstale":"2024-09-17T05:21:55.499687+0000","last_undegraded":"2024-09-17T05:21:55.499687+0000","last_fullsized":"2024-09-17T05:21:55.499687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:18.824693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.498770+0000","last_change":"2024-09-17T05:21:54.511036+0000","last_active":"2024-09-17T05:21:55.498770+0000","last_peered":"2024-09-17T05:21:55.498770+0000","last_clean":"2024-09-17T05:21:55.498770+0000","last_became_active":"2024-09-17T05:21:54.510599+0000","last_became_peered":"2024-09-17T05:21:54.510599+0000","last_unstale":"2024-09-17T05:21:55.498770+0000","last_undegraded":"2024-09-17T05:21:55.498770+0000","last_fullsized":"2024-09-17T05:21:55.498770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:29.213187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.498235+0000","last_change":"2024-09-17T05:21:54.510133+0000","last_active":"2024-09-17T05:21:55.498235+0000","last_peered":"2024-09-17T05:21:55.498235+0000","last_clean":"2024-09-17T05:21:55.498235+0000","last_became_active":"2024-09-17T05:21:54.509861+0000","last_became_peered":"2024-09-17T05:21:54.509861+0000","last_unstale":"2024-09-17T05:21:55.498235+0000","last_undegraded":"2024-09-17T05:21:55.498235+0000","last_fullsized":"2024-09-17T05:21:55.498235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:35:45.144313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.749782+0000","last_change":"2024-09-17T05:21:54.498112+0000","last_active":"2024-09-17T05:21:55.749782+0000","last_peered":"2024-09-17T05:21:55.749782+0000","last_clean":"2024-09-17T05:21:55.749782+0000","last_became_active":"2024-09-17T05:21:54.497838+0000","last_became_peered":"2024-09-17T05:21:54.497838+0000","last_unstale":"2024-09-17T05:21:55.749782+0000","last_undegraded":"2024-09-17T05:21:55.749782+0000","last_fullsized":"2024-09-17T05:21:55.749782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:53:18.926924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.497008+0000","last_change":"2024-09-17T05:21:54.497275+0000","last_active":"2024-09-17T05:21:55.497008+0000","last_peered":"2024-09-17T05:21:55.497008+0000","last_clean":"2024-09-17T05:21:55.497008+0000","last_became_active":"2024-09-17T05:21:54.495616+0000","last_became_peered":"2024-09-17T05:21:54.495616+0000","last_unstale":"2024-09-17T05:21:55.497008+0000","last_undegraded":"2024-09-17T05:21:55.497008+0000","last_fullsized":"2024-09-17T05:21:55.497008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:29.213187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.502388+0000","last_change":"2024-09-17T05:21:54.504915+0000","last_active":"2024-09-17T05:21:55.502388+0000","last_peered":"2024-09-17T05:21:55.502388+0000","last_clean":"2024-09-17T05:21:55.502388+0000","last_became_active":"2024-09-17T05:21:54.503778+0000","last_became_peered":"2024-09-17T05:21:54.503778+0000","last_unstale":"2024-09-17T05:21:55.502388+0000","last_undegraded":"2024-09-17T05:21:55.502388+0000","last_fullsized":"2024-09-17T05:21:55.502388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:45.560083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.748111+0000","last_change":"2024-09-17T05:21:54.504130+0000","last_active":"2024-09-17T05:21:55.748111+0000","last_peered":"2024-09-17T05:21:55.748111+0000","last_clean":"2024-09-17T05:21:55.748111+0000","last_became_active":"2024-09-17T05:21:54.503843+0000","last_became_peered":"2024-09-17T05:21:54.503843+0000","last_unstale":"2024-09-17T05:21:55.748111+0000","last_undegraded":"2024-09-17T05:21:55.748111+0000","last_fullsized":"2024-09-17T05:21:55.748111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:41.750971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.498656+0000","last_change":"2024-09-17T05:21:54.509569+0000","last_active":"2024-09-17T05:21:55.498656+0000","last_peered":"2024-09-17T05:21:55.498656+0000","last_clean":"2024-09-17T05:21:55.498656+0000","last_became_active":"2024-09-17T05:21:54.508928+0000","last_became_peered":"2024-09-17T05:21:54.508928+0000","last_unstale":"2024-09-17T05:21:55.498656+0000","last_undegraded":"2024-09-17T05:21:55.498656+0000","last_fullsized":"2024-09-17T05:21:55.498656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:12:31.977218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.749141+0000","last_change":"2024-09-17T05:21:54.497160+0000","last_active":"2024-09-17T05:21:55.749141+0000","last_peered":"2024-09-17T05:21:55.749141+0000","last_clean":"2024-09-17T05:21:55.749141+0000","last_became_active":"2024-09-17T05:21:54.496885+0000","last_became_peered":"2024-09-17T05:21:54.496885+0000","last_unstale":"2024-09-17T05:21:55.749141+0000","last_undegraded":"2024-09-17T05:21:55.749141+0000","last_fullsized":"2024-09-17T05:21:55.749141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:59:59.386632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499016+0000","last_change":"2024-09-17T05:21:54.510866+0000","last_active":"2024-09-17T05:21:55.499016+0000","last_peered":"2024-09-17T05:21:55.499016+0000","last_clean":"2024-09-17T05:21:55.499016+0000","last_became_active":"2024-09-17T05:21:54.510301+0000","last_became_peered":"2024-09-17T05:21:54.510301+0000","last_unstale":"2024-09-17T05:21:55.499016+0000","last_undegraded":"2024-09-17T05:21:55.499016+0000","last_fullsized":"2024-09-17T05:21:55.499016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:52:10.150875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.748057+0000","last_change":"2024-09-17T05:21:54.501814+0000","last_active":"2024-09-17T05:21:55.748057+0000","last_peered":"2024-09-17T05:21:55.748057+0000","last_clean":"2024-09-17T05:21:55.748057+0000","last_became_active":"2024-09-17T05:21:54.501512+0000","last_became_peered":"2024-09-17T05:21:54.501512+0000","last_unstale":"2024-09-17T05:21:55.748057+0000","last_undegraded":"2024-09-17T05:21:55.748057+0000","last_fullsized":"2024-09-17T05:21:55.748057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:26.479441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.502586+0000","last_change":"2024-09-17T05:21:54.497869+0000","last_active":"2024-09-17T05:21:55.502586+0000","last_peered":"2024-09-17T05:21:55.502586+0000","last_clean":"2024-09-17T05:21:55.502586+0000","last_became_active":"2024-09-17T05:21:54.497583+0000","last_became_peered":"2024-09-17T05:21:54.497583+0000","last_unstale":"2024-09-17T05:21:55.502586+0000","last_undegraded":"2024-09-17T05:21:55.502586+0000","last_fullsized":"2024-09-17T05:21:55.502586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:42:01.373169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499859+0000","last_change":"2024-09-17T05:21:54.493860+0000","last_active":"2024-09-17T05:21:55.499859+0000","last_peered":"2024-09-17T05:21:55.499859+0000","last_clean":"2024-09-17T05:21:55.499859+0000","last_became_active":"2024-09-17T05:21:54.493554+0000","last_became_peered":"2024-09-17T05:21:54.493554+0000","last_unstale":"2024-09-17T05:21:55.499859+0000","last_undegraded":"2024-09-17T05:21:55.499859+0000","last_fullsized":"2024-09-17T05:21:55.499859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:30:58.548877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.748653+0000","last_change":"2024-09-17T05:21:54.498320+0000","last_active":"2024-09-17T05:21:55.748653+0000","last_peered":"2024-09-17T05:21:55.748653+0000","last_clean":"2024-09-17T05:21:55.748653+0000","last_became_active":"2024-09-17T05:21:54.498002+0000","last_became_peered":"2024-09-17T05:21:54.498002+0000","last_unstale":"2024-09-17T05:21:55.748653+0000","last_undegraded":"2024-09-17T05:21:55.748653+0000","last_fullsized":"2024-09-17T05:21:55.748653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:56:30.051932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.748189+0000","last_change":"2024-09-17T05:21:54.500883+0000","last_active":"2024-09-17T05:21:55.748189+0000","last_peered":"2024-09-17T05:21:55.748189+0000","last_clean":"2024-09-17T05:21:55.748189+0000","last_became_active":"2024-09-17T05:21:54.500587+0000","last_became_peered":"2024-09-17T05:21:54.500587+0000","last_unstale":"2024-09-17T05:21:55.748189+0000","last_undegraded":"2024-09-17T05:21:55.748189+0000","last_fullsized":"2024-09-17T05:21:55.748189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:45.560083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.498946+0000","last_change":"2024-09-17T05:21:54.508790+0000","last_active":"2024-09-17T05:21:55.498946+0000","last_peered":"2024-09-17T05:21:55.498946+0000","last_clean":"2024-09-17T05:21:55.498946+0000","last_became_active":"2024-09-17T05:21:54.508431+0000","last_became_peered":"2024-09-17T05:21:54.508431+0000","last_unstale":"2024-09-17T05:21:55.498946+0000","last_undegraded":"2024-09-17T05:21:55.498946+0000","last_fullsized":"2024-09-17T05:21:55.498946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:26:25.545759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.748213+0000","last_change":"2024-09-17T05:21:54.506270+0000","last_active":"2024-09-17T05:21:55.748213+0000","last_peered":"2024-09-17T05:21:55.748213+0000","last_clean":"2024-09-17T05:21:55.748213+0000","last_became_active":"2024-09-17T05:21:54.505940+0000","last_became_peered":"2024-09-17T05:21:54.505940+0000","last_unstale":"2024-09-17T05:21:55.748213+0000","last_undegraded":"2024-09-17T05:21:55.748213+0000","last_fullsized":"2024-09-17T05:21:55.748213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:50:43.095802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.502048+0000","last_change":"2024-09-17T05:21:54.505209+0000","last_active":"2024-09-17T05:21:55.502048+0000","last_peered":"2024-09-17T05:21:55.502048+0000","last_clean":"2024-09-17T05:21:55.502048+0000","last_became_active":"2024-09-17T05:21:54.504601+0000","last_became_peered":"2024-09-17T05:21:54.504601+0000","last_unstale":"2024-09-17T05:21:55.502048+0000","last_undegraded":"2024-09-17T05:21:55.502048+0000","last_fullsized":"2024-09-17T05:21:55.502048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:32.727377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.498911+0000","last_change":"2024-09-17T05:21:54.495748+0000","last_active":"2024-09-17T05:21:55.498911+0000","last_peered":"2024-09-17T05:21:55.498911+0000","last_clean":"2024-09-17T05:21:55.498911+0000","last_became_active":"2024-09-17T05:21:54.494696+0000","last_became_peered":"2024-09-17T05:21:54.494696+0000","last_unstale":"2024-09-17T05:21:55.498911+0000","last_undegraded":"2024-09-17T05:21:55.498911+0000","last_fullsized":"2024-09-17T05:21:55.498911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:02.422828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.749565+0000","last_change":"2024-09-17T05:21:53.484897+0000","last_active":"2024-09-17T05:21:55.749565+0000","last_peered":"2024-09-17T05:21:55.749565+0000","last_clean":"2024-09-17T05:21:55.749565+0000","last_became_active":"2024-09-17T05:21:53.484370+0000","last_became_peered":"2024-09-17T05:21:53.484370+0000","last_unstale":"2024-09-17T05:21:55.749565+0000","last_undegraded":"2024-09-17T05:21:55.749565+0000","last_fullsized":"2024-09-17T05:21:55.749565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:26:33.902720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.748296+0000","last_change":"2024-09-17T05:21:54.502294+0000","last_active":"2024-09-17T05:21:55.748296+0000","last_peered":"2024-09-17T05:21:55.748296+0000","last_clean":"2024-09-17T05:21:55.748296+0000","last_became_active":"2024-09-17T05:21:54.501214+0000","last_became_peered":"2024-09-17T05:21:54.501214+0000","last_unstale":"2024-09-17T05:21:55.748296+0000","last_undegraded":"2024-09-17T05:21:55.748296+0000","last_fullsized":"2024-09-17T05:21:55.748296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:42:01.373169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.502078+0000","last_change":"2024-09-17T05:21:53.493253+0000","last_active":"2024-09-17T05:21:55.502078+0000","last_peered":"2024-09-17T05:21:55.502078+0000","last_clean":"2024-09-17T05:21:55.502078+0000","last_became_active":"2024-09-17T05:21:53.492943+0000","last_became_peered":"2024-09-17T05:21:53.492943+0000","last_unstale":"2024-09-17T05:21:55.502078+0000","last_undegraded":"2024-09-17T05:21:55.502078+0000","last_fullsized":"2024-09-17T05:21:55.502078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:53:55.808093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.749171+0000","last_change":"2024-09-17T05:21:53.491206+0000","last_active":"2024-09-17T05:21:55.749171+0000","last_peered":"2024-09-17T05:21:55.749171+0000","last_clean":"2024-09-17T05:21:55.749171+0000","last_became_active":"2024-09-17T05:21:53.490940+0000","last_became_peered":"2024-09-17T05:21:53.490940+0000","last_unstale":"2024-09-17T05:21:55.749171+0000","last_undegraded":"2024-09-17T05:21:55.749171+0000","last_fullsized":"2024-09-17T05:21:55.749171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:39.425517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.748603+0000","last_change":"2024-09-17T05:21:54.504258+0000","last_active":"2024-09-17T05:21:55.748603+0000","last_peered":"2024-09-17T05:21:55.748603+0000","last_clean":"2024-09-17T05:21:55.748603+0000","last_became_active":"2024-09-17T05:21:54.503974+0000","last_became_peered":"2024-09-17T05:21:54.503974+0000","last_unstale":"2024-09-17T05:21:55.748603+0000","last_undegraded":"2024-09-17T05:21:55.748603+0000","last_fullsized":"2024-09-17T05:21:55.748603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:10.923504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499004+0000","last_change":"2024-09-17T05:21:53.489575+0000","last_active":"2024-09-17T05:21:55.499004+0000","last_peered":"2024-09-17T05:21:55.499004+0000","last_clean":"2024-09-17T05:21:55.499004+0000","last_became_active":"2024-09-17T05:21:53.489294+0000","last_became_peered":"2024-09-17T05:21:53.489294+0000","last_unstale":"2024-09-17T05:21:55.499004+0000","last_undegraded":"2024-09-17T05:21:55.499004+0000","last_fullsized":"2024-09-17T05:21:55.499004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:28.463818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499674+0000","last_change":"2024-09-17T05:21:54.494216+0000","last_active":"2024-09-17T05:21:55.499674+0000","last_peered":"2024-09-17T05:21:55.499674+0000","last_clean":"2024-09-17T05:21:55.499674+0000","last_became_active":"2024-09-17T05:21:54.492853+0000","last_became_peered":"2024-09-17T05:21:54.492853+0000","last_unstale":"2024-09-17T05:21:55.499674+0000","last_undegraded":"2024-09-17T05:21:55.499674+0000","last_fullsized":"2024-09-17T05:21:55.499674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:01:15.655368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.502262+0000","last_change":"2024-09-17T05:21:53.494796+0000","last_active":"2024-09-17T05:21:55.502262+0000","last_peered":"2024-09-17T05:21:55.502262+0000","last_clean":"2024-09-17T05:21:55.502262+0000","last_became_active":"2024-09-17T05:21:53.494486+0000","last_became_peered":"2024-09-17T05:21:53.494486+0000","last_unstale":"2024-09-17T05:21:55.502262+0000","last_undegraded":"2024-09-17T05:21:55.502262+0000","last_fullsized":"2024-09-17T05:21:55.502262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:59.914761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.497597+0000","last_change":"2024-09-17T05:21:54.509807+0000","last_active":"2024-09-17T05:21:55.497597+0000","last_peered":"2024-09-17T05:21:55.497597+0000","last_clean":"2024-09-17T05:21:55.497597+0000","last_became_active":"2024-09-17T05:21:54.509245+0000","last_became_peered":"2024-09-17T05:21:54.509245+0000","last_unstale":"2024-09-17T05:21:55.497597+0000","last_undegraded":"2024-09-17T05:21:55.497597+0000","last_fullsized":"2024-09-17T05:21:55.497597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:38:26.480830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.497949+0000","last_change":"2024-09-17T05:21:53.491049+0000","last_active":"2024-09-17T05:21:55.497949+0000","last_peered":"2024-09-17T05:21:55.497949+0000","last_clean":"2024-09-17T05:21:55.497949+0000","last_became_active":"2024-09-17T05:21:53.490795+0000","last_became_peered":"2024-09-17T05:21:53.490795+0000","last_unstale":"2024-09-17T05:21:55.497949+0000","last_undegraded":"2024-09-17T05:21:55.497949+0000","last_fullsized":"2024-09-17T05:21:55.497949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:03:21.023914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.748065+0000","last_change":"2024-09-17T05:21:54.512151+0000","last_active":"2024-09-17T05:21:55.748065+0000","last_peered":"2024-09-17T05:21:55.748065+0000","last_clean":"2024-09-17T05:21:55.748065+0000","last_became_active":"2024-09-17T05:21:54.511204+0000","last_became_peered":"2024-09-17T05:21:54.511204+0000","last_unstale":"2024-09-17T05:21:55.748065+0000","last_undegraded":"2024-09-17T05:21:55.748065+0000","last_fullsized":"2024-09-17T05:21:55.748065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:06:40.408782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499832+0000","last_change":"2024-09-17T05:21:53.493370+0000","last_active":"2024-09-17T05:21:55.499832+0000","last_peered":"2024-09-17T05:21:55.499832+0000","last_clean":"2024-09-17T05:21:55.499832+0000","last_became_active":"2024-09-17T05:21:53.493010+0000","last_became_peered":"2024-09-17T05:21:53.493010+0000","last_unstale":"2024-09-17T05:21:55.499832+0000","last_undegraded":"2024-09-17T05:21:55.499832+0000","last_fullsized":"2024-09-17T05:21:55.499832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:21.689266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499435+0000","last_change":"2024-09-17T05:21:54.499432+0000","last_active":"2024-09-17T05:21:55.499435+0000","last_peered":"2024-09-17T05:21:55.499435+0000","last_clean":"2024-09-17T05:21:55.499435+0000","last_became_active":"2024-09-17T05:21:54.499133+0000","last_became_peered":"2024-09-17T05:21:54.499133+0000","last_unstale":"2024-09-17T05:21:55.499435+0000","last_undegraded":"2024-09-17T05:21:55.499435+0000","last_fullsized":"2024-09-17T05:21:55.499435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:53:18.926924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.502291+0000","last_change":"2024-09-17T05:21:53.491745+0000","last_active":"2024-09-17T05:21:55.502291+0000","last_peered":"2024-09-17T05:21:55.502291+0000","last_clean":"2024-09-17T05:21:55.502291+0000","last_became_active":"2024-09-17T05:21:53.491464+0000","last_became_peered":"2024-09-17T05:21:53.491464+0000","last_unstale":"2024-09-17T05:21:55.502291+0000","last_undegraded":"2024-09-17T05:21:55.502291+0000","last_fullsized":"2024-09-17T05:21:55.502291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:03:27.097328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.496199+0000","last_change":"2024-09-17T05:21:54.493190+0000","last_active":"2024-09-17T05:21:55.496199+0000","last_peered":"2024-09-17T05:21:55.496199+0000","last_clean":"2024-09-17T05:21:55.496199+0000","last_became_active":"2024-09-17T05:21:54.492889+0000","last_became_peered":"2024-09-17T05:21:54.492889+0000","last_unstale":"2024-09-17T05:21:55.496199+0000","last_undegraded":"2024-09-17T05:21:55.496199+0000","last_fullsized":"2024-09-17T05:21:55.496199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:40.851639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.748250+0000","last_change":"2024-09-17T05:21:53.487462+0000","last_active":"2024-09-17T05:21:55.748250+0000","last_peered":"2024-09-17T05:21:55.748250+0000","last_clean":"2024-09-17T05:21:55.748250+0000","last_became_active":"2024-09-17T05:21:53.487189+0000","last_became_peered":"2024-09-17T05:21:53.487189+0000","last_unstale":"2024-09-17T05:21:55.748250+0000","last_undegraded":"2024-09-17T05:21:55.748250+0000","last_fullsized":"2024-09-17T05:21:55.748250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:37:20.042353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.748230+0000","last_change":"2024-09-17T05:21:54.500759+0000","last_active":"2024-09-17T05:21:55.748230+0000","last_peered":"2024-09-17T05:21:55.748230+0000","last_clean":"2024-09-17T05:21:55.748230+0000","last_became_active":"2024-09-17T05:21:54.500480+0000","last_became_peered":"2024-09-17T05:21:54.500480+0000","last_unstale":"2024-09-17T05:21:55.748230+0000","last_undegraded":"2024-09-17T05:21:55.748230+0000","last_fullsized":"2024-09-17T05:21:55.748230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:28:33.399315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499013+0000","last_change":"2024-09-17T05:21:53.489506+0000","last_active":"2024-09-17T05:21:55.499013+0000","last_peered":"2024-09-17T05:21:55.499013+0000","last_clean":"2024-09-17T05:21:55.499013+0000","last_became_active":"2024-09-17T05:21:53.488663+0000","last_became_peered":"2024-09-17T05:21:53.488663+0000","last_unstale":"2024-09-17T05:21:55.499013+0000","last_undegraded":"2024-09-17T05:21:55.499013+0000","last_fullsized":"2024-09-17T05:21:55.499013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:58:35.674900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.496782+0000","last_change":"2024-09-17T05:21:54.495318+0000","last_active":"2024-09-17T05:21:55.496782+0000","last_peered":"2024-09-17T05:21:55.496782+0000","last_clean":"2024-09-17T05:21:55.496782+0000","last_became_active":"2024-09-17T05:21:54.495022+0000","last_became_peered":"2024-09-17T05:21:54.495022+0000","last_unstale":"2024-09-17T05:21:55.496782+0000","last_undegraded":"2024-09-17T05:21:55.496782+0000","last_fullsized":"2024-09-17T05:21:55.496782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:12:31.977218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.501937+0000","last_change":"2024-09-17T05:21:53.493137+0000","last_active":"2024-09-17T05:21:55.501937+0000","last_peered":"2024-09-17T05:21:55.501937+0000","last_clean":"2024-09-17T05:21:55.501937+0000","last_became_active":"2024-09-17T05:21:53.492861+0000","last_became_peered":"2024-09-17T05:21:53.492861+0000","last_unstale":"2024-09-17T05:21:55.501937+0000","last_undegraded":"2024-09-17T05:21:55.501937+0000","last_fullsized":"2024-09-17T05:21:55.501937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:26:33.902720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.502039+0000","last_change":"2024-09-17T05:21:54.504481+0000","last_active":"2024-09-17T05:21:55.502039+0000","last_peered":"2024-09-17T05:21:55.502039+0000","last_clean":"2024-09-17T05:21:55.502039+0000","last_became_active":"2024-09-17T05:21:54.504110+0000","last_became_peered":"2024-09-17T05:21:54.504110+0000","last_unstale":"2024-09-17T05:21:55.502039+0000","last_undegraded":"2024-09-17T05:21:55.502039+0000","last_fullsized":"2024-09-17T05:21:55.502039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:06.884350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.748146+0000","last_change":"2024-09-17T05:21:53.487613+0000","last_active":"2024-09-17T05:21:55.748146+0000","last_peered":"2024-09-17T05:21:55.748146+0000","last_clean":"2024-09-17T05:21:55.748146+0000","last_became_active":"2024-09-17T05:21:53.487341+0000","last_became_peered":"2024-09-17T05:21:53.487341+0000","last_unstale":"2024-09-17T05:21:55.748146+0000","last_undegraded":"2024-09-17T05:21:55.748146+0000","last_fullsized":"2024-09-17T05:21:55.748146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:26:33.902720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.496294+0000","last_change":"2024-09-17T05:21:54.500288+0000","last_active":"2024-09-17T05:21:55.496294+0000","last_peered":"2024-09-17T05:21:55.496294+0000","last_clean":"2024-09-17T05:21:55.496294+0000","last_became_active":"2024-09-17T05:21:54.499508+0000","last_became_peered":"2024-09-17T05:21:54.499508+0000","last_unstale":"2024-09-17T05:21:55.496294+0000","last_undegraded":"2024-09-17T05:21:55.496294+0000","last_fullsized":"2024-09-17T05:21:55.496294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:51.043848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499138+0000","last_change":"2024-09-17T05:21:53.486134+0000","last_active":"2024-09-17T05:21:55.499138+0000","last_peered":"2024-09-17T05:21:55.499138+0000","last_clean":"2024-09-17T05:21:55.499138+0000","last_became_active":"2024-09-17T05:21:53.485804+0000","last_became_peered":"2024-09-17T05:21:53.485804+0000","last_unstale":"2024-09-17T05:21:55.499138+0000","last_undegraded":"2024-09-17T05:21:55.499138+0000","last_fullsized":"2024-09-17T05:21:55.499138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:34:05.720343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.497407+0000","last_change":"2024-09-17T05:21:54.499818+0000","last_active":"2024-09-17T05:21:55.497407+0000","last_peered":"2024-09-17T05:21:55.497407+0000","last_clean":"2024-09-17T05:21:55.497407+0000","last_became_active":"2024-09-17T05:21:54.499298+0000","last_became_peered":"2024-09-17T05:21:54.499298+0000","last_unstale":"2024-09-17T05:21:55.497407+0000","last_undegraded":"2024-09-17T05:21:55.497407+0000","last_fullsized":"2024-09-17T05:21:55.497407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:26:25.545759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.749690+0000","last_change":"2024-09-17T05:21:53.487000+0000","last_active":"2024-09-17T05:21:55.749690+0000","last_peered":"2024-09-17T05:21:55.749690+0000","last_clean":"2024-09-17T05:21:55.749690+0000","last_became_active":"2024-09-17T05:21:53.486705+0000","last_became_peered":"2024-09-17T05:21:53.486705+0000","last_unstale":"2024-09-17T05:21:55.749690+0000","last_undegraded":"2024-09-17T05:21:55.749690+0000","last_fullsized":"2024-09-17T05:21:55.749690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:53:55.808093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.497849+0000","last_change":"2024-09-17T05:21:54.499532+0000","last_active":"2024-09-17T05:21:55.497849+0000","last_peered":"2024-09-17T05:21:55.497849+0000","last_clean":"2024-09-17T05:21:55.497849+0000","last_became_active":"2024-09-17T05:21:54.499228+0000","last_became_peered":"2024-09-17T05:21:54.499228+0000","last_unstale":"2024-09-17T05:21:55.497849+0000","last_undegraded":"2024-09-17T05:21:55.497849+0000","last_fullsized":"2024-09-17T05:21:55.497849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:34:49.600804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499922+0000","last_change":"2024-09-17T05:21:53.481560+0000","last_active":"2024-09-17T05:21:55.499922+0000","last_peered":"2024-09-17T05:21:55.499922+0000","last_clean":"2024-09-17T05:21:55.499922+0000","last_became_active":"2024-09-17T05:21:53.481288+0000","last_became_peered":"2024-09-17T05:21:53.481288+0000","last_unstale":"2024-09-17T05:21:55.499922+0000","last_undegraded":"2024-09-17T05:21:55.499922+0000","last_fullsized":"2024-09-17T05:21:55.499922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:14:54.894468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.498134+0000","last_change":"2024-09-17T05:21:54.507480+0000","last_active":"2024-09-17T05:21:55.498134+0000","last_peered":"2024-09-17T05:21:55.498134+0000","last_clean":"2024-09-17T05:21:55.498134+0000","last_became_active":"2024-09-17T05:21:54.507184+0000","last_became_peered":"2024-09-17T05:21:54.507184+0000","last_unstale":"2024-09-17T05:21:55.498134+0000","last_undegraded":"2024-09-17T05:21:55.498134+0000","last_fullsized":"2024-09-17T05:21:55.498134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:40.851639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.749572+0000","last_change":"2024-09-17T05:21:53.493592+0000","last_active":"2024-09-17T05:21:55.749572+0000","last_peered":"2024-09-17T05:21:55.749572+0000","last_clean":"2024-09-17T05:21:55.749572+0000","last_became_active":"2024-09-17T05:21:53.492958+0000","last_became_peered":"2024-09-17T05:21:53.492958+0000","last_unstale":"2024-09-17T05:21:55.749572+0000","last_undegraded":"2024-09-17T05:21:55.749572+0000","last_fullsized":"2024-09-17T05:21:55.749572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:25.985141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.496458+0000","last_change":"2024-09-17T05:21:54.509525+0000","last_active":"2024-09-17T05:21:55.496458+0000","last_peered":"2024-09-17T05:21:55.496458+0000","last_clean":"2024-09-17T05:21:55.496458+0000","last_became_active":"2024-09-17T05:21:54.509257+0000","last_became_peered":"2024-09-17T05:21:54.509257+0000","last_unstale":"2024-09-17T05:21:55.496458+0000","last_undegraded":"2024-09-17T05:21:55.496458+0000","last_fullsized":"2024-09-17T05:21:55.496458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:34:47.447957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.495985+0000","last_change":"2024-09-17T05:21:44.086098+0000","last_active":"2024-09-17T05:21:55.495985+0000","last_peered":"2024-09-17T05:21:55.495985+0000","last_clean":"2024-09-17T05:21:55.495985+0000","last_became_active":"2024-09-17T05:21:44.083477+0000","last_became_peered":"2024-09-17T05:21:44.083477+0000","last_unstale":"2024-09-17T05:21:55.495985+0000","last_undegraded":"2024-09-17T05:21:55.495985+0000","last_fullsized":"2024-09-17T05:21:55.495985+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:42.925756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:42.925756+0000","last_clean_scrub_stamp":"2024-09-17T05:21:42.925756+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:11.410250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.497233+0000","last_change":"2024-09-17T05:21:53.490183+0000","last_active":"2024-09-17T05:21:55.497233+0000","last_peered":"2024-09-17T05:21:55.497233+0000","last_clean":"2024-09-17T05:21:55.497233+0000","last_became_active":"2024-09-17T05:21:53.489914+0000","last_became_peered":"2024-09-17T05:21:53.489914+0000","last_unstale":"2024-09-17T05:21:55.497233+0000","last_undegraded":"2024-09-17T05:21:55.497233+0000","last_fullsized":"2024-09-17T05:21:55.497233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:55:15.542710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.749341+0000","last_change":"2024-09-17T05:21:54.510457+0000","last_active":"2024-09-17T05:21:55.749341+0000","last_peered":"2024-09-17T05:21:55.749341+0000","last_clean":"2024-09-17T05:21:55.749341+0000","last_became_active":"2024-09-17T05:21:54.510191+0000","last_became_peered":"2024-09-17T05:21:54.510191+0000","last_unstale":"2024-09-17T05:21:55.749341+0000","last_undegraded":"2024-09-17T05:21:55.749341+0000","last_fullsized":"2024-09-17T05:21:55.749341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:54:11.270930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.495899+0000","last_change":"2024-09-17T05:21:53.484333+0000","last_active":"2024-09-17T05:21:55.495899+0000","last_peered":"2024-09-17T05:21:55.495899+0000","last_clean":"2024-09-17T05:21:55.495899+0000","last_became_active":"2024-09-17T05:21:53.483640+0000","last_became_peered":"2024-09-17T05:21:53.483640+0000","last_unstale":"2024-09-17T05:21:55.495899+0000","last_undegraded":"2024-09-17T05:21:55.495899+0000","last_fullsized":"2024-09-17T05:21:55.495899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:37:47.645603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.747762+0000","last_change":"2024-09-17T05:21:54.501913+0000","last_active":"2024-09-17T05:21:55.747762+0000","last_peered":"2024-09-17T05:21:55.747762+0000","last_clean":"2024-09-17T05:21:55.747762+0000","last_became_active":"2024-09-17T05:21:54.501513+0000","last_became_peered":"2024-09-17T05:21:54.501513+0000","last_unstale":"2024-09-17T05:21:55.747762+0000","last_undegraded":"2024-09-17T05:21:55.747762+0000","last_fullsized":"2024-09-17T05:21:55.747762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:41.511545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.748269+0000","last_change":"2024-09-17T05:21:53.487710+0000","last_active":"2024-09-17T05:21:55.748269+0000","last_peered":"2024-09-17T05:21:55.748269+0000","last_clean":"2024-09-17T05:21:55.748269+0000","last_became_active":"2024-09-17T05:21:53.487436+0000","last_became_peered":"2024-09-17T05:21:53.487436+0000","last_unstale":"2024-09-17T05:21:55.748269+0000","last_undegraded":"2024-09-17T05:21:55.748269+0000","last_fullsized":"2024-09-17T05:21:55.748269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:03:27.097328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499651+0000","last_change":"2024-09-17T05:21:54.497084+0000","last_active":"2024-09-17T05:21:55.499651+0000","last_peered":"2024-09-17T05:21:55.499651+0000","last_clean":"2024-09-17T05:21:55.499651+0000","last_became_active":"2024-09-17T05:21:54.495742+0000","last_became_peered":"2024-09-17T05:21:54.495742+0000","last_unstale":"2024-09-17T05:21:55.499651+0000","last_undegraded":"2024-09-17T05:21:55.499651+0000","last_fullsized":"2024-09-17T05:21:55.499651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:27:18.182327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499082+0000","last_change":"2024-09-17T05:21:53.490161+0000","last_active":"2024-09-17T05:21:55.499082+0000","last_peered":"2024-09-17T05:21:55.499082+0000","last_clean":"2024-09-17T05:21:55.499082+0000","last_became_active":"2024-09-17T05:21:53.489883+0000","last_became_peered":"2024-09-17T05:21:53.489883+0000","last_unstale":"2024-09-17T05:21:55.499082+0000","last_undegraded":"2024-09-17T05:21:55.499082+0000","last_fullsized":"2024-09-17T05:21:55.499082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:08.690514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499340+0000","last_change":"2024-09-17T05:21:54.503475+0000","last_active":"2024-09-17T05:21:55.499340+0000","last_peered":"2024-09-17T05:21:55.499340+0000","last_clean":"2024-09-17T05:21:55.499340+0000","last_became_active":"2024-09-17T05:21:54.503198+0000","last_became_peered":"2024-09-17T05:21:54.503198+0000","last_unstale":"2024-09-17T05:21:55.499340+0000","last_undegraded":"2024-09-17T05:21:55.499340+0000","last_fullsized":"2024-09-17T05:21:55.499340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:50:43.095802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499769+0000","last_change":"2024-09-17T05:21:53.484383+0000","last_active":"2024-09-17T05:21:55.499769+0000","last_peered":"2024-09-17T05:21:55.499769+0000","last_clean":"2024-09-17T05:21:55.499769+0000","last_became_active":"2024-09-17T05:21:53.484071+0000","last_became_peered":"2024-09-17T05:21:53.484071+0000","last_unstale":"2024-09-17T05:21:55.499769+0000","last_undegraded":"2024-09-17T05:21:55.499769+0000","last_fullsized":"2024-09-17T05:21:55.499769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:35:29.473422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.498541+0000","last_change":"2024-09-17T05:21:54.514953+0000","last_active":"2024-09-17T05:21:55.498541+0000","last_peered":"2024-09-17T05:21:55.498541+0000","last_clean":"2024-09-17T05:21:55.498541+0000","last_became_active":"2024-09-17T05:21:54.514665+0000","last_became_peered":"2024-09-17T05:21:54.514665+0000","last_unstale":"2024-09-17T05:21:55.498541+0000","last_undegraded":"2024-09-17T05:21:55.498541+0000","last_fullsized":"2024-09-17T05:21:55.498541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:38.013877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.497013+0000","last_change":"2024-09-17T05:21:53.489197+0000","last_active":"2024-09-17T05:21:55.497013+0000","last_peered":"2024-09-17T05:21:55.497013+0000","last_clean":"2024-09-17T05:21:55.497013+0000","last_became_active":"2024-09-17T05:21:53.484928+0000","last_became_peered":"2024-09-17T05:21:53.484928+0000","last_unstale":"2024-09-17T05:21:55.497013+0000","last_undegraded":"2024-09-17T05:21:55.497013+0000","last_fullsized":"2024-09-17T05:21:55.497013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:28.936504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499864+0000","last_change":"2024-09-17T05:21:54.497779+0000","last_active":"2024-09-17T05:21:55.499864+0000","last_peered":"2024-09-17T05:21:55.499864+0000","last_clean":"2024-09-17T05:21:55.499864+0000","last_became_active":"2024-09-17T05:21:54.497343+0000","last_became_peered":"2024-09-17T05:21:54.497343+0000","last_unstale":"2024-09-17T05:21:55.499864+0000","last_undegraded":"2024-09-17T05:21:55.499864+0000","last_fullsized":"2024-09-17T05:21:55.499864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:34:38.737329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.501521+0000","last_change":"2024-09-17T05:21:53.490515+0000","last_active":"2024-09-17T05:21:55.501521+0000","last_peered":"2024-09-17T05:21:55.501521+0000","last_clean":"2024-09-17T05:21:55.501521+0000","last_became_active":"2024-09-17T05:21:53.490173+0000","last_became_peered":"2024-09-17T05:21:53.490173+0000","last_unstale":"2024-09-17T05:21:55.501521+0000","last_undegraded":"2024-09-17T05:21:55.501521+0000","last_fullsized":"2024-09-17T05:21:55.501521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:42.132331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.748234+0000","last_change":"2024-09-17T05:21:54.494254+0000","last_active":"2024-09-17T05:21:55.748234+0000","last_peered":"2024-09-17T05:21:55.748234+0000","last_clean":"2024-09-17T05:21:55.748234+0000","last_became_active":"2024-09-17T05:21:54.493968+0000","last_became_peered":"2024-09-17T05:21:54.493968+0000","last_unstale":"2024-09-17T05:21:55.748234+0000","last_undegraded":"2024-09-17T05:21:55.748234+0000","last_fullsized":"2024-09-17T05:21:55.748234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:06.884350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.502396+0000","last_change":"2024-09-17T05:21:53.494784+0000","last_active":"2024-09-17T05:21:55.502396+0000","last_peered":"2024-09-17T05:21:55.502396+0000","last_clean":"2024-09-17T05:21:55.502396+0000","last_became_active":"2024-09-17T05:21:53.494504+0000","last_became_peered":"2024-09-17T05:21:53.494504+0000","last_unstale":"2024-09-17T05:21:55.502396+0000","last_undegraded":"2024-09-17T05:21:55.502396+0000","last_fullsized":"2024-09-17T05:21:55.502396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:13:50.064294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.747891+0000","last_change":"2024-09-17T05:21:54.493842+0000","last_active":"2024-09-17T05:21:55.747891+0000","last_peered":"2024-09-17T05:21:55.747891+0000","last_clean":"2024-09-17T05:21:55.747891+0000","last_became_active":"2024-09-17T05:21:54.493586+0000","last_became_peered":"2024-09-17T05:21:54.493586+0000","last_unstale":"2024-09-17T05:21:55.747891+0000","last_undegraded":"2024-09-17T05:21:55.747891+0000","last_fullsized":"2024-09-17T05:21:55.747891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:14:39.618479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.495902+0000","last_change":"2024-09-17T05:21:53.484810+0000","last_active":"2024-09-17T05:21:55.495902+0000","last_peered":"2024-09-17T05:21:55.495902+0000","last_clean":"2024-09-17T05:21:55.495902+0000","last_became_active":"2024-09-17T05:21:53.484016+0000","last_became_peered":"2024-09-17T05:21:53.484016+0000","last_unstale":"2024-09-17T05:21:55.495902+0000","last_undegraded":"2024-09-17T05:21:55.495902+0000","last_fullsized":"2024-09-17T05:21:55.495902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:58:35.674900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499028+0000","last_change":"2024-09-17T05:21:54.498171+0000","last_active":"2024-09-17T05:21:55.499028+0000","last_peered":"2024-09-17T05:21:55.499028+0000","last_clean":"2024-09-17T05:21:55.499028+0000","last_became_active":"2024-09-17T05:21:54.497780+0000","last_became_peered":"2024-09-17T05:21:54.497780+0000","last_unstale":"2024-09-17T05:21:55.499028+0000","last_undegraded":"2024-09-17T05:21:55.499028+0000","last_fullsized":"2024-09-17T05:21:55.499028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:53:19.454025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499780+0000","last_change":"2024-09-17T05:21:53.487419+0000","last_active":"2024-09-17T05:21:55.499780+0000","last_peered":"2024-09-17T05:21:55.499780+0000","last_clean":"2024-09-17T05:21:55.499780+0000","last_became_active":"2024-09-17T05:21:53.485874+0000","last_became_peered":"2024-09-17T05:21:53.485874+0000","last_unstale":"2024-09-17T05:21:55.499780+0000","last_undegraded":"2024-09-17T05:21:55.499780+0000","last_fullsized":"2024-09-17T05:21:55.499780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:31.652148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.748779+0000","last_change":"2024-09-17T05:21:54.500587+0000","last_active":"2024-09-17T05:21:55.748779+0000","last_peered":"2024-09-17T05:21:55.748779+0000","last_clean":"2024-09-17T05:21:55.748779+0000","last_became_active":"2024-09-17T05:21:54.500333+0000","last_became_peered":"2024-09-17T05:21:54.500333+0000","last_unstale":"2024-09-17T05:21:55.748779+0000","last_undegraded":"2024-09-17T05:21:55.748779+0000","last_fullsized":"2024-09-17T05:21:55.748779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:53.919157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.499720+0000","last_change":"2024-09-17T05:21:53.486091+0000","last_active":"2024-09-17T05:21:55.499720+0000","last_peered":"2024-09-17T05:21:55.499720+0000","last_clean":"2024-09-17T05:21:55.499720+0000","last_became_active":"2024-09-17T05:21:53.485314+0000","last_became_peered":"2024-09-17T05:21:53.485314+0000","last_unstale":"2024-09-17T05:21:55.499720+0000","last_undegraded":"2024-09-17T05:21:55.499720+0000","last_fullsized":"2024-09-17T05:21:55.499720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:53:42.808589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.749674+0000","last_change":"2024-09-17T05:21:54.503373+0000","last_active":"2024-09-17T05:21:55.749674+0000","last_peered":"2024-09-17T05:21:55.749674+0000","last_clean":"2024-09-17T05:21:55.749674+0000","last_became_active":"2024-09-17T05:21:54.503073+0000","last_became_peered":"2024-09-17T05:21:54.503073+0000","last_unstale":"2024-09-17T05:21:55.749674+0000","last_undegraded":"2024-09-17T05:21:55.749674+0000","last_fullsized":"2024-09-17T05:21:55.749674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:28.960088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.496712+0000","last_change":"2024-09-17T05:21:53.489998+0000","last_active":"2024-09-17T05:21:55.496712+0000","last_peered":"2024-09-17T05:21:55.496712+0000","last_clean":"2024-09-17T05:21:55.496712+0000","last_became_active":"2024-09-17T05:21:53.489673+0000","last_became_peered":"2024-09-17T05:21:53.489673+0000","last_unstale":"2024-09-17T05:21:55.496712+0000","last_undegraded":"2024-09-17T05:21:55.496712+0000","last_fullsized":"2024-09-17T05:21:55.496712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:15.739862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.502066+0000","last_change":"2024-09-17T05:21:54.504813+0000","last_active":"2024-09-17T05:21:55.502066+0000","last_peered":"2024-09-17T05:21:55.502066+0000","last_clean":"2024-09-17T05:21:55.502066+0000","last_became_active":"2024-09-17T05:21:54.504086+0000","last_became_peered":"2024-09-17T05:21:54.504086+0000","last_unstale":"2024-09-17T05:21:55.502066+0000","last_undegraded":"2024-09-17T05:21:55.502066+0000","last_fullsized":"2024-09-17T05:21:55.502066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:06:40.408782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.498308+0000","last_change":"2024-09-17T05:21:54.512621+0000","last_active":"2024-09-17T05:21:55.498308+0000","last_peered":"2024-09-17T05:21:55.498308+0000","last_clean":"2024-09-17T05:21:55.498308+0000","last_became_active":"2024-09-17T05:21:54.512256+0000","last_became_peered":"2024-09-17T05:21:54.512256+0000","last_unstale":"2024-09-17T05:21:55.498308+0000","last_undegraded":"2024-09-17T05:21:55.498308+0000","last_fullsized":"2024-09-17T05:21:55.498308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:34:47.447957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.496194+0000","last_change":"2024-09-17T05:21:53.490984+0000","last_active":"2024-09-17T05:21:55.496194+0000","last_peered":"2024-09-17T05:21:55.496194+0000","last_clean":"2024-09-17T05:21:55.496194+0000","last_became_active":"2024-09-17T05:21:53.490001+0000","last_became_peered":"2024-09-17T05:21:53.490001+0000","last_unstale":"2024-09-17T05:21:55.496194+0000","last_undegraded":"2024-09-17T05:21:55.496194+0000","last_fullsized":"2024-09-17T05:21:55.496194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:08.690514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.497721+0000","last_change":"2024-09-17T05:21:54.510777+0000","last_active":"2024-09-17T05:21:55.497721+0000","last_peered":"2024-09-17T05:21:55.497721+0000","last_clean":"2024-09-17T05:21:55.497721+0000","last_became_active":"2024-09-17T05:21:54.510517+0000","last_became_peered":"2024-09-17T05:21:54.510517+0000","last_unstale":"2024-09-17T05:21:55.497721+0000","last_undegraded":"2024-09-17T05:21:55.497721+0000","last_fullsized":"2024-09-17T05:21:55.497721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:49:06.303460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.496892+0000","last_change":"2024-09-17T05:21:53.491157+0000","last_active":"2024-09-17T05:21:55.496892+0000","last_peered":"2024-09-17T05:21:55.496892+0000","last_clean":"2024-09-17T05:21:55.496892+0000","last_became_active":"2024-09-17T05:21:53.490315+0000","last_became_peered":"2024-09-17T05:21:53.490315+0000","last_unstale":"2024-09-17T05:21:55.496892+0000","last_undegraded":"2024-09-17T05:21:55.496892+0000","last_fullsized":"2024-09-17T05:21:55.496892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:58:14.211132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.747944+0000","last_change":"2024-09-17T05:21:54.512428+0000","last_active":"2024-09-17T05:21:55.747944+0000","last_peered":"2024-09-17T05:21:55.747944+0000","last_clean":"2024-09-17T05:21:55.747944+0000","last_became_active":"2024-09-17T05:21:54.511546+0000","last_became_peered":"2024-09-17T05:21:54.511546+0000","last_unstale":"2024-09-17T05:21:55.747944+0000","last_undegraded":"2024-09-17T05:21:55.747944+0000","last_fullsized":"2024-09-17T05:21:55.747944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:32.727377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.749095+0000","last_change":"2024-09-17T05:21:53.483928+0000","last_active":"2024-09-17T05:21:55.749095+0000","last_peered":"2024-09-17T05:21:55.749095+0000","last_clean":"2024-09-17T05:21:55.749095+0000","last_became_active":"2024-09-17T05:21:53.483478+0000","last_became_peered":"2024-09-17T05:21:53.483478+0000","last_unstale":"2024-09-17T05:21:55.749095+0000","last_undegraded":"2024-09-17T05:21:55.749095+0000","last_fullsized":"2024-09-17T05:21:55.749095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:25.985141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.749036+0000","last_change":"2024-09-17T05:21:54.499626+0000","last_active":"2024-09-17T05:21:55.749036+0000","last_peered":"2024-09-17T05:21:55.749036+0000","last_clean":"2024-09-17T05:21:55.749036+0000","last_became_active":"2024-09-17T05:21:54.499321+0000","last_became_peered":"2024-09-17T05:21:54.499321+0000","last_unstale":"2024-09-17T05:21:55.749036+0000","last_undegraded":"2024-09-17T05:21:55.749036+0000","last_fullsized":"2024-09-17T05:21:55.749036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:53.466708+0000","last_clean_scrub_stamp":"2024-09-17T05:21:53.466708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:44:54.516203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:21:55.748008+0000","last_change":"2024-09-17T05:21:53.486585+0000","last_active":"2024-09-17T05:21:55.748008+0000","last_peered":"2024-09-17T05:21:55.748008+0000","last_clean":"2024-09-17T05:21:55.748008+0000","last_became_active":"2024-09-17T05:21:53.486306+0000","last_became_peered":"2024-09-17T05:21:53.486306+0000","last_unstale":"2024-09-17T05:21:55.748008+0000","last_undegraded":"2024-09-17T05:21:55.748008+0000","last_fullsized":"2024-09-17T05:21:55.748008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:52.460729+0000","last_clean_scrub_stamp":"2024-09-17T05:21:52.460729+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:19.726620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":74993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":73381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":815104,"data_stored":664387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":806912,"data_stored":664331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":74993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":73471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542152,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":73507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":73541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:22:05.278 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T05:22:05.278 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-17T05:22:05.278 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-17T05:22:05.278 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-17T05:22:05.415 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.413+0000 7f684dc08640 1 -- 172.21.15.98:0/2493021975 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68481616e0 msgr2=0x7f68480b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:05.415 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.413+0000 7f684dc08640 1 --2- 172.21.15.98:0/2493021975 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68481616e0 0x7f68480b41c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f68480d23e0 tx=0x7f683802a440 comp rx=0 tx=0).stop 2024-09-17T05:22:05.415 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.413+0000 7f684dc08640 1 -- 172.21.15.98:0/2493021975 shutdown_connections 2024-09-17T05:22:05.415 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.413+0000 7f684dc08640 1 --2- 172.21.15.98:0/2493021975 >> v2:172.21.15.167:3300/0 conn(0x7f68480d1ee0 0x7f68480d2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:05.415 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.413+0000 7f684dc08640 1 --2- 172.21.15.98:0/2493021975 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f68480b4ae0 0x7f68480d2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:05.415 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.413+0000 7f684dc08640 1 --2- 172.21.15.98:0/2493021975 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68481616e0 0x7f68480b41c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:05.415 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.413+0000 7f684dc08640 1 -- 172.21.15.98:0/2493021975 >> 172.21.15.98:0/2493021975 conn(0x7f68480d3fe0 msgr2=0x7f68480d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:05.415 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.413+0000 7f684dc08640 1 -- 172.21.15.98:0/2493021975 shutdown_connections 2024-09-17T05:22:05.415 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.413+0000 7f684dc08640 1 -- 172.21.15.98:0/2493021975 wait complete. 2024-09-17T05:22:05.418 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.415+0000 7f684dc08640 1 Processor -- start 2024-09-17T05:22:05.418 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.415+0000 7f684dc08640 1 -- start start 2024-09-17T05:22:05.418 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.416+0000 7f684dc08640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f68480b4ae0 0x7f68480b2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:05.418 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.416+0000 7f684dc08640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68480d1ee0 0x7f68481f5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:05.418 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.416+0000 7f684dc08640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68481616e0 0x7f68480b20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:05.418 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.416+0000 7f684dc08640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f68480b4910 con 0x7f68480d1ee0 2024-09-17T05:22:05.418 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.416+0000 7f684dc08640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6848161c60 con 0x7f68481616e0 2024-09-17T05:22:05.418 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.416+0000 7f684dc08640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f68480d03b0 con 0x7f68480b4ae0 2024-09-17T05:22:05.418 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.416+0000 7f6846ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68480d1ee0 0x7f68481f5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:05.418 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.416+0000 7f6846ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68480d1ee0 0x7f68481f5370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47876/0 (socket says 172.21.15.98:47876) 2024-09-17T05:22:05.418 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.416+0000 7f6846ffd640 1 -- 172.21.15.98:0/938603777 learned_addr learned my addr 172.21.15.98:0/938603777 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:05.419 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.416+0000 7f6847fff640 1 --2- 172.21.15.98:0/938603777 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68481616e0 0x7f68480b20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:05.419 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.416+0000 7f68477fe640 1 --2- 172.21.15.98:0/938603777 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f68480b4ae0 0x7f68480b2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:05.419 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.416+0000 7f6846ffd640 1 -- 172.21.15.98:0/938603777 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f68480b4ae0 msgr2=0x7f68480b2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:05.419 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.416+0000 7f6846ffd640 1 --2- 172.21.15.98:0/938603777 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f68480b4ae0 0x7f68480b2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:05.419 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.416+0000 7f6846ffd640 1 -- 172.21.15.98:0/938603777 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68481616e0 msgr2=0x7f68480b20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:05.419 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.416+0000 7f6846ffd640 1 --2- 172.21.15.98:0/938603777 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68481616e0 0x7f68480b20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:05.419 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.416+0000 7f6846ffd640 1 -- 172.21.15.98:0/938603777 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f684809ddc0 con 0x7f68480d1ee0 2024-09-17T05:22:05.419 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.416+0000 7f6846ffd640 1 --2- 172.21.15.98:0/938603777 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68480d1ee0 0x7f68481f5370 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f683c00c890 tx=0x7f683c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:05.419 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.416+0000 7f682ffff640 1 -- 172.21.15.98:0/938603777 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f683c004220 con 0x7f68480d1ee0 2024-09-17T05:22:05.420 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.416+0000 7f682ffff640 1 -- 172.21.15.98:0/938603777 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f683c0079b0 con 0x7f68480d1ee0 2024-09-17T05:22:05.420 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.416+0000 7f684dc08640 1 -- 172.21.15.98:0/938603777 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68481f58b0 con 0x7f68480d1ee0 2024-09-17T05:22:05.420 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.416+0000 7f682ffff640 1 -- 172.21.15.98:0/938603777 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f683c007de0 con 0x7f68480d1ee0 2024-09-17T05:22:05.420 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.416+0000 7f684dc08640 1 -- 172.21.15.98:0/938603777 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68480cb2c0 con 0x7f68480d1ee0 2024-09-17T05:22:05.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.417+0000 7f684dc08640 1 -- 172.21.15.98:0/938603777 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68480b41c0 con 0x7f68480d1ee0 2024-09-17T05:22:05.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.418+0000 7f682ffff640 1 -- 172.21.15.98:0/938603777 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f683c005020 con 0x7f68480d1ee0 2024-09-17T05:22:05.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.418+0000 7f682ffff640 1 --2- 172.21.15.98:0/938603777 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f6834078bc0 0x7f683407b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:05.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.419+0000 7f682ffff640 1 -- 172.21.15.98:0/938603777 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f683c09b070 con 0x7f68480d1ee0 2024-09-17T05:22:05.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.419+0000 7f68477fe640 1 --2- 172.21.15.98:0/938603777 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f6834078bc0 0x7f683407b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:05.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.419+0000 7f68477fe640 1 --2- 172.21.15.98:0/938603777 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f6834078bc0 0x7f683407b080 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6838033000 tx=0x7f6838004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:05.423 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.423+0000 7f682ffff640 1 -- 172.21.15.98:0/938603777 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f68481f58b0 con 0x7f68480d1ee0 2024-09-17T05:22:05.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.637+0000 7f684dc08640 1 -- 172.21.15.98:0/938603777 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f68480b1930 con 0x7f68480d1ee0 2024-09-17T05:22:05.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.637+0000 7f682ffff640 1 -- 172.21.15.98:0/938603777 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f683c014030 con 0x7f68480d1ee0 2024-09-17T05:22:05.638 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:22:05.638 INFO:teuthology.orchestra.run.smithi098.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-17T05:22:05.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.639+0000 7f684dc08640 1 -- 172.21.15.98:0/938603777 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f6834078bc0 msgr2=0x7f683407b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:05.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.639+0000 7f684dc08640 1 --2- 172.21.15.98:0/938603777 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f6834078bc0 0x7f683407b080 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6838033000 tx=0x7f6838004730 comp rx=0 tx=0).stop 2024-09-17T05:22:05.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.639+0000 7f684dc08640 1 -- 172.21.15.98:0/938603777 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68480d1ee0 msgr2=0x7f68481f5370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:05.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.639+0000 7f684dc08640 1 --2- 172.21.15.98:0/938603777 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68480d1ee0 0x7f68481f5370 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f683c00c890 tx=0x7f683c00cd50 comp rx=0 tx=0).stop 2024-09-17T05:22:05.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.639+0000 7f684dc08640 1 -- 172.21.15.98:0/938603777 shutdown_connections 2024-09-17T05:22:05.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.639+0000 7f684dc08640 1 --2- 172.21.15.98:0/938603777 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f6834078bc0 0x7f683407b080 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:05.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.639+0000 7f684dc08640 1 --2- 172.21.15.98:0/938603777 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68481616e0 0x7f68480b20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:05.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.639+0000 7f684dc08640 1 --2- 172.21.15.98:0/938603777 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68480d1ee0 0x7f68481f5370 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:05.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.639+0000 7f684dc08640 1 --2- 172.21.15.98:0/938603777 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f68480b4ae0 0x7f68480b2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:05.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.639+0000 7f684dc08640 1 -- 172.21.15.98:0/938603777 >> 172.21.15.98:0/938603777 conn(0x7f68480d3fe0 msgr2=0x7f68480b50c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:05.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.640+0000 7f684dc08640 1 -- 172.21.15.98:0/938603777 shutdown_connections 2024-09-17T05:22:05.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.640+0000 7f684dc08640 1 -- 172.21.15.98:0/938603777 wait complete. 2024-09-17T05:22:05.651 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-17T05:22:05.652 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:22:05.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.752+0000 7f1f7ec40640 1 -- 172.21.15.98:0/4202150270 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f68004d40 msgr2=0x7f1f680051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:05.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.752+0000 7f1f7ec40640 1 --2- 172.21.15.98:0/4202150270 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f68004d40 0x7f1f680051c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1f70002230 tx=0x7f1f68005830 comp rx=0 tx=0).stop 2024-09-17T05:22:05.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.752+0000 7f1f7d1dd640 1 -- 172.21.15.98:0/4202150270 reap_dead start 2024-09-17T05:22:05.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.752+0000 7f1f7ec40640 1 -- 172.21.15.98:0/4202150270 shutdown_connections 2024-09-17T05:22:05.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.752+0000 7f1f7ec40640 1 -- 172.21.15.98:0/4202150270 >> 172.21.15.98:0/4202150270 conn(0x7f1f780b1950 msgr2=0x7f1f780b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:05.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.752+0000 7f1f7ec40640 1 -- 172.21.15.98:0/4202150270 shutdown_connections 2024-09-17T05:22:05.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.752+0000 7f1f7ec40640 1 -- 172.21.15.98:0/4202150270 wait complete. 2024-09-17T05:22:05.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.753+0000 7f1f7ec40640 1 Processor -- start 2024-09-17T05:22:05.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.753+0000 7f1f7ec40640 1 -- start start 2024-09-17T05:22:05.756 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.754+0000 7f1f7ec40640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f68004d40 0x7f1f780cfa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:05.756 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.754+0000 7f1f7ec40640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f78157810 0x7f1f7814d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:05.756 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.754+0000 7f1f7ec40640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f781f48e0 0x7f1f7809ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:05.756 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.754+0000 7f1f7ec40640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1f780b25c0 con 0x7f1f78157810 2024-09-17T05:22:05.756 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.754+0000 7f1f7ec40640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1f780b2440 con 0x7f1f68004d40 2024-09-17T05:22:05.756 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.754+0000 7f1f7ec40640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f1f780b2740 con 0x7f1f781f48e0 2024-09-17T05:22:05.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.754+0000 7f1f77fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f78157810 0x7f1f7814d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:05.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.754+0000 7f1f77fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f78157810 0x7f1f7814d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47898/0 (socket says 172.21.15.98:47898) 2024-09-17T05:22:05.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.754+0000 7f1f77fff640 1 -- 172.21.15.98:0/2976538207 learned_addr learned my addr 172.21.15.98:0/2976538207 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:05.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.754+0000 7f1f7c9dc640 1 --2- 172.21.15.98:0/2976538207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f68004d40 0x7f1f780cfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:05.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.754+0000 7f1f7d1dd640 1 --2- 172.21.15.98:0/2976538207 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f781f48e0 0x7f1f7809ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:05.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.754+0000 7f1f77fff640 1 -- 172.21.15.98:0/2976538207 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f781f48e0 msgr2=0x7f1f7809ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:05.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.754+0000 7f1f77fff640 1 --2- 172.21.15.98:0/2976538207 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f781f48e0 0x7f1f7809ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:05.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.754+0000 7f1f77fff640 1 -- 172.21.15.98:0/2976538207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f68004d40 msgr2=0x7f1f780cfa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:05.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.754+0000 7f1f77fff640 1 --2- 172.21.15.98:0/2976538207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f68004d40 0x7f1f780cfa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:05.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.754+0000 7f1f77fff640 1 -- 172.21.15.98:0/2976538207 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f780d01c0 con 0x7f1f78157810 2024-09-17T05:22:05.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.755+0000 7f1f77fff640 1 --2- 172.21.15.98:0/2976538207 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f78157810 0x7f1f7814d480 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1f64005fd0 tx=0x7f1f64009dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:05.758 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.755+0000 7f1f757fa640 1 -- 172.21.15.98:0/2976538207 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f64007a70 con 0x7f1f78157810 2024-09-17T05:22:05.758 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.755+0000 7f1f757fa640 1 -- 172.21.15.98:0/2976538207 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1f64007c10 con 0x7f1f78157810 2024-09-17T05:22:05.758 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.755+0000 7f1f7ec40640 1 -- 172.21.15.98:0/2976538207 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f780d04a0 con 0x7f1f78157810 2024-09-17T05:22:05.758 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.755+0000 7f1f757fa640 1 -- 172.21.15.98:0/2976538207 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f64004020 con 0x7f1f78157810 2024-09-17T05:22:05.758 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.755+0000 7f1f7ec40640 1 -- 172.21.15.98:0/2976538207 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f781f40e0 con 0x7f1f78157810 2024-09-17T05:22:05.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.756+0000 7f1f7ec40640 1 -- 172.21.15.98:0/2976538207 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f780710e0 con 0x7f1f78157810 2024-09-17T05:22:05.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.756+0000 7f1f757fa640 1 -- 172.21.15.98:0/2976538207 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1f64020020 con 0x7f1f78157810 2024-09-17T05:22:05.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.757+0000 7f1f757fa640 1 --2- 172.21.15.98:0/2976538207 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f1f5c078b90 0x7f1f5c07b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:05.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.757+0000 7f1f757fa640 1 -- 172.21.15.98:0/2976538207 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1f6409eb10 con 0x7f1f78157810 2024-09-17T05:22:05.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.757+0000 7f1f7c9dc640 1 --2- 172.21.15.98:0/2976538207 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f1f5c078b90 0x7f1f5c07b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:05.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.757+0000 7f1f7c9dc640 1 --2- 172.21.15.98:0/2976538207 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f1f5c078b90 0x7f1f5c07b050 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c009c50 tx=0x7f1f6c005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:05.761 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.761+0000 7f1f757fa640 1 -- 172.21.15.98:0/2976538207 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f1f780710e0 con 0x7f1f78157810 2024-09-17T05:22:05.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.971+0000 7f1f7ec40640 1 -- 172.21.15.98:0/2976538207 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1f780acd30 con 0x7f1f78157810 2024-09-17T05:22:05.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.971+0000 7f1f757fa640 1 -- 172.21.15.98:0/2976538207 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5217 (secure 0 0 0) 0x7f1f64016070 con 0x7f1f78157810 2024-09-17T05:22:05.973 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:22:05.973 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":7,"btime":"2024-09-17T05:21:56:643998+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4368,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/237112225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":237112225},{"type":"v1","addr":"172.21.15.98:6833","nonce":237112225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4377,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/4042308128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":4042308128},{"type":"v1","addr":"172.21.15.98:6835","nonce":4042308128}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4378,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/313781530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":313781530},{"type":"v1","addr":"172.21.15.167:6836","nonce":313781530}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:21:53.826247+0000","modified":"2024-09-17T05:21:55.988646+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4386},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4386":{"gid":4386,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6837/4171766128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":4171766128},{"type":"v1","addr":"172.21.15.167:6837","nonce":4171766128}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4386,"qdb_cluster":[4386]},"id":1}]} 2024-09-17T05:22:05.973 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 7 2024-09-17T05:22:05.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.974+0000 7f1f7ec40640 1 -- 172.21.15.98:0/2976538207 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f1f5c078b90 msgr2=0x7f1f5c07b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:05.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.974+0000 7f1f7ec40640 1 --2- 172.21.15.98:0/2976538207 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f1f5c078b90 0x7f1f5c07b050 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c009c50 tx=0x7f1f6c005f90 comp rx=0 tx=0).stop 2024-09-17T05:22:05.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.974+0000 7f1f7ec40640 1 -- 172.21.15.98:0/2976538207 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f78157810 msgr2=0x7f1f7814d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:05.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.974+0000 7f1f7ec40640 1 --2- 172.21.15.98:0/2976538207 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f78157810 0x7f1f7814d480 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1f64005fd0 tx=0x7f1f64009dc0 comp rx=0 tx=0).stop 2024-09-17T05:22:05.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.974+0000 7f1f7ec40640 1 -- 172.21.15.98:0/2976538207 shutdown_connections 2024-09-17T05:22:05.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.974+0000 7f1f7ec40640 1 --2- 172.21.15.98:0/2976538207 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f1f5c078b90 0x7f1f5c07b050 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:05.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.974+0000 7f1f7ec40640 1 --2- 172.21.15.98:0/2976538207 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f781f48e0 0x7f1f7809ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:05.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.974+0000 7f1f7ec40640 1 --2- 172.21.15.98:0/2976538207 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f78157810 0x7f1f7814d480 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:05.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.974+0000 7f1f7ec40640 1 --2- 172.21.15.98:0/2976538207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f68004d40 0x7f1f780cfa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:05.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.974+0000 7f1f7ec40640 1 -- 172.21.15.98:0/2976538207 >> 172.21.15.98:0/2976538207 conn(0x7f1f780b1950 msgr2=0x7f1f780b48f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:05.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.974+0000 7f1f7ec40640 1 -- 172.21.15.98:0/2976538207 shutdown_connections 2024-09-17T05:22:05.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:05.974+0000 7f1f7ec40640 1 -- 172.21.15.98:0/2976538207 wait complete. 2024-09-17T05:22:05.986 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:22:06.088 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.085+0000 7f2eaec62640 1 -- 172.21.15.98:0/2763953411 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ea815f5a0 msgr2=0x7f2ea80b2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:06.088 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.086+0000 7f2eaec62640 1 --2- 172.21.15.98:0/2763953411 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ea815f5a0 0x7f2ea80b2440 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8076720 tx=0x7f2ea402a4d0 comp rx=0 tx=0).stop 2024-09-17T05:22:06.088 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.086+0000 7f2eaec62640 1 -- 172.21.15.98:0/2763953411 shutdown_connections 2024-09-17T05:22:06.088 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.086+0000 7f2eaec62640 1 --2- 172.21.15.98:0/2763953411 >> v2:172.21.15.167:3300/0 conn(0x7f2ea80ad270 0x7f2ea8073fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:06.088 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.086+0000 7f2eaec62640 1 --2- 172.21.15.98:0/2763953411 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ea80ccf00 0x7f2ea80acd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:06.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.086+0000 7f2eaec62640 1 --2- 172.21.15.98:0/2763953411 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ea815f5a0 0x7f2ea80b2440 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:06.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.086+0000 7f2eaec62640 1 -- 172.21.15.98:0/2763953411 >> 172.21.15.98:0/2763953411 conn(0x7f2ea80b1950 msgr2=0x7f2ea80b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:06.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.086+0000 7f2eaec62640 1 -- 172.21.15.98:0/2763953411 shutdown_connections 2024-09-17T05:22:06.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.086+0000 7f2eaec62640 1 -- 172.21.15.98:0/2763953411 wait complete. 2024-09-17T05:22:06.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.087+0000 7f2eaec62640 1 Processor -- start 2024-09-17T05:22:06.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.087+0000 7f2eaec62640 1 -- start start 2024-09-17T05:22:06.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.088+0000 7f2eaec62640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ea80ad270 0x7f2ea814ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:06.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.088+0000 7f2eaec62640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ea80ccf00 0x7f2ea814f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:06.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.088+0000 7f2eaec62640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ea815f5a0 0x7f2ea814fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:06.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.088+0000 7f2eaec62640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea806f160 con 0x7f2ea80ad270 2024-09-17T05:22:06.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.088+0000 7f2eaec62640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea8074780 con 0x7f2ea80ccf00 2024-09-17T05:22:06.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.088+0000 7f2eaec62640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f2ea806f2e0 con 0x7f2ea815f5a0 2024-09-17T05:22:06.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.088+0000 7f2eac9fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ea80ad270 0x7f2ea814ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:06.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.088+0000 7f2eac9fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ea80ad270 0x7f2ea814ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47920/0 (socket says 172.21.15.98:47920) 2024-09-17T05:22:06.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.088+0000 7f2eac9fe640 1 -- 172.21.15.98:0/679971205 learned_addr learned my addr 172.21.15.98:0/679971205 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:06.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.088+0000 7f2ead1ff640 1 --2- 172.21.15.98:0/679971205 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ea815f5a0 0x7f2ea814fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:06.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.088+0000 7f2e9ffff640 1 --2- 172.21.15.98:0/679971205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ea80ccf00 0x7f2ea814f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:06.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.088+0000 7f2eac9fe640 1 -- 172.21.15.98:0/679971205 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ea815f5a0 msgr2=0x7f2ea814fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:06.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.088+0000 7f2eac9fe640 1 --2- 172.21.15.98:0/679971205 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ea815f5a0 0x7f2ea814fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:06.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.088+0000 7f2eac9fe640 1 -- 172.21.15.98:0/679971205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ea80ccf00 msgr2=0x7f2ea814f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:06.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.088+0000 7f2eac9fe640 1 --2- 172.21.15.98:0/679971205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ea80ccf00 0x7f2ea814f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:06.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.088+0000 7f2eac9fe640 1 -- 172.21.15.98:0/679971205 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ea814e940 con 0x7f2ea80ad270 2024-09-17T05:22:06.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.088+0000 7f2ead1ff640 1 --2- 172.21.15.98:0/679971205 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ea815f5a0 0x7f2ea814fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:22:06.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.088+0000 7f2eac9fe640 1 --2- 172.21.15.98:0/679971205 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ea80ad270 0x7f2ea814ca70 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4034040 tx=0x7f2ea40039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:06.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.088+0000 7f2e9d7fa640 1 -- 172.21.15.98:0/679971205 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea403e030 con 0x7f2ea80ad270 2024-09-17T05:22:06.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.088+0000 7f2e9d7fa640 1 -- 172.21.15.98:0/679971205 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2ea40047a0 con 0x7f2ea80ad270 2024-09-17T05:22:06.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.088+0000 7f2eaec62640 1 -- 172.21.15.98:0/679971205 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ea81f3920 con 0x7f2ea80ad270 2024-09-17T05:22:06.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.088+0000 7f2e9d7fa640 1 -- 172.21.15.98:0/679971205 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea4035040 con 0x7f2ea80ad270 2024-09-17T05:22:06.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.088+0000 7f2eaec62640 1 -- 172.21.15.98:0/679971205 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ea81f3ee0 con 0x7f2ea80ad270 2024-09-17T05:22:06.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.089+0000 7f2eaec62640 1 -- 172.21.15.98:0/679971205 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ea806f870 con 0x7f2ea80ad270 2024-09-17T05:22:06.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.090+0000 7f2e9d7fa640 1 -- 172.21.15.98:0/679971205 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2ea4041030 con 0x7f2ea80ad270 2024-09-17T05:22:06.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.091+0000 7f2e9d7fa640 1 --2- 172.21.15.98:0/679971205 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f2e94078b90 0x7f2e9407b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:06.100 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.091+0000 7f2e9d7fa640 1 -- 172.21.15.98:0/679971205 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2ea40bb490 con 0x7f2ea80ad270 2024-09-17T05:22:06.100 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.091+0000 7f2e9ffff640 1 --2- 172.21.15.98:0/679971205 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f2e94078b90 0x7f2e9407b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:06.100 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.091+0000 7f2e9ffff640 1 --2- 172.21.15.98:0/679971205 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f2e94078b90 0x7f2e9407b050 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2e980058c0 tx=0x7f2e98005c60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:06.100 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.095+0000 7f2e9d7fa640 1 -- 172.21.15.98:0/679971205 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f2ea40839f0 con 0x7f2ea80ad270 2024-09-17T05:22:06.308 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.307+0000 7f2eaec62640 1 -- 172.21.15.98:0/679971205 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2ea809d630 con 0x7f2ea80ad270 2024-09-17T05:22:06.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.308+0000 7f2e9d7fa640 1 -- 172.21.15.98:0/679971205 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5217 (secure 0 0 0) 0x7f2ea40832f0 con 0x7f2ea80ad270 2024-09-17T05:22:06.309 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:22:06.309 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":7,"btime":"2024-09-17T05:21:56:643998+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4368,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/237112225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":237112225},{"type":"v1","addr":"172.21.15.98:6833","nonce":237112225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4377,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/4042308128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":4042308128},{"type":"v1","addr":"172.21.15.98:6835","nonce":4042308128}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4378,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/313781530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":313781530},{"type":"v1","addr":"172.21.15.167:6836","nonce":313781530}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:21:53.826247+0000","modified":"2024-09-17T05:21:55.988646+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4386},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4386":{"gid":4386,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6837/4171766128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":4171766128},{"type":"v1","addr":"172.21.15.167:6837","nonce":4171766128}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4386,"qdb_cluster":[4386]},"id":1}]} 2024-09-17T05:22:06.309 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 7 2024-09-17T05:22:06.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.310+0000 7f2eaec62640 1 -- 172.21.15.98:0/679971205 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f2e94078b90 msgr2=0x7f2e9407b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:06.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.310+0000 7f2eaec62640 1 --2- 172.21.15.98:0/679971205 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f2e94078b90 0x7f2e9407b050 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2e980058c0 tx=0x7f2e98005c60 comp rx=0 tx=0).stop 2024-09-17T05:22:06.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.310+0000 7f2eaec62640 1 -- 172.21.15.98:0/679971205 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ea80ad270 msgr2=0x7f2ea814ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:06.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.310+0000 7f2eaec62640 1 --2- 172.21.15.98:0/679971205 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ea80ad270 0x7f2ea814ca70 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4034040 tx=0x7f2ea40039e0 comp rx=0 tx=0).stop 2024-09-17T05:22:06.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.310+0000 7f2eaec62640 1 -- 172.21.15.98:0/679971205 shutdown_connections 2024-09-17T05:22:06.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.310+0000 7f2eaec62640 1 --2- 172.21.15.98:0/679971205 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f2e94078b90 0x7f2e9407b050 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:06.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.310+0000 7f2eaec62640 1 --2- 172.21.15.98:0/679971205 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ea815f5a0 0x7f2ea814fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:06.312 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.310+0000 7f2eaec62640 1 --2- 172.21.15.98:0/679971205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ea80ccf00 0x7f2ea814f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:06.312 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.310+0000 7f2eaec62640 1 --2- 172.21.15.98:0/679971205 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ea80ad270 0x7f2ea814ca70 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:06.312 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.310+0000 7f2eaec62640 1 -- 172.21.15.98:0/679971205 >> 172.21.15.98:0/679971205 conn(0x7f2ea80b1950 msgr2=0x7f2ea80af8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:06.312 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.310+0000 7f2eaec62640 1 -- 172.21.15.98:0/679971205 shutdown_connections 2024-09-17T05:22:06.312 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.310+0000 7f2eaec62640 1 -- 172.21.15.98:0/679971205 wait complete. 2024-09-17T05:22:06.322 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:22:06.423 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.422+0000 7fa8ebefe640 1 -- 172.21.15.98:0/2382868457 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8e40ccf00 msgr2=0x7fa8e40acd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:06.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.422+0000 7fa8ebefe640 1 --2- 172.21.15.98:0/2382868457 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8e40ccf00 0x7fa8e40acd30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa8d4005fd0 tx=0x7fa8d402a540 comp rx=0 tx=0).stop 2024-09-17T05:22:06.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.422+0000 7fa8ebefe640 1 -- 172.21.15.98:0/2382868457 shutdown_connections 2024-09-17T05:22:06.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.422+0000 7fa8ebefe640 1 --2- 172.21.15.98:0/2382868457 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8e40ccf00 0x7fa8e40acd30 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:06.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.422+0000 7fa8ebefe640 1 --2- 172.21.15.98:0/2382868457 >> v2:172.21.15.167:3300/0 conn(0x7fa8e415f5a0 0x7fa8e40b2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:06.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.422+0000 7fa8ebefe640 1 -- 172.21.15.98:0/2382868457 >> 172.21.15.98:0/2382868457 conn(0x7fa8e40b1950 msgr2=0x7fa8e40b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:06.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.422+0000 7fa8ebefe640 1 -- 172.21.15.98:0/2382868457 shutdown_connections 2024-09-17T05:22:06.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.422+0000 7fa8ebefe640 1 -- 172.21.15.98:0/2382868457 wait complete. 2024-09-17T05:22:06.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.423+0000 7fa8ebefe640 1 Processor -- start 2024-09-17T05:22:06.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.423+0000 7fa8ebefe640 1 -- start start 2024-09-17T05:22:06.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.424+0000 7fa8ebefe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8e40ad270 0x7fa8e40c67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:06.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.424+0000 7fa8ebefe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8e40ccf00 0x7fa8e415b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:06.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.424+0000 7fa8ebefe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8e415f5a0 0x7fa8e415bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:06.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.424+0000 7fa8ebefe640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa8e406f2e0 con 0x7fa8e415f5a0 2024-09-17T05:22:06.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.424+0000 7fa8ebefe640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa8e406f160 con 0x7fa8e40ccf00 2024-09-17T05:22:06.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.424+0000 7fa8ebefe640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fa8e406f460 con 0x7fa8e40ad270 2024-09-17T05:22:06.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.424+0000 7fa8ea49b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8e415f5a0 0x7fa8e415bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:06.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.424+0000 7fa8e9499640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8e40ccf00 0x7fa8e415b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:06.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.424+0000 7fa8ea49b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8e415f5a0 0x7fa8e415bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39730/0 (socket says 172.21.15.98:39730) 2024-09-17T05:22:06.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.424+0000 7fa8ea49b640 1 -- 172.21.15.98:0/3481913170 learned_addr learned my addr 172.21.15.98:0/3481913170 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:06.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.424+0000 7fa8e9c9a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8e40ad270 0x7fa8e40c67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:06.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.425+0000 7fa8ea49b640 1 -- 172.21.15.98:0/3481913170 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8e40ad270 msgr2=0x7fa8e40c67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:06.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.425+0000 7fa8ea49b640 1 --2- 172.21.15.98:0/3481913170 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8e40ad270 0x7fa8e40c67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:06.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.425+0000 7fa8ea49b640 1 -- 172.21.15.98:0/3481913170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8e40ccf00 msgr2=0x7fa8e415b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:06.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.425+0000 7fa8ea49b640 1 --2- 172.21.15.98:0/3481913170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8e40ccf00 0x7fa8e415b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:06.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.425+0000 7fa8ea49b640 1 -- 172.21.15.98:0/3481913170 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8e415c370 con 0x7fa8e415f5a0 2024-09-17T05:22:06.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.425+0000 7fa8ea49b640 1 --2- 172.21.15.98:0/3481913170 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8e415f5a0 0x7fa8e415bbf0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc00c7a0 tx=0x7fa8dc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:06.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.425+0000 7fa8da7fc640 1 -- 172.21.15.98:0/3481913170 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8dc003b70 con 0x7fa8e415f5a0 2024-09-17T05:22:06.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.425+0000 7fa8da7fc640 1 -- 172.21.15.98:0/3481913170 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa8dc003d30 con 0x7fa8e415f5a0 2024-09-17T05:22:06.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.425+0000 7fa8ebefe640 1 -- 172.21.15.98:0/3481913170 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8e41f2b00 con 0x7fa8e415f5a0 2024-09-17T05:22:06.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.425+0000 7fa8da7fc640 1 -- 172.21.15.98:0/3481913170 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8dc00aab0 con 0x7fa8e415f5a0 2024-09-17T05:22:06.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.425+0000 7fa8ebefe640 1 -- 172.21.15.98:0/3481913170 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8e41f33a0 con 0x7fa8e415f5a0 2024-09-17T05:22:06.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.426+0000 7fa8ebefe640 1 -- 172.21.15.98:0/3481913170 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8e41f2ef0 con 0x7fa8e415f5a0 2024-09-17T05:22:06.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.427+0000 7fa8da7fc640 1 -- 172.21.15.98:0/3481913170 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa8dc00ac50 con 0x7fa8e415f5a0 2024-09-17T05:22:06.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.427+0000 7fa8da7fc640 1 --2- 172.21.15.98:0/3481913170 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fa8c8078b90 0x7fa8c807b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:06.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.427+0000 7fa8da7fc640 1 -- 172.21.15.98:0/3481913170 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa8dc09aa00 con 0x7fa8e415f5a0 2024-09-17T05:22:06.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.427+0000 7fa8e9c9a640 1 --2- 172.21.15.98:0/3481913170 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fa8c8078b90 0x7fa8c807b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:06.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.428+0000 7fa8e9c9a640 1 --2- 172.21.15.98:0/3481913170 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fa8c8078b90 0x7fa8c807b050 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa8e0009b30 tx=0x7fa8e0005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:06.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.431+0000 7fa8da7fc640 1 -- 172.21.15.98:0/3481913170 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fa8dc062880 con 0x7fa8e415f5a0 2024-09-17T05:22:06.611 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.610+0000 7fa8ebefe640 1 -- 172.21.15.98:0/3481913170 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa8e406f990 con 0x7fa8e415f5a0 2024-09-17T05:22:06.612 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.611+0000 7fa8da7fc640 1 -- 172.21.15.98:0/3481913170 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16653 (secure 0 0 0) 0x7fa8dc0672b0 con 0x7fa8e415f5a0 2024-09-17T05:22:06.612 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:22:06.612 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":21,"fsid":"fcbf5a43-b3d8-497c-b15d-3cc022477cf0","created":"2024-09-17T05:21:29.852143+0000","modified":"2024-09-17T05:21:55.491401+0000","last_up_change":"2024-09-17T05:21:42.925756+0000","last_in_change":"2024-09-17T05:21:32.893880+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:21:42.263011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:21:51.665719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T05:21:52.780673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ad711a-df74-438b-b0dc-1499d685c958","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6825","nonce":3644101529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6827","nonce":3644101529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6831","nonce":3644101529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6829","nonce":3644101529}]},"public_addr":"172.21.15.98:6825/3644101529","cluster_addr":"172.21.15.98:6827/3644101529","heartbeat_back_addr":"172.21.15.98:6831/3644101529","heartbeat_front_addr":"172.21.15.98:6829/3644101529","state":["exists","up"]},{"osd":1,"uuid":"f0ccb08d-4d8d-47b8-9320-8c372a6605b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6817","nonce":3902180920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6819","nonce":3902180920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6823","nonce":3902180920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6821","nonce":3902180920}]},"public_addr":"172.21.15.98:6817/3902180920","cluster_addr":"172.21.15.98:6819/3902180920","heartbeat_back_addr":"172.21.15.98:6823/3902180920","heartbeat_front_addr":"172.21.15.98:6821/3902180920","state":["exists","up"]},{"osd":2,"uuid":"a0985398-5e5f-494f-8abf-f785f19e94ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6801","nonce":1518887101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6803","nonce":1518887101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6807","nonce":1518887101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6805","nonce":1518887101}]},"public_addr":"172.21.15.98:6801/1518887101","cluster_addr":"172.21.15.98:6803/1518887101","heartbeat_back_addr":"172.21.15.98:6807/1518887101","heartbeat_front_addr":"172.21.15.98:6805/1518887101","state":["exists","up"]},{"osd":3,"uuid":"e960be2e-0c3a-426e-9507-d3be5895f9e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6809","nonce":4125246091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6811","nonce":4125246091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6815","nonce":4125246091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6813","nonce":4125246091}]},"public_addr":"172.21.15.98:6809/4125246091","cluster_addr":"172.21.15.98:6811/4125246091","heartbeat_back_addr":"172.21.15.98:6815/4125246091","heartbeat_front_addr":"172.21.15.98:6813/4125246091","state":["exists","up"]},{"osd":4,"uuid":"49118c00-3dc1-43ef-8ed4-aca61e56a507","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6811","nonce":765789888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6813","nonce":765789888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6817","nonce":765789888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6815","nonce":765789888}]},"public_addr":"172.21.15.167:6811/765789888","cluster_addr":"172.21.15.167:6813/765789888","heartbeat_back_addr":"172.21.15.167:6817/765789888","heartbeat_front_addr":"172.21.15.167:6815/765789888","state":["exists","up"]},{"osd":5,"uuid":"9f4e0143-2b3d-40e4-bfb5-043d9a9f4ba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6803","nonce":2567019914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6805","nonce":2567019914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6809","nonce":2567019914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6807","nonce":2567019914}]},"public_addr":"172.21.15.167:6803/2567019914","cluster_addr":"172.21.15.167:6805/2567019914","heartbeat_back_addr":"172.21.15.167:6809/2567019914","heartbeat_front_addr":"172.21.15.167:6807/2567019914","state":["exists","up"]},{"osd":6,"uuid":"28720514-e627-4dea-8f4d-bd311ec31361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6819","nonce":96262631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6821","nonce":96262631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6825","nonce":96262631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6823","nonce":96262631}]},"public_addr":"172.21.15.167:6819/96262631","cluster_addr":"172.21.15.167:6821/96262631","heartbeat_back_addr":"172.21.15.167:6825/96262631","heartbeat_front_addr":"172.21.15.167:6823/96262631","state":["exists","up"]},{"osd":7,"uuid":"01edaf9c-3898-406e-85b0-774cfda60adf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6827","nonce":4169560909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6829","nonce":4169560909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6833","nonce":4169560909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6831","nonce":4169560909}]},"public_addr":"172.21.15.167:6827/4169560909","cluster_addr":"172.21.15.167:6829/4169560909","heartbeat_back_addr":"172.21.15.167:6833/4169560909","heartbeat_front_addr":"172.21.15.167:6831/4169560909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:40.054920+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.177110+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.749278+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.400155+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.503576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.196417+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.371063+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.212852+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:22:06.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.613+0000 7fa8ebefe640 1 -- 172.21.15.98:0/3481913170 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fa8c8078b90 msgr2=0x7fa8c807b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:06.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.613+0000 7fa8ebefe640 1 --2- 172.21.15.98:0/3481913170 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fa8c8078b90 0x7fa8c807b050 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa8e0009b30 tx=0x7fa8e0005f90 comp rx=0 tx=0).stop 2024-09-17T05:22:06.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.613+0000 7fa8ebefe640 1 -- 172.21.15.98:0/3481913170 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8e415f5a0 msgr2=0x7fa8e415bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:06.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.613+0000 7fa8ebefe640 1 --2- 172.21.15.98:0/3481913170 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8e415f5a0 0x7fa8e415bbf0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc00c7a0 tx=0x7fa8dc00cc60 comp rx=0 tx=0).stop 2024-09-17T05:22:06.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.613+0000 7fa8ebefe640 1 -- 172.21.15.98:0/3481913170 shutdown_connections 2024-09-17T05:22:06.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.613+0000 7fa8ebefe640 1 --2- 172.21.15.98:0/3481913170 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fa8c8078b90 0x7fa8c807b050 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:06.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.613+0000 7fa8ebefe640 1 --2- 172.21.15.98:0/3481913170 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8e415f5a0 0x7fa8e415bbf0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:06.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.613+0000 7fa8ebefe640 1 --2- 172.21.15.98:0/3481913170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8e40ccf00 0x7fa8e415b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:06.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.613+0000 7fa8ebefe640 1 --2- 172.21.15.98:0/3481913170 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8e40ad270 0x7fa8e40c67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:06.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.613+0000 7fa8ebefe640 1 -- 172.21.15.98:0/3481913170 >> 172.21.15.98:0/3481913170 conn(0x7fa8e40b1950 msgr2=0x7fa8e409bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:06.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.613+0000 7fa8ebefe640 1 -- 172.21.15.98:0/3481913170 shutdown_connections 2024-09-17T05:22:06.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.613+0000 7fa8ebefe640 1 -- 172.21.15.98:0/3481913170 wait complete. 2024-09-17T05:22:06.625 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:22:06.726 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.725+0000 7f0df7cb0640 1 -- 172.21.15.98:0/3409573676 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ddc003a00 msgr2=0x7f0ddc003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:06.726 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.725+0000 7f0df7cb0640 1 --2- 172.21.15.98:0/3409573676 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ddc003a00 0x7f0ddc003e20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0dec00c260 tx=0x7f0ddc005830 comp rx=0 tx=0).stop 2024-09-17T05:22:06.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.725+0000 7f0df624d640 1 -- 172.21.15.98:0/3409573676 reap_dead start 2024-09-17T05:22:06.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.725+0000 7f0df7cb0640 1 -- 172.21.15.98:0/3409573676 shutdown_connections 2024-09-17T05:22:06.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.725+0000 7f0df7cb0640 1 -- 172.21.15.98:0/3409573676 >> 172.21.15.98:0/3409573676 conn(0x7f0df00b1950 msgr2=0x7f0df00b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:06.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.725+0000 7f0df7cb0640 1 -- 172.21.15.98:0/3409573676 shutdown_connections 2024-09-17T05:22:06.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.725+0000 7f0df7cb0640 1 -- 172.21.15.98:0/3409573676 wait complete. 2024-09-17T05:22:06.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.726+0000 7f0df7cb0640 1 Processor -- start 2024-09-17T05:22:06.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.727+0000 7f0df7cb0640 1 -- start start 2024-09-17T05:22:06.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.727+0000 7f0df7cb0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ddc003a00 0x7f0df01408c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:06.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.727+0000 7f0df7cb0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0df0140370 0x7f0df0138580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:06.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.727+0000 7f0df7cb0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0df015f0d0 0x7f0df00cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:06.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.727+0000 7f0df7cb0640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0df00729a0 con 0x7f0ddc003a00 2024-09-17T05:22:06.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.727+0000 7f0df7cb0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0df00b4eb0 con 0x7f0df015f0d0 2024-09-17T05:22:06.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.727+0000 7f0df7cb0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f0df0072b20 con 0x7f0df0140370 2024-09-17T05:22:06.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.727+0000 7f0df5a4c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ddc003a00 0x7f0df01408c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:06.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.727+0000 7f0df5a4c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ddc003a00 0x7f0df01408c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39746/0 (socket says 172.21.15.98:39746) 2024-09-17T05:22:06.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.727+0000 7f0df5a4c640 1 -- 172.21.15.98:0/1529967369 learned_addr learned my addr 172.21.15.98:0/1529967369 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:06.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.727+0000 7f0df524b640 1 --2- 172.21.15.98:0/1529967369 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0df0140370 0x7f0df0138580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:06.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.727+0000 7f0df624d640 1 --2- 172.21.15.98:0/1529967369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0df015f0d0 0x7f0df00cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:06.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.728+0000 7f0df5a4c640 1 -- 172.21.15.98:0/1529967369 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0df0140370 msgr2=0x7f0df0138580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:06.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.728+0000 7f0df5a4c640 1 --2- 172.21.15.98:0/1529967369 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0df0140370 0x7f0df0138580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:06.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.728+0000 7f0df5a4c640 1 -- 172.21.15.98:0/1529967369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0df015f0d0 msgr2=0x7f0df00cdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:06.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.728+0000 7f0df5a4c640 1 --2- 172.21.15.98:0/1529967369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0df015f0d0 0x7f0df00cdae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:06.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.728+0000 7f0df5a4c640 1 -- 172.21.15.98:0/1529967369 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0df015e070 con 0x7f0ddc003a00 2024-09-17T05:22:06.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.728+0000 7f0df5a4c640 1 --2- 172.21.15.98:0/1529967369 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ddc003a00 0x7f0df01408c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0dec00c290 tx=0x7f0dec0064c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:06.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.728+0000 7f0de67fc640 1 -- 172.21.15.98:0/1529967369 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dec003a00 con 0x7f0ddc003a00 2024-09-17T05:22:06.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.728+0000 7f0de67fc640 1 -- 172.21.15.98:0/1529967369 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0dec003c90 con 0x7f0ddc003a00 2024-09-17T05:22:06.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.728+0000 7f0de67fc640 1 -- 172.21.15.98:0/1529967369 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dec038690 con 0x7f0ddc003a00 2024-09-17T05:22:06.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.728+0000 7f0df7cb0640 1 -- 172.21.15.98:0/1529967369 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0df015e310 con 0x7f0ddc003a00 2024-09-17T05:22:06.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.728+0000 7f0df7cb0640 1 -- 172.21.15.98:0/1529967369 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0df015e8d0 con 0x7f0ddc003a00 2024-09-17T05:22:06.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.729+0000 7f0df7cb0640 1 -- 172.21.15.98:0/1529967369 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0df0072ea0 con 0x7f0ddc003a00 2024-09-17T05:22:06.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.730+0000 7f0de67fc640 1 -- 172.21.15.98:0/1529967369 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0dec035020 con 0x7f0ddc003a00 2024-09-17T05:22:06.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.730+0000 7f0de67fc640 1 --2- 172.21.15.98:0/1529967369 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f0dd4078b90 0x7f0dd407b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:06.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.730+0000 7f0de67fc640 1 -- 172.21.15.98:0/1529967369 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0dec0badb0 con 0x7f0ddc003a00 2024-09-17T05:22:06.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.730+0000 7f0df524b640 1 --2- 172.21.15.98:0/1529967369 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f0dd4078b90 0x7f0dd407b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:06.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.731+0000 7f0df524b640 1 --2- 172.21.15.98:0/1529967369 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f0dd4078b90 0x7f0dd407b050 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0df009d180 tx=0x7f0de000d410 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:06.735 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.734+0000 7f0de67fc640 1 -- 172.21.15.98:0/1529967369 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f0dec047030 con 0x7f0ddc003a00 2024-09-17T05:22:06.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.944+0000 7f0df7cb0640 1 -- 172.21.15.98:0/1529967369 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0df0070a20 con 0x7f0ddc003a00 2024-09-17T05:22:06.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.944+0000 7f0de67fc640 1 -- 172.21.15.98:0/1529967369 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5217 (secure 0 0 0) 0x7f0dec03e070 con 0x7f0ddc003a00 2024-09-17T05:22:06.945 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:22:06.946 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":7,"btime":"2024-09-17T05:21:56:643998+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4368,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/237112225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":237112225},{"type":"v1","addr":"172.21.15.98:6833","nonce":237112225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4377,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/4042308128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":4042308128},{"type":"v1","addr":"172.21.15.98:6835","nonce":4042308128}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4378,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/313781530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":313781530},{"type":"v1","addr":"172.21.15.167:6836","nonce":313781530}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:21:53.826247+0000","modified":"2024-09-17T05:21:55.988646+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4386},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4386":{"gid":4386,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6837/4171766128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":4171766128},{"type":"v1","addr":"172.21.15.167:6837","nonce":4171766128}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4386,"qdb_cluster":[4386]},"id":1}]} 2024-09-17T05:22:06.946 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 7 2024-09-17T05:22:06.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.946+0000 7f0df7cb0640 1 -- 172.21.15.98:0/1529967369 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f0dd4078b90 msgr2=0x7f0dd407b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:06.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.946+0000 7f0df7cb0640 1 --2- 172.21.15.98:0/1529967369 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f0dd4078b90 0x7f0dd407b050 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0df009d180 tx=0x7f0de000d410 comp rx=0 tx=0).stop 2024-09-17T05:22:06.948 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.946+0000 7f0df7cb0640 1 -- 172.21.15.98:0/1529967369 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ddc003a00 msgr2=0x7f0df01408c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:06.948 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.946+0000 7f0df7cb0640 1 --2- 172.21.15.98:0/1529967369 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ddc003a00 0x7f0df01408c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0dec00c290 tx=0x7f0dec0064c0 comp rx=0 tx=0).stop 2024-09-17T05:22:06.948 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.946+0000 7f0df7cb0640 1 -- 172.21.15.98:0/1529967369 shutdown_connections 2024-09-17T05:22:06.948 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.946+0000 7f0df7cb0640 1 --2- 172.21.15.98:0/1529967369 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f0dd4078b90 0x7f0dd407b050 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:06.948 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.946+0000 7f0df7cb0640 1 --2- 172.21.15.98:0/1529967369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0df015f0d0 0x7f0df00cdae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:06.948 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.946+0000 7f0df7cb0640 1 --2- 172.21.15.98:0/1529967369 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0df0140370 0x7f0df0138580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:06.948 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.946+0000 7f0df7cb0640 1 --2- 172.21.15.98:0/1529967369 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ddc003a00 0x7f0df01408c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:06.948 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.946+0000 7f0df7cb0640 1 -- 172.21.15.98:0/1529967369 >> 172.21.15.98:0/1529967369 conn(0x7f0df00b1950 msgr2=0x7f0df00af8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:06.948 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.946+0000 7f0df7cb0640 1 -- 172.21.15.98:0/1529967369 shutdown_connections 2024-09-17T05:22:06.948 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:06.946+0000 7f0df7cb0640 1 -- 172.21.15.98:0/1529967369 wait complete. 2024-09-17T05:22:07.360 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:21:53.826247+0000', 'modified': '2024-09-17T05:21:55.988646+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4386}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4386': {'gid': 4386, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.167:6837/4171766128', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6835', 'nonce': 4171766128}, {'type': 'v1', 'addr': '172.21.15.167:6837', 'nonce': 4171766128}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4386, 'qdb_cluster': [4386]} 2024-09-17T05:22:07.361 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T05:22:07.361 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-17T05:22:07.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.464+0000 7fe60b040640 1 -- 172.21.15.98:0/1605914733 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5f4004d40 msgr2=0x7fe5f40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:07.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.464+0000 7fe60b040640 1 --2- 172.21.15.98:0/1605914733 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5f4004d40 0x7fe5f40051c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe6040d1a40 tx=0x7fe5f4005830 comp rx=0 tx=0).stop 2024-09-17T05:22:07.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.464+0000 7fe6095dd640 1 -- 172.21.15.98:0/1605914733 reap_dead start 2024-09-17T05:22:07.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.464+0000 7fe60b040640 1 -- 172.21.15.98:0/1605914733 shutdown_connections 2024-09-17T05:22:07.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.464+0000 7fe60b040640 1 -- 172.21.15.98:0/1605914733 >> 172.21.15.98:0/1605914733 conn(0x7fe6040d3fe0 msgr2=0x7fe6040d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:07.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.464+0000 7fe60b040640 1 -- 172.21.15.98:0/1605914733 shutdown_connections 2024-09-17T05:22:07.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.464+0000 7fe60b040640 1 -- 172.21.15.98:0/1605914733 wait complete. 2024-09-17T05:22:07.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.465+0000 7fe60b040640 1 Processor -- start 2024-09-17T05:22:07.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.465+0000 7fe60b040640 1 -- start start 2024-09-17T05:22:07.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.466+0000 7fe60b040640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe5f4004d40 0x7fe6040ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:07.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.466+0000 7fe60b040640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe6040b7680 0x7fe6040cbf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:07.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.466+0000 7fe60b040640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe60415d0c0 0x7fe6040b5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:07.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.466+0000 7fe60b040640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe6040d1460 con 0x7fe6040b7680 2024-09-17T05:22:07.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.466+0000 7fe60b040640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe6040d12e0 con 0x7fe60415d0c0 2024-09-17T05:22:07.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.466+0000 7fe60b040640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fe6040cf200 con 0x7fe5f4004d40 2024-09-17T05:22:07.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.466+0000 7fe603fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe6040b7680 0x7fe6040cbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:07.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.466+0000 7fe603fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe6040b7680 0x7fe6040cbf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39766/0 (socket says 172.21.15.98:39766) 2024-09-17T05:22:07.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.466+0000 7fe603fff640 1 -- 172.21.15.98:0/3056613492 learned_addr learned my addr 172.21.15.98:0/3056613492 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:07.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.466+0000 7fe608ddc640 1 --2- 172.21.15.98:0/3056613492 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe5f4004d40 0x7fe6040ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:07.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.466+0000 7fe6095dd640 1 --2- 172.21.15.98:0/3056613492 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe60415d0c0 0x7fe6040b5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:07.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.466+0000 7fe603fff640 1 -- 172.21.15.98:0/3056613492 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe5f4004d40 msgr2=0x7fe6040ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:07.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.466+0000 7fe603fff640 1 --2- 172.21.15.98:0/3056613492 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe5f4004d40 0x7fe6040ccb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:07.470 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.466+0000 7fe603fff640 1 -- 172.21.15.98:0/3056613492 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe60415d0c0 msgr2=0x7fe6040b5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:07.470 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.466+0000 7fe603fff640 1 --2- 172.21.15.98:0/3056613492 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe60415d0c0 0x7fe6040b5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:07.470 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.466+0000 7fe603fff640 1 -- 172.21.15.98:0/3056613492 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6040cb350 con 0x7fe6040b7680 2024-09-17T05:22:07.470 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.466+0000 7fe608ddc640 1 --2- 172.21.15.98:0/3056613492 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe5f4004d40 0x7fe6040ccb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:22:07.470 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.466+0000 7fe6095dd640 1 --2- 172.21.15.98:0/3056613492 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe60415d0c0 0x7fe6040b5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:22:07.470 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.466+0000 7fe603fff640 1 --2- 172.21.15.98:0/3056613492 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe6040b7680 0x7fe6040cbf90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0010a70 tx=0x7fe5f0010f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:07.470 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.466+0000 7fe6017fa640 1 -- 172.21.15.98:0/3056613492 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f0004220 con 0x7fe6040b7680 2024-09-17T05:22:07.470 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.467+0000 7fe6017fa640 1 -- 172.21.15.98:0/3056613492 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe5f00043c0 con 0x7fe6040b7680 2024-09-17T05:22:07.470 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.467+0000 7fe60b040640 1 -- 172.21.15.98:0/3056613492 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6041f3be0 con 0x7fe6040b7680 2024-09-17T05:22:07.470 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.467+0000 7fe6017fa640 1 -- 172.21.15.98:0/3056613492 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f000ebf0 con 0x7fe6040b7680 2024-09-17T05:22:07.470 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.467+0000 7fe60b040640 1 -- 172.21.15.98:0/3056613492 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6041f41a0 con 0x7fe6040b7680 2024-09-17T05:22:07.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.468+0000 7fe6017fa640 1 -- 172.21.15.98:0/3056613492 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe5f0005020 con 0x7fe6040b7680 2024-09-17T05:22:07.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.469+0000 7fe6017fa640 1 --2- 172.21.15.98:0/3056613492 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fe5e8078b90 0x7fe5e807b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:07.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.469+0000 7fe6017fa640 1 -- 172.21.15.98:0/3056613492 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe5f009b3f0 con 0x7fe6040b7680 2024-09-17T05:22:07.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.469+0000 7fe608ddc640 1 --2- 172.21.15.98:0/3056613492 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fe5e8078b90 0x7fe5e807b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:07.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.469+0000 7fe608ddc640 1 --2- 172.21.15.98:0/3056613492 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fe5e8078b90 0x7fe5e807b050 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8001860 tx=0x7fe5f8001cd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:07.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.469+0000 7fe60de13740 1 Processor -- start 2024-09-17T05:22:07.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.469+0000 7fe60de13740 1 -- start start 2024-09-17T05:22:07.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.470+0000 7fe60de13740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560a369f31b0 0x560a369cab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:07.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.470+0000 7fe60de13740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560a36a12df0 0x560a36a131f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:07.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.470+0000 7fe60de13740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a369c85f0 0x560a369c8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:07.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.470+0000 7fe60de13740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x560a3693f820 con 0x560a369c85f0 2024-09-17T05:22:07.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.470+0000 7fe60de13740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x560a3692ec50 con 0x560a369f31b0 2024-09-17T05:22:07.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.470+0000 7fe60de13740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x560a36932a60 con 0x560a36a12df0 2024-09-17T05:22:07.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.470+0000 7fe6095dd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a369c85f0 0x560a369c8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:07.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.470+0000 7fe6095dd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a369c85f0 0x560a369c8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39780/0 (socket says 172.21.15.98:39780) 2024-09-17T05:22:07.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.470+0000 7fe6095dd640 1 -- 172.21.15.98:0/3136117568 learned_addr learned my addr 172.21.15.98:0/3136117568 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:07.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.470+0000 7fe603fff640 1 --2- 172.21.15.98:0/3136117568 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560a36a12df0 0x560a36a131f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:07.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.470+0000 7fe608ddc640 1 --2- 172.21.15.98:0/3136117568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560a369f31b0 0x560a369cab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:07.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.471+0000 7fe6095dd640 1 -- 172.21.15.98:0/3136117568 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560a36a12df0 msgr2=0x560a36a131f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:22:07.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.471+0000 7fe6095dd640 1 --2- 172.21.15.98:0/3136117568 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560a36a12df0 0x560a36a131f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:07.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.471+0000 7fe6095dd640 1 -- 172.21.15.98:0/3136117568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560a369f31b0 msgr2=0x560a369cab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:22:07.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.471+0000 7fe6095dd640 1 --2- 172.21.15.98:0/3136117568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560a369f31b0 0x560a369cab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:07.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.471+0000 7fe6095dd640 1 -- 172.21.15.98:0/3136117568 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a36690850 con 0x560a369c85f0 2024-09-17T05:22:07.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.471+0000 7fe6095dd640 1 --2- 172.21.15.98:0/3136117568 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a369c85f0 0x560a369c8a40 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc009ee0 tx=0x7fe5fc004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7e3b755cea71cbd server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:07.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.471+0000 7fe5ee7fc640 1 -- 172.21.15.98:0/3136117568 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc049030 con 0x560a369c85f0 2024-09-17T05:22:07.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.471+0000 7fe5ee7fc640 1 -- 172.21.15.98:0/3136117568 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe5fc004b20 con 0x560a369c85f0 2024-09-17T05:22:07.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.471+0000 7fe5ee7fc640 1 -- 172.21.15.98:0/3136117568 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc0444d0 con 0x560a369c85f0 2024-09-17T05:22:07.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.471+0000 7fe60de13740 1 -- 172.21.15.98:0/3136117568 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a369c85f0 msgr2=0x560a369c8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:07.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.471+0000 7fe60de13740 1 --2- 172.21.15.98:0/3136117568 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a369c85f0 0x560a369c8a40 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc009ee0 tx=0x7fe5fc004ab0 comp rx=0 tx=0).stop 2024-09-17T05:22:07.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.471+0000 7fe60de13740 1 -- 172.21.15.98:0/3136117568 shutdown_connections 2024-09-17T05:22:07.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.471+0000 7fe60de13740 1 --2- 172.21.15.98:0/3136117568 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a369c85f0 0x560a369c8a40 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:07.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.471+0000 7fe60de13740 1 --2- 172.21.15.98:0/3136117568 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560a36a12df0 0x560a36a131f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:07.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.471+0000 7fe60de13740 1 --2- 172.21.15.98:0/3136117568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560a369f31b0 0x560a369cab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:07.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.472+0000 7fe60de13740 1 -- 172.21.15.98:0/3136117568 >> 172.21.15.98:0/3136117568 conn(0x560a369c96a0 msgr2=0x560a369cd0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:07.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.472+0000 7fe60de13740 1 -- 172.21.15.98:0/3136117568 shutdown_connections 2024-09-17T05:22:07.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.472+0000 7fe60de13740 1 -- 172.21.15.98:0/3136117568 wait complete. 2024-09-17T05:22:07.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.472+0000 7fe60de13740 1 -- start start 2024-09-17T05:22:07.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.472+0000 7fe60de13740 1 Processor -- start 2024-09-17T05:22:07.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.473+0000 7fe60de13740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a369f31b0 0x560a36a09c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:07.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.473+0000 7fe60de13740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560a36a12df0 0x560a36a0c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:07.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.473+0000 7fe60de13740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560a369eafc0 0x560a36a0c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:07.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.473+0000 7fe60de13740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x560a3669f620 con 0x560a369f31b0 2024-09-17T05:22:07.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.473+0000 7fe60de13740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x560a368d45f0 con 0x560a36a12df0 2024-09-17T05:22:07.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.473+0000 7fe60de13740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x560a369c7850 con 0x560a369eafc0 2024-09-17T05:22:07.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.473+0000 7fe60de13740 10 client.0 _ll_register_callbacks cb 0x560a368d80a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:22:07.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.473+0000 7fe608ddc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a369f31b0 0x560a36a09c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:07.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.473+0000 7fe608ddc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a369f31b0 0x560a36a09c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39796/0 (socket says 172.21.15.98:39796) 2024-09-17T05:22:07.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.473+0000 7fe608ddc640 1 -- 172.21.15.98:0/2883813187 learned_addr learned my addr 172.21.15.98:0/2883813187 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:07.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.473+0000 7fe603fff640 1 --2- 172.21.15.98:0/2883813187 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560a36a12df0 0x560a36a0c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:07.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.473+0000 7fe6095dd640 1 --2- 172.21.15.98:0/2883813187 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560a369eafc0 0x560a36a0c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:07.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.473+0000 7fe608ddc640 1 -- 172.21.15.98:0/2883813187 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560a369eafc0 msgr2=0x560a36a0c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:22:07.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.473+0000 7fe608ddc640 1 --2- 172.21.15.98:0/2883813187 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560a369eafc0 0x560a36a0c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:07.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.473+0000 7fe608ddc640 1 -- 172.21.15.98:0/2883813187 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560a36a12df0 msgr2=0x560a36a0c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:22:07.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.473+0000 7fe608ddc640 1 --2- 172.21.15.98:0/2883813187 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560a36a12df0 0x560a36a0c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:07.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.473+0000 7fe608ddc640 1 -- 172.21.15.98:0/2883813187 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a367076b0 con 0x560a369f31b0 2024-09-17T05:22:07.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.474+0000 7fe608ddc640 1 --2- 172.21.15.98:0/2883813187 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a369f31b0 0x560a36a09c40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8012570 tx=0x7fe6040d2f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b390358c3319257e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:07.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.474+0000 7fe5e37fe640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-17T05:22:07.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.474+0000 7fe5e37fe640 1 -- 172.21.15.98:0/2883813187 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f80115e0 con 0x560a369f31b0 2024-09-17T05:22:07.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.474+0000 7fe5e37fe640 1 -- 172.21.15.98:0/2883813187 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe5f8011780 con 0x560a369f31b0 2024-09-17T05:22:07.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.474+0000 7fe60de13740 1 -- 172.21.15.98:0/2883813187 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5fc004b20 con 0x560a369f31b0 2024-09-17T05:22:07.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.474+0000 7fe5e37fe640 1 -- 172.21.15.98:0/2883813187 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7fe5f802d050 con 0x560a369f31b0 2024-09-17T05:22:07.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.474+0000 7fe60de13740 10 client.4680 fetch_fsmap learned FSMap version 7 2024-09-17T05:22:07.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.474+0000 7fe60de13740 1 -- 172.21.15.98:0/2883813187 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x560a36a09780 con 0x560a369f31b0 2024-09-17T05:22:07.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.474+0000 7fe5e37fe640 1 -- 172.21.15.98:0/2883813187 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe5fc004b20 con 0x560a369f31b0 2024-09-17T05:22:07.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.474+0000 7fe5e37fe640 1 -- 172.21.15.98:0/2883813187 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 7) ==== 3502+0+0 (secure 0 0 0) 0x7fe5f8030020 con 0x560a369f31b0 2024-09-17T05:22:07.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.474+0000 7fe60de13740 10 client.4680 fetch_fsmap finished waiting for FSMap version 7 2024-09-17T05:22:07.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.474+0000 7fe60de13740 10 client.4680 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-17T05:22:07.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.474+0000 7fe60de13740 20 client.4680 populate_metadata read hostname 'smithi098' 2024-09-17T05:22:07.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.474+0000 7fe60de13740 1 --2- 172.21.15.98:0/2883813187 >> [v2:172.21.15.167:6835/4171766128,v1:172.21.15.167:6837/4171766128] conn(0x560a36a24f80 0x560a36a0ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:07.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.474+0000 7fe60de13740 4 client.4680 mds_command: new command op to 4386 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:22:07.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.474+0000 7fe60de13740 1 -- 172.21.15.98:0/2883813187 --> [v2:172.21.15.167:6835/4171766128,v1:172.21.15.167:6837/4171766128] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560a36941770 con 0x560a36a24f80 2024-09-17T05:22:07.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.474+0000 7fe603fff640 1 --2- 172.21.15.98:0/2883813187 >> [v2:172.21.15.167:6835/4171766128,v1:172.21.15.167:6837/4171766128] conn(0x560a36a24f80 0x560a36a0ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:07.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.475+0000 7fe603fff640 1 --2- 172.21.15.98:0/2883813187 >> [v2:172.21.15.167:6835/4171766128,v1:172.21.15.167:6837/4171766128] conn(0x560a36a24f80 0x560a36a0ab70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74f7e3f2294e7a2d server_cookie=9ae13ff308d83fa7 in_seq=0 out_seq=0 2024-09-17T05:22:07.485 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.475+0000 7fe5e37fe640 10 client.4680 ms_handle_connect on v2:172.21.15.167:6835/4171766128 2024-09-17T05:22:07.485 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.476+0000 7fe5e37fe640 1 -- 172.21.15.98:0/2883813187 <== mds.0 v2:172.21.15.167:6835/4171766128 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560a36941770 con 0x560a36a24f80 2024-09-17T05:22:07.485 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.476+0000 7fe5e37fe640 10 client.4680 handle_command_reply: tid=0 2024-09-17T05:22:07.485 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.476+0000 7fe60de13740 1 client.4680 shutdown 2024-09-17T05:22:07.485 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.476+0000 7fe60de13740 1 -- 172.21.15.98:0/2883813187 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a369f31b0 msgr2=0x560a36a09c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:07.485 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.476+0000 7fe60de13740 1 --2- 172.21.15.98:0/2883813187 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a369f31b0 0x560a36a09c40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8012570 tx=0x7fe6040d2f40 comp rx=0 tx=0).stop 2024-09-17T05:22:07.485 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.476+0000 7fe60de13740 1 -- 172.21.15.98:0/2883813187 shutdown_connections 2024-09-17T05:22:07.485 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.476+0000 7fe60de13740 1 --2- 172.21.15.98:0/2883813187 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560a369eafc0 0x560a36a0c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:07.485 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.476+0000 7fe60de13740 1 --2- 172.21.15.98:0/2883813187 >> [v2:172.21.15.167:6835/4171766128,v1:172.21.15.167:6837/4171766128] conn(0x560a36a24f80 0x560a36a0ab70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:07.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.476+0000 7fe60de13740 1 --2- 172.21.15.98:0/2883813187 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560a36a12df0 0x560a36a0c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:07.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.476+0000 7fe60de13740 1 --2- 172.21.15.98:0/2883813187 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a369f31b0 0x560a36a09c40 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:07.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.476+0000 7fe5e37fe640 0 client.4680 ms_handle_reset on v2:172.21.15.167:6835/4171766128 2024-09-17T05:22:07.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.476+0000 7fe60de13740 1 -- 172.21.15.98:0/2883813187 >> 172.21.15.98:0/2883813187 conn(0x560a369c85f0 msgr2=0x560a36a12680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:07.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.476+0000 7fe60de13740 1 -- 172.21.15.98:0/2883813187 shutdown_connections 2024-09-17T05:22:07.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.476+0000 7fe60de13740 1 -- 172.21.15.98:0/2883813187 wait complete. 2024-09-17T05:22:07.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.476+0000 7fe60de13740 20 client.4680 trim_cache size 0 max 16384 2024-09-17T05:22:07.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.494+0000 7fe60de13740 1 Processor -- start 2024-09-17T05:22:07.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.494+0000 7fe60de13740 1 -- start start 2024-09-17T05:22:07.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.494+0000 7fe60de13740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a369eafc0 0x560a36a35900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:07.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.494+0000 7fe60de13740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560a369f31b0 0x560a36a09c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:07.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.494+0000 7fe60de13740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560a36a12df0 0x560a36a0a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:07.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.495+0000 7fe60de13740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe6041fc330 con 0x560a369eafc0 2024-09-17T05:22:07.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.495+0000 7fe60de13740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe604160f90 con 0x560a369f31b0 2024-09-17T05:22:07.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.495+0000 7fe60de13740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fe6041fbed0 con 0x560a36a12df0 2024-09-17T05:22:07.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.495+0000 7fe608ddc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a369eafc0 0x560a36a35900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:07.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.495+0000 7fe608ddc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a369eafc0 0x560a36a35900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39802/0 (socket says 172.21.15.98:39802) 2024-09-17T05:22:07.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.495+0000 7fe608ddc640 1 -- 172.21.15.98:0/624916281 learned_addr learned my addr 172.21.15.98:0/624916281 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:07.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.495+0000 7fe603fff640 1 --2- 172.21.15.98:0/624916281 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560a369f31b0 0x560a36a09c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:07.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.495+0000 7fe608ddc640 1 -- 172.21.15.98:0/624916281 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560a36a12df0 msgr2=0x560a36a0a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:22:07.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.495+0000 7fe608ddc640 1 --2- 172.21.15.98:0/624916281 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560a36a12df0 0x560a36a0a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:07.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.495+0000 7fe608ddc640 1 -- 172.21.15.98:0/624916281 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560a369f31b0 msgr2=0x560a36a09c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:22:07.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.495+0000 7fe608ddc640 1 --2- 172.21.15.98:0/624916281 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560a369f31b0 0x560a36a09c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:07.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.495+0000 7fe608ddc640 1 -- 172.21.15.98:0/624916281 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a36a35e40 con 0x560a369eafc0 2024-09-17T05:22:07.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.495+0000 7fe608ddc640 1 --2- 172.21.15.98:0/624916281 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a369eafc0 0x560a36a35900 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8011b60 tx=0x7fe5f8001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfb0f48396491c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:07.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.495+0000 7fe5edffb640 1 -- 172.21.15.98:0/624916281 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f80117e0 con 0x560a369eafc0 2024-09-17T05:22:07.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.495+0000 7fe5edffb640 1 -- 172.21.15.98:0/624916281 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe5f8025070 con 0x560a369eafc0 2024-09-17T05:22:07.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.495+0000 7fe5edffb640 1 -- 172.21.15.98:0/624916281 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f8020640 con 0x560a369eafc0 2024-09-17T05:22:07.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.496+0000 7fe60de13740 1 -- 172.21.15.98:0/624916281 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a369eafc0 msgr2=0x560a36a35900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:07.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.496+0000 7fe60de13740 1 --2- 172.21.15.98:0/624916281 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a369eafc0 0x560a36a35900 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8011b60 tx=0x7fe5f8001e70 comp rx=0 tx=0).stop 2024-09-17T05:22:07.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.496+0000 7fe60de13740 1 -- 172.21.15.98:0/624916281 shutdown_connections 2024-09-17T05:22:07.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.496+0000 7fe60de13740 1 --2- 172.21.15.98:0/624916281 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560a36a12df0 0x560a36a0a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:07.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.496+0000 7fe60de13740 1 --2- 172.21.15.98:0/624916281 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560a369f31b0 0x560a36a09c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:07.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.496+0000 7fe60de13740 1 --2- 172.21.15.98:0/624916281 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a369eafc0 0x560a36a35900 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:07.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.496+0000 7fe60de13740 1 -- 172.21.15.98:0/624916281 >> 172.21.15.98:0/624916281 conn(0x560a369c85f0 msgr2=0x560a36a0af90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:07.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.496+0000 7fe60de13740 1 -- 172.21.15.98:0/624916281 shutdown_connections 2024-09-17T05:22:07.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.496+0000 7fe60de13740 1 -- 172.21.15.98:0/624916281 wait complete. 2024-09-17T05:22:07.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.496+0000 7fe60de13740 1 -- start start 2024-09-17T05:22:07.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.496+0000 7fe60de13740 1 Processor -- start 2024-09-17T05:22:07.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.497+0000 7fe60de13740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a369eafc0 0x560a369f3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:07.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.497+0000 7fe60de13740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560a369f31b0 0x560a36a23720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:07.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.497+0000 7fe60de13740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560a36a12df0 0x560a36a09960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:07.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.497+0000 7fe60de13740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x560a36a24e00 con 0x560a369eafc0 2024-09-17T05:22:07.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.497+0000 7fe60de13740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x560a369ea940 con 0x560a36a12df0 2024-09-17T05:22:07.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.497+0000 7fe60de13740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x560a36a25450 con 0x560a369f31b0 2024-09-17T05:22:07.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.497+0000 7fe60de13740 10 client.0 _ll_register_callbacks cb 0x7fe5f800fd50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:22:07.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.497+0000 7fe608ddc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a369eafc0 0x560a369f3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:07.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.497+0000 7fe608ddc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a369eafc0 0x560a369f3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39810/0 (socket says 172.21.15.98:39810) 2024-09-17T05:22:07.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.497+0000 7fe608ddc640 1 -- 172.21.15.98:0/2943353736 learned_addr learned my addr 172.21.15.98:0/2943353736 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:07.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.497+0000 7fe6095dd640 1 --2- 172.21.15.98:0/2943353736 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560a36a12df0 0x560a36a09960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:07.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.497+0000 7fe603fff640 1 --2- 172.21.15.98:0/2943353736 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560a369f31b0 0x560a36a23720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:07.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.497+0000 7fe608ddc640 1 -- 172.21.15.98:0/2943353736 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560a369f31b0 msgr2=0x560a36a23720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:22:07.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.497+0000 7fe608ddc640 1 --2- 172.21.15.98:0/2943353736 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560a369f31b0 0x560a36a23720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:07.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.497+0000 7fe608ddc640 1 -- 172.21.15.98:0/2943353736 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560a36a12df0 msgr2=0x560a36a09960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:22:07.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.497+0000 7fe608ddc640 1 --2- 172.21.15.98:0/2943353736 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560a36a12df0 0x560a36a09960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:07.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.498+0000 7fe608ddc640 1 -- 172.21.15.98:0/2943353736 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a369f3ad0 con 0x560a369eafc0 2024-09-17T05:22:07.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.498+0000 7fe603fff640 1 --2- 172.21.15.98:0/2943353736 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560a369f31b0 0x560a36a23720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:22:07.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.498+0000 7fe608ddc640 1 --2- 172.21.15.98:0/2943353736 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a369eafc0 0x560a369f3590 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8001180 tx=0x7fe5f803c6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bb24aeefde2b69e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:07.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.498+0000 7fe5e37fe640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-17T05:22:07.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.498+0000 7fe5e37fe640 1 -- 172.21.15.98:0/2943353736 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f8004440 con 0x560a369eafc0 2024-09-17T05:22:07.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.498+0000 7fe5e37fe640 1 -- 172.21.15.98:0/2943353736 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe5f8021af0 con 0x560a369eafc0 2024-09-17T05:22:07.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.498+0000 7fe60de13740 1 -- 172.21.15.98:0/2943353736 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5f8025070 con 0x560a369eafc0 2024-09-17T05:22:07.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.498+0000 7fe5e37fe640 1 -- 172.21.15.98:0/2943353736 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7fe5f8012d40 con 0x560a369eafc0 2024-09-17T05:22:07.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.498+0000 7fe60de13740 10 client.4686 fetch_fsmap learned FSMap version 7 2024-09-17T05:22:07.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.498+0000 7fe60de13740 1 -- 172.21.15.98:0/2943353736 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x560a369e7530 con 0x560a369eafc0 2024-09-17T05:22:07.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.498+0000 7fe5e37fe640 1 -- 172.21.15.98:0/2943353736 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe5f8025070 con 0x560a369eafc0 2024-09-17T05:22:07.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.498+0000 7fe5e37fe640 1 -- 172.21.15.98:0/2943353736 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 7) ==== 3502+0+0 (secure 0 0 0) 0x7fe5f8030070 con 0x560a369eafc0 2024-09-17T05:22:07.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.498+0000 7fe60de13740 10 client.4686 fetch_fsmap finished waiting for FSMap version 7 2024-09-17T05:22:07.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.498+0000 7fe60de13740 10 client.4686 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-17T05:22:07.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.498+0000 7fe60de13740 20 client.4686 populate_metadata read hostname 'smithi098' 2024-09-17T05:22:07.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.498+0000 7fe60de13740 1 --2- 172.21.15.98:0/2943353736 >> [v2:172.21.15.167:6835/4171766128,v1:172.21.15.167:6837/4171766128] conn(0x560a36a09ea0 0x560a369cab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:07.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.498+0000 7fe60de13740 4 client.4686 mds_command: new command op to 4386 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T05:22:07.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.498+0000 7fe60de13740 1 -- 172.21.15.98:0/2943353736 --> [v2:172.21.15.167:6835/4171766128,v1:172.21.15.167:6837/4171766128] -- command(tid 0: {"prefix": "status"}) -- 0x560a3693d220 con 0x560a36a09ea0 2024-09-17T05:22:07.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.498+0000 7fe603fff640 1 --2- 172.21.15.98:0/2943353736 >> [v2:172.21.15.167:6835/4171766128,v1:172.21.15.167:6837/4171766128] conn(0x560a36a09ea0 0x560a369cab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:07.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.499+0000 7fe603fff640 1 --2- 172.21.15.98:0/2943353736 >> [v2:172.21.15.167:6835/4171766128,v1:172.21.15.167:6837/4171766128] conn(0x560a36a09ea0 0x560a369cab20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef71c38c6df733dc server_cookie=3e25851929f548eb in_seq=0 out_seq=0 2024-09-17T05:22:07.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.499+0000 7fe5e37fe640 10 client.4686 ms_handle_connect on v2:172.21.15.167:6835/4171766128 2024-09-17T05:22:07.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.499+0000 7fe5e37fe640 1 -- 172.21.15.98:0/2943353736 <== mds.0 v2:172.21.15.167:6835/4171766128 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x560a3693d220 con 0x560a36a09ea0 2024-09-17T05:22:07.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.499+0000 7fe5e37fe640 10 client.4686 handle_command_reply: tid=0 2024-09-17T05:22:07.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.499+0000 7fe60de13740 1 client.4686 shutdown 2024-09-17T05:22:07.518 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.499+0000 7fe60de13740 1 -- 172.21.15.98:0/2943353736 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a369eafc0 msgr2=0x560a369f3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:07.518 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.499+0000 7fe60de13740 1 --2- 172.21.15.98:0/2943353736 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a369eafc0 0x560a369f3590 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8001180 tx=0x7fe5f803c6d0 comp rx=0 tx=0).stop 2024-09-17T05:22:07.518 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.499+0000 7fe60de13740 1 -- 172.21.15.98:0/2943353736 shutdown_connections 2024-09-17T05:22:07.518 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.499+0000 7fe60de13740 1 --2- 172.21.15.98:0/2943353736 >> [v2:172.21.15.167:6835/4171766128,v1:172.21.15.167:6837/4171766128] conn(0x560a36a09ea0 0x560a369cab20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:07.518 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.499+0000 7fe60de13740 1 --2- 172.21.15.98:0/2943353736 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560a36a12df0 0x560a36a09960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:07.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.499+0000 7fe60de13740 1 --2- 172.21.15.98:0/2943353736 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560a369f31b0 0x560a36a23720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:07.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.499+0000 7fe5e37fe640 0 client.4686 ms_handle_reset on v2:172.21.15.167:6835/4171766128 2024-09-17T05:22:07.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.499+0000 7fe60de13740 1 --2- 172.21.15.98:0/2943353736 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a369eafc0 0x560a369f3590 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:07.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.499+0000 7fe60de13740 1 -- 172.21.15.98:0/2943353736 >> 172.21.15.98:0/2943353736 conn(0x560a369c85f0 msgr2=0x560a36a0b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:07.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.499+0000 7fe60de13740 1 -- 172.21.15.98:0/2943353736 shutdown_connections 2024-09-17T05:22:07.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.499+0000 7fe60de13740 1 -- 172.21.15.98:0/2943353736 wait complete. 2024-09-17T05:22:07.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.499+0000 7fe60de13740 20 client.4686 trim_cache size 0 max 16384 2024-09-17T05:22:07.520 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T05:22:07.520 INFO:teuthology.orchestra.run.smithi098.stdout: "cluster_fsid": "fcbf5a43-b3d8-497c-b15d-3cc022477cf0", 2024-09-17T05:22:07.521 INFO:teuthology.orchestra.run.smithi098.stdout: "whoami": 0, 2024-09-17T05:22:07.521 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 4386, 2024-09-17T05:22:07.521 INFO:teuthology.orchestra.run.smithi098.stdout: "want_state": "up:active", 2024-09-17T05:22:07.521 INFO:teuthology.orchestra.run.smithi098.stdout: "state": "up:active", 2024-09-17T05:22:07.521 INFO:teuthology.orchestra.run.smithi098.stdout: "fs_name": "cephfs", 2024-09-17T05:22:07.521 INFO:teuthology.orchestra.run.smithi098.stdout: "rank_uptime": 13.007833639999999, 2024-09-17T05:22:07.521 INFO:teuthology.orchestra.run.smithi098.stdout: "mdsmap_epoch": 7, 2024-09-17T05:22:07.522 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_epoch": 21, 2024-09-17T05:22:07.522 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_epoch_barrier": 21, 2024-09-17T05:22:07.522 INFO:teuthology.orchestra.run.smithi098.stdout: "uptime": 19.034814312000002 2024-09-17T05:22:07.522 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T05:22:07.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.500+0000 7fe60b040640 1 -- 172.21.15.98:0/3056613492 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fe5e8078b90 msgr2=0x7fe5e807b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:07.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.500+0000 7fe60b040640 1 --2- 172.21.15.98:0/3056613492 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fe5e8078b90 0x7fe5e807b050 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8001860 tx=0x7fe5f8001cd0 comp rx=0 tx=0).stop 2024-09-17T05:22:07.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.500+0000 7fe60b040640 1 -- 172.21.15.98:0/3056613492 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe6040b7680 msgr2=0x7fe6040cbf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:07.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.500+0000 7fe60b040640 1 --2- 172.21.15.98:0/3056613492 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe6040b7680 0x7fe6040cbf90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0010a70 tx=0x7fe5f0010f30 comp rx=0 tx=0).stop 2024-09-17T05:22:07.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.500+0000 7fe60b040640 1 -- 172.21.15.98:0/3056613492 shutdown_connections 2024-09-17T05:22:07.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.500+0000 7fe60b040640 1 --2- 172.21.15.98:0/3056613492 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fe5e8078b90 0x7fe5e807b050 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:07.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.500+0000 7fe60b040640 1 --2- 172.21.15.98:0/3056613492 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe60415d0c0 0x7fe6040b5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:07.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.500+0000 7fe60b040640 1 --2- 172.21.15.98:0/3056613492 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe6040b7680 0x7fe6040cbf90 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:07.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.500+0000 7fe60b040640 1 --2- 172.21.15.98:0/3056613492 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe5f4004d40 0x7fe6040ccb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:07.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.500+0000 7fe60b040640 1 -- 172.21.15.98:0/3056613492 >> 172.21.15.98:0/3056613492 conn(0x7fe6040d3fe0 msgr2=0x7fe6040b6340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:07.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.500+0000 7fe60b040640 1 -- 172.21.15.98:0/3056613492 shutdown_connections 2024-09-17T05:22:07.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:07.500+0000 7fe60b040640 1 -- 172.21.15.98:0/3056613492 wait complete. 2024-09-17T05:22:07.524 INFO:teuthology.run_tasks:Running task kclient... 2024-09-17T05:22:07.553 INFO:tasks.kclient:Mounting kernel clients... 2024-09-17T05:22:07.553 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-17T05:22:07.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:07.553 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list 2024-09-17T05:22:07.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:07.570 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link delete ceph-brx 2024-09-17T05:22:07.636 INFO:teuthology.orchestra.run.smithi098.stderr:Cannot find device "ceph-brx" 2024-09-17T05:22:07.637 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:22:07.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:07.638 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list 2024-09-17T05:22:07.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:07.694 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link delete ceph-brx 2024-09-17T05:22:07.759 INFO:teuthology.orchestra.run.smithi098.stderr:Cannot find device "ceph-brx" 2024-09-17T05:22:07.760 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:22:07.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:07.761 DEBUG:teuthology.orchestra.run.smithi167:> ip netns list 2024-09-17T05:22:07.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:07.781 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link delete ceph-brx 2024-09-17T05:22:07.853 INFO:teuthology.orchestra.run.smithi167.stderr:Cannot find device "ceph-brx" 2024-09-17T05:22:07.854 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:22:07.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:07.855 DEBUG:teuthology.orchestra.run.smithi167:> ip netns list 2024-09-17T05:22:07.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:07.913 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link delete ceph-brx 2024-09-17T05:22:07.981 INFO:teuthology.orchestra.run.smithi167.stderr:Cannot find device "ceph-brx" 2024-09-17T05:22:07.982 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:22:07.983 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-09-17T05:22:07.983 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T05:22:07.983 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T05:22:07.983 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:22:08.083 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:08.082+0000 7f84d294b640 1 -- 172.21.15.98:0/2322308877 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84cc1445d0 msgr2=0x7f84cc0cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:08.083 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:08.082+0000 7f84d294b640 1 --2- 172.21.15.98:0/2322308877 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84cc1445d0 0x7f84cc0cebf0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f84cc0cd420 tx=0x7f84bc02a5f0 comp rx=0 tx=0).stop 2024-09-17T05:22:08.083 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:08.082+0000 7f84d294b640 1 -- 172.21.15.98:0/2322308877 shutdown_connections 2024-09-17T05:22:08.083 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:08.082+0000 7f84d294b640 1 --2- 172.21.15.98:0/2322308877 >> v2:172.21.15.167:3300/0 conn(0x7f84cc0b4ca0 0x7f84cc15e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:08.083 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:08.082+0000 7f84d294b640 1 --2- 172.21.15.98:0/2322308877 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f84cc0ccfd0 0x7f84cc0cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:08.084 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:08.082+0000 7f84d294b640 1 --2- 172.21.15.98:0/2322308877 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84cc1445d0 0x7f84cc0cebf0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:08.084 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:08.082+0000 7f84d294b640 1 -- 172.21.15.98:0/2322308877 >> 172.21.15.98:0/2322308877 conn(0x7f84cc0b1950 msgr2=0x7f84cc0b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:08.084 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:08.082+0000 7f84d294b640 1 -- 172.21.15.98:0/2322308877 shutdown_connections 2024-09-17T05:22:08.084 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:08.082+0000 7f84d294b640 1 -- 172.21.15.98:0/2322308877 wait complete. 2024-09-17T05:22:08.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:08.083+0000 7f84d294b640 1 Processor -- start 2024-09-17T05:22:08.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:08.083+0000 7f84d294b640 1 -- start start 2024-09-17T05:22:08.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:08.084+0000 7f84d294b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84cc0b4ca0 0x7f84cc0adff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:08.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:08.084+0000 7f84d294b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f84cc0ccfd0 0x7f84cc09b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:08.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:08.084+0000 7f84d294b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84cc1445d0 0x7f84cc15a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:08.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:08.084+0000 7f84d294b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f84cc15f240 con 0x7f84cc1445d0 2024-09-17T05:22:08.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:08.084+0000 7f84d294b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f84cc15f0c0 con 0x7f84cc0b4ca0 2024-09-17T05:22:08.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:08.084+0000 7f84d294b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f84cc15f3c0 con 0x7f84cc0ccfd0 2024-09-17T05:22:08.087 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:08.084+0000 7f84d0ee8640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84cc1445d0 0x7f84cc15a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:08.087 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:08.084+0000 7f84d0ee8640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84cc1445d0 0x7f84cc15a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39832/0 (socket says 172.21.15.98:39832) 2024-09-17T05:22:08.087 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:08.084+0000 7f84d0ee8640 1 -- 172.21.15.98:0/1424847416 learned_addr learned my addr 172.21.15.98:0/1424847416 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:08.087 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:08.084+0000 7f84cbfff640 1 --2- 172.21.15.98:0/1424847416 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84cc0b4ca0 0x7f84cc0adff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:08.087 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:08.084+0000 7f84cb7fe640 1 --2- 172.21.15.98:0/1424847416 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f84cc0ccfd0 0x7f84cc09b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:08.087 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:08.084+0000 7f84d0ee8640 1 -- 172.21.15.98:0/1424847416 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f84cc0ccfd0 msgr2=0x7f84cc09b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:08.087 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:08.084+0000 7f84d0ee8640 1 --2- 172.21.15.98:0/1424847416 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f84cc0ccfd0 0x7f84cc09b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:08.087 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:08.084+0000 7f84d0ee8640 1 -- 172.21.15.98:0/1424847416 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84cc0b4ca0 msgr2=0x7f84cc0adff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:08.087 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:08.084+0000 7f84d0ee8640 1 --2- 172.21.15.98:0/1424847416 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84cc0b4ca0 0x7f84cc0adff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:08.087 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:08.084+0000 7f84d0ee8640 1 -- 172.21.15.98:0/1424847416 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84cc09aa00 con 0x7f84cc1445d0 2024-09-17T05:22:08.087 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:08.085+0000 7f84d0ee8640 1 --2- 172.21.15.98:0/1424847416 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84cc1445d0 0x7f84cc15a530 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f84c400b970 tx=0x7f84c400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:08.087 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:08.085+0000 7f84c8ff9640 1 -- 172.21.15.98:0/1424847416 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c4019070 con 0x7f84cc1445d0 2024-09-17T05:22:08.087 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:08.085+0000 7f84c8ff9640 1 -- 172.21.15.98:0/1424847416 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f84c400cbb0 con 0x7f84cc1445d0 2024-09-17T05:22:08.088 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:08.085+0000 7f84d294b640 1 -- 172.21.15.98:0/1424847416 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84cc09c110 con 0x7f84cc1445d0 2024-09-17T05:22:08.088 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:08.085+0000 7f84c8ff9640 1 -- 172.21.15.98:0/1424847416 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c4014440 con 0x7f84cc1445d0 2024-09-17T05:22:08.088 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:08.085+0000 7f84d294b640 1 -- 172.21.15.98:0/1424847416 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84cc09c6d0 con 0x7f84cc1445d0 2024-09-17T05:22:08.088 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:08.086+0000 7f84d294b640 1 -- 172.21.15.98:0/1424847416 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84cc15e970 con 0x7f84cc1445d0 2024-09-17T05:22:08.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:08.086+0000 7f84c8ff9640 1 -- 172.21.15.98:0/1424847416 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f84c401c070 con 0x7f84cc1445d0 2024-09-17T05:22:08.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:08.087+0000 7f84c8ff9640 1 --2- 172.21.15.98:0/1424847416 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f84b8078b90 0x7f84b807b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:08.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:08.087+0000 7f84c8ff9640 1 -- 172.21.15.98:0/1424847416 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f84c409a820 con 0x7f84cc1445d0 2024-09-17T05:22:08.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:08.087+0000 7f84cbfff640 1 --2- 172.21.15.98:0/1424847416 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f84b8078b90 0x7f84b807b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:08.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:08.088+0000 7f84cbfff640 1 --2- 172.21.15.98:0/1424847416 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f84b8078b90 0x7f84b807b050 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f84bc033000 tx=0x7f84bc004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:08.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:08.091+0000 7f84c8ff9640 1 -- 172.21.15.98:0/1424847416 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f84c4062730 con 0x7f84cc1445d0 2024-09-17T05:22:08.306 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:08.305+0000 7f84d294b640 1 -- 172.21.15.98:0/1424847416 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f84cc0cdef0 con 0x7f84cc1445d0 2024-09-17T05:22:08.306 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:08.305+0000 7f84c8ff9640 1 -- 172.21.15.98:0/1424847416 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7f84c4067160 con 0x7f84cc1445d0 2024-09-17T05:22:08.306 INFO:teuthology.orchestra.run.smithi098.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:22:08.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:08.308+0000 7f84d294b640 1 -- 172.21.15.98:0/1424847416 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f84b8078b90 msgr2=0x7f84b807b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:08.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:08.308+0000 7f84d294b640 1 --2- 172.21.15.98:0/1424847416 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f84b8078b90 0x7f84b807b050 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f84bc033000 tx=0x7f84bc004730 comp rx=0 tx=0).stop 2024-09-17T05:22:08.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:08.308+0000 7f84d294b640 1 -- 172.21.15.98:0/1424847416 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84cc1445d0 msgr2=0x7f84cc15a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:08.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:08.308+0000 7f84d294b640 1 --2- 172.21.15.98:0/1424847416 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84cc1445d0 0x7f84cc15a530 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f84c400b970 tx=0x7f84c400bd70 comp rx=0 tx=0).stop 2024-09-17T05:22:08.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:08.308+0000 7f84d294b640 1 -- 172.21.15.98:0/1424847416 shutdown_connections 2024-09-17T05:22:08.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:08.308+0000 7f84d294b640 1 --2- 172.21.15.98:0/1424847416 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f84b8078b90 0x7f84b807b050 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:08.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:08.308+0000 7f84d294b640 1 --2- 172.21.15.98:0/1424847416 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84cc1445d0 0x7f84cc15a530 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:08.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:08.308+0000 7f84d294b640 1 --2- 172.21.15.98:0/1424847416 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f84cc0ccfd0 0x7f84cc09b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:08.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:08.308+0000 7f84d294b640 1 --2- 172.21.15.98:0/1424847416 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84cc0b4ca0 0x7f84cc0adff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:08.310 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:08.308+0000 7f84d294b640 1 -- 172.21.15.98:0/1424847416 >> 172.21.15.98:0/1424847416 conn(0x7f84cc0b1950 msgr2=0x7f84cc0af880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:08.310 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:08.308+0000 7f84d294b640 1 -- 172.21.15.98:0/1424847416 shutdown_connections 2024-09-17T05:22:08.310 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:08.308+0000 7f84d294b640 1 -- 172.21.15.98:0/1424847416 wait complete. 2024-09-17T05:22:08.319 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T05:22:08.320 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:22:08.320 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi098.front.sepia.ceph.com 2024-09-17T05:22:08.320 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T05:22:08.320 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T05:22:08.320 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T05:22:08.320 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T05:22:08.320 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:22:08.320 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:22:08.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:08.320 DEBUG:teuthology.orchestra.run.smithi098:> ip addr 2024-09-17T05:22:08.335 INFO:teuthology.orchestra.run.smithi098.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:22:08.336 INFO:teuthology.orchestra.run.smithi098.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:22:08.336 INFO:teuthology.orchestra.run.smithi098.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:22:08.336 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:08.336 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 ::1/128 scope host 2024-09-17T05:22:08.336 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:08.336 INFO:teuthology.orchestra.run.smithi098.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:22:08.336 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:d8:d9:b8 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:22:08.336 INFO:teuthology.orchestra.run.smithi098.stdout: altname enp7s0f0 2024-09-17T05:22:08.336 INFO:teuthology.orchestra.run.smithi098.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:22:08.336 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:d8:d9:b9 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:22:08.336 INFO:teuthology.orchestra.run.smithi098.stdout: altname enp7s0f1 2024-09-17T05:22:08.336 INFO:teuthology.orchestra.run.smithi098.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:22:08.337 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:8f:d2:6a brd ff:ff:ff:ff:ff:ff 2024-09-17T05:22:08.337 INFO:teuthology.orchestra.run.smithi098.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:22:08.337 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:8f:d2:6b brd ff:ff:ff:ff:ff:ff 2024-09-17T05:22:08.337 INFO:teuthology.orchestra.run.smithi098.stdout: inet 172.21.15.98/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T05:22:08.337 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft 42774sec preferred_lft 42774sec 2024-09-17T05:22:08.337 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::ec4:7aff:fe8f:d26b/64 scope link noprefixroute 2024-09-17T05:22:08.337 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:08.337 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-17T05:22:08.338 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:22:08.338 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2024-09-17T05:22:08.338 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link add name ceph-brx type bridge 2024-09-17T05:22:08.338 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip addr flush dev ceph-brx 2024-09-17T05:22:08.338 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link set ceph-brx up 2024-09-17T05:22:08.338 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-17T05:22:08.338 DEBUG:teuthology.orchestra.run.smithi098:> ') 2024-09-17T05:22:08.423 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:22:08.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:22:08.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:08.543 DEBUG:teuthology.orchestra.run.smithi098:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:22:08.567 INFO:teuthology.orchestra.run.smithi098.stdout:1 2024-09-17T05:22:08.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:08.569 DEBUG:teuthology.orchestra.run.smithi098:> route 2024-09-17T05:22:08.639 INFO:teuthology.orchestra.run.smithi098.stdout:Kernel IP routing table 2024-09-17T05:22:08.640 INFO:teuthology.orchestra.run.smithi098.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:22:08.640 INFO:teuthology.orchestra.run.smithi098.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T05:22:08.640 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T05:22:08.640 INFO:teuthology.orchestra.run.smithi098.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:22:08.640 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:22:08.641 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2024-09-17T05:22:08.641 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T05:22:08.641 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T05:22:08.641 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T05:22:08.641 DEBUG:teuthology.orchestra.run.smithi098:> ') 2024-09-17T05:22:08.728 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:22:08.932 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:22:08.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:08.939 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list 2024-09-17T05:22:08.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:08.954 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list-id 2024-09-17T05:22:09.009 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:22:09.010 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2024-09-17T05:22:09.010 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:22:09.010 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-17T05:22:09.010 DEBUG:teuthology.orchestra.run.smithi098:> ') 2024-09-17T05:22:09.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:22:09.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:22:09.130 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-17T05:22:09.130 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:22:09.130 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2024-09-17T05:22:09.130 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-17T05:22:09.130 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-17T05:22:09.130 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-17T05:22:09.130 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-17T05:22:09.131 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-17T05:22:09.131 DEBUG:teuthology.orchestra.run.smithi098:> ') 2024-09-17T05:22:09.179 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:22:09.254 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:22:09.260 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:22:09.260 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2024-09-17T05:22:09.260 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link set brx.0 up 2024-09-17T05:22:09.261 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link set dev brx.0 master ceph-brx 2024-09-17T05:22:09.261 DEBUG:teuthology.orchestra.run.smithi098:> ') 2024-09-17T05:22:09.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:22:09.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:22:09.339 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:22:09.340 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T05:22:09.356 INFO:teuthology.orchestra.run.smithi098.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:22:09.356 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:22:09.356 DEBUG:teuthology.orchestra.run.smithi098:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:22:09.411 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-17T05:22:09.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:09.412 DEBUG:teuthology.orchestra.run.smithi098:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:22:09.506 INFO:teuthology.orchestra.run.smithi098.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:22:09.507 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:22:09.636 INFO:teuthology.orchestra.run.smithi098.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:22:09.636 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:22:09.637 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: resolved to: "172.21.15.98:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-09-17T05:22:09.637 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: trying mount with new device syntax: 0@fcbf5a43-b3d8-497c-b15d-3cc022477cf0.cephfs=/ 2024-09-17T05:22:09.637 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.98:3300/172.21.15.167:3300/172.21.15.167:3301" will pass to kernel 2024-09-17T05:22:09.637 INFO:teuthology.orchestra.run.smithi098.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T05:22:09.637 INFO:teuthology.orchestra.run.smithi098.stdout: You just mounted a file system that supports labels which does not 2024-09-17T05:22:09.637 INFO:teuthology.orchestra.run.smithi098.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T05:22:09.638 INFO:teuthology.orchestra.run.smithi098.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T05:22:09.638 INFO:teuthology.orchestra.run.smithi098.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T05:22:09.639 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:22:09.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:09.639 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:22:09.665 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:22:09.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:22:09.761 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:22:09.767 INFO:teuthology.orchestra.run.smithi098.stdout:client4627 2024-09-17T05:22:09.768 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T05:22:09.768 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:22:09.784 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:22:09.874 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:22:09.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:22:09.894 INFO:teuthology.orchestra.run.smithi098.stdout:client4627 2024-09-17T05:22:09.894 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:22:09.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:22:09.952 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:22:09.958 INFO:teuthology.orchestra.run.smithi098.stdout:client4627 2024-09-17T05:22:09.958 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/fcbf5a43-b3d8-497c-b15d-3cc022477cf0.client4627/status') 2024-09-17T05:22:10.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:22:10.021 INFO:teuthology.orchestra.run.smithi098.stdout:instance: client.4627 (3)172.21.15.98:0/1864240933 2024-09-17T05:22:10.022 INFO:teuthology.orchestra.run.smithi098.stdout:blocklisted: false 2024-09-17T05:22:10.022 INFO:teuthology.orchestra.run.smithi098.stderr:0+1 records in 2024-09-17T05:22:10.022 INFO:teuthology.orchestra.run.smithi098.stderr:0+1 records out 2024-09-17T05:22:10.022 INFO:teuthology.orchestra.run.smithi098.stderr:70 bytes copied, 2.1958e-05 s, 3.2 MB/s 2024-09-17T05:22:10.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:22:10.029 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-09-17T05:22:10.029 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T05:22:10.029 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-17T05:22:10.030 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:22:10.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:10.131+0000 7fa6db2fe640 1 -- 172.21.15.98:0/1918793060 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6bc003a00 msgr2=0x7fa6bc003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:10.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:10.131+0000 7fa6db2fe640 1 --2- 172.21.15.98:0/1918793060 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6bc003a00 0x7fa6bc003e20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa6c400c640 tx=0x7fa6bc005830 comp rx=0 tx=0).stop 2024-09-17T05:22:10.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:10.131+0000 7fa6d989b640 1 -- 172.21.15.98:0/1918793060 reap_dead start 2024-09-17T05:22:10.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:10.131+0000 7fa6db2fe640 1 -- 172.21.15.98:0/1918793060 shutdown_connections 2024-09-17T05:22:10.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:10.131+0000 7fa6db2fe640 1 -- 172.21.15.98:0/1918793060 >> 172.21.15.98:0/1918793060 conn(0x7fa6d40b1950 msgr2=0x7fa6d40b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:10.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:10.131+0000 7fa6db2fe640 1 -- 172.21.15.98:0/1918793060 shutdown_connections 2024-09-17T05:22:10.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:10.131+0000 7fa6db2fe640 1 -- 172.21.15.98:0/1918793060 wait complete. 2024-09-17T05:22:10.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:10.132+0000 7fa6db2fe640 1 Processor -- start 2024-09-17T05:22:10.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:10.132+0000 7fa6db2fe640 1 -- start start 2024-09-17T05:22:10.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:10.133+0000 7fa6db2fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6bc003a00 0x7fa6d409ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:10.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:10.133+0000 7fa6db2fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6d41f55d0 0x7fa6d41f0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:10.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:10.133+0000 7fa6db2fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6d41f14e0 0x7fa6d40ae590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:10.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:10.133+0000 7fa6db2fe640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d40729a0 con 0x7fa6d41f55d0 2024-09-17T05:22:10.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:10.133+0000 7fa6db2fe640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d40b4eb0 con 0x7fa6d41f14e0 2024-09-17T05:22:10.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:10.133+0000 7fa6db2fe640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fa6d4072b20 con 0x7fa6bc003a00 2024-09-17T05:22:10.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:10.133+0000 7fa6d8899640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6d41f55d0 0x7fa6d41f0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:10.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:10.133+0000 7fa6d8899640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6d41f55d0 0x7fa6d41f0fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39860/0 (socket says 172.21.15.98:39860) 2024-09-17T05:22:10.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:10.133+0000 7fa6d8899640 1 -- 172.21.15.98:0/3326166797 learned_addr learned my addr 172.21.15.98:0/3326166797 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:10.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:10.133+0000 7fa6d909a640 1 --2- 172.21.15.98:0/3326166797 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6bc003a00 0x7fa6d409ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:10.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:10.133+0000 7fa6d989b640 1 --2- 172.21.15.98:0/3326166797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6d41f14e0 0x7fa6d40ae590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:10.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:10.134+0000 7fa6d8899640 1 -- 172.21.15.98:0/3326166797 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6bc003a00 msgr2=0x7fa6d409ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:10.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:10.134+0000 7fa6d8899640 1 --2- 172.21.15.98:0/3326166797 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6bc003a00 0x7fa6d409ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:10.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:10.134+0000 7fa6d8899640 1 -- 172.21.15.98:0/3326166797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6d41f14e0 msgr2=0x7fa6d40ae590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:10.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:10.134+0000 7fa6d8899640 1 --2- 172.21.15.98:0/3326166797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6d41f14e0 0x7fa6d40ae590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:10.137 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:10.134+0000 7fa6d8899640 1 -- 172.21.15.98:0/3326166797 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6d413bee0 con 0x7fa6d41f55d0 2024-09-17T05:22:10.137 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:10.134+0000 7fa6d8899640 1 --2- 172.21.15.98:0/3326166797 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6d41f55d0 0x7fa6d41f0fa0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8004600 tx=0x7fa6c800ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:10.137 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:10.134+0000 7fa6d1ffb640 1 -- 172.21.15.98:0/3326166797 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c80109f0 con 0x7fa6d41f55d0 2024-09-17T05:22:10.137 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:10.134+0000 7fa6d1ffb640 1 -- 172.21.15.98:0/3326166797 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa6c8010b90 con 0x7fa6d41f55d0 2024-09-17T05:22:10.137 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:10.134+0000 7fa6db2fe640 1 -- 172.21.15.98:0/3326166797 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6d409d290 con 0x7fa6d41f55d0 2024-09-17T05:22:10.137 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:10.134+0000 7fa6d1ffb640 1 -- 172.21.15.98:0/3326166797 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c801a420 con 0x7fa6d41f55d0 2024-09-17T05:22:10.137 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:10.134+0000 7fa6db2fe640 1 -- 172.21.15.98:0/3326166797 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6d41f1e50 con 0x7fa6d41f55d0 2024-09-17T05:22:10.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:10.135+0000 7fa6db2fe640 1 -- 172.21.15.98:0/3326166797 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6d41f18f0 con 0x7fa6d41f55d0 2024-09-17T05:22:10.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:10.136+0000 7fa6d1ffb640 1 -- 172.21.15.98:0/3326166797 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa6c8023440 con 0x7fa6d41f55d0 2024-09-17T05:22:10.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:10.136+0000 7fa6d1ffb640 1 --2- 172.21.15.98:0/3326166797 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fa6c0078b90 0x7fa6c007b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:10.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:10.136+0000 7fa6d1ffb640 1 -- 172.21.15.98:0/3326166797 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa6c809d3a0 con 0x7fa6d41f55d0 2024-09-17T05:22:10.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:10.136+0000 7fa6d909a640 1 --2- 172.21.15.98:0/3326166797 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fa6c0078b90 0x7fa6c007b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:10.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:10.137+0000 7fa6d909a640 1 --2- 172.21.15.98:0/3326166797 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fa6c0078b90 0x7fa6c007b050 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa6c4033000 tx=0x7fa6d40cd6f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:10.141 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:10.141+0000 7fa6d1ffb640 1 -- 172.21.15.98:0/3326166797 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fa6d41f18f0 con 0x7fa6d41f55d0 2024-09-17T05:22:10.357 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:10.356+0000 7fa6db2fe640 1 -- 172.21.15.98:0/3326166797 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa6d4072ea0 con 0x7fa6d41f55d0 2024-09-17T05:22:10.357 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:10.356+0000 7fa6d1ffb640 1 -- 172.21.15.98:0/3326166797 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7fa6c8065230 con 0x7fa6d41f55d0 2024-09-17T05:22:10.357 INFO:teuthology.orchestra.run.smithi098.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:22:10.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:10.359+0000 7fa6db2fe640 1 -- 172.21.15.98:0/3326166797 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fa6c0078b90 msgr2=0x7fa6c007b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:10.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:10.359+0000 7fa6db2fe640 1 --2- 172.21.15.98:0/3326166797 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fa6c0078b90 0x7fa6c007b050 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa6c4033000 tx=0x7fa6d40cd6f0 comp rx=0 tx=0).stop 2024-09-17T05:22:10.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:10.359+0000 7fa6db2fe640 1 -- 172.21.15.98:0/3326166797 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6d41f55d0 msgr2=0x7fa6d41f0fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:10.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:10.359+0000 7fa6db2fe640 1 --2- 172.21.15.98:0/3326166797 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6d41f55d0 0x7fa6d41f0fa0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8004600 tx=0x7fa6c800ba40 comp rx=0 tx=0).stop 2024-09-17T05:22:10.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:10.359+0000 7fa6db2fe640 1 -- 172.21.15.98:0/3326166797 shutdown_connections 2024-09-17T05:22:10.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:10.359+0000 7fa6db2fe640 1 --2- 172.21.15.98:0/3326166797 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fa6c0078b90 0x7fa6c007b050 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:10.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:10.359+0000 7fa6db2fe640 1 --2- 172.21.15.98:0/3326166797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6d41f14e0 0x7fa6d40ae590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:10.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:10.359+0000 7fa6db2fe640 1 --2- 172.21.15.98:0/3326166797 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6d41f55d0 0x7fa6d41f0fa0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:10.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:10.359+0000 7fa6db2fe640 1 --2- 172.21.15.98:0/3326166797 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6bc003a00 0x7fa6d409ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:10.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:10.359+0000 7fa6db2fe640 1 -- 172.21.15.98:0/3326166797 >> 172.21.15.98:0/3326166797 conn(0x7fa6d40b1950 msgr2=0x7fa6d406e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:10.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:10.359+0000 7fa6db2fe640 1 -- 172.21.15.98:0/3326166797 shutdown_connections 2024-09-17T05:22:10.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:10.359+0000 7fa6db2fe640 1 -- 172.21.15.98:0/3326166797 wait complete. 2024-09-17T05:22:10.370 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T05:22:10.370 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:22:10.370 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi098.front.sepia.ceph.com 2024-09-17T05:22:10.370 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-17T05:22:10.370 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-17T05:22:10.370 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T05:22:10.371 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T05:22:10.371 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:22:10.371 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-17T05:22:10.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:10.371 DEBUG:teuthology.orchestra.run.smithi098:> ip addr 2024-09-17T05:22:10.386 INFO:teuthology.orchestra.run.smithi098.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:22:10.387 INFO:teuthology.orchestra.run.smithi098.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:22:10.387 INFO:teuthology.orchestra.run.smithi098.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:22:10.387 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:10.387 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 ::1/128 scope host 2024-09-17T05:22:10.387 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:10.387 INFO:teuthology.orchestra.run.smithi098.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:22:10.387 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:d8:d9:b8 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:22:10.387 INFO:teuthology.orchestra.run.smithi098.stdout: altname enp7s0f0 2024-09-17T05:22:10.387 INFO:teuthology.orchestra.run.smithi098.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:22:10.387 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:d8:d9:b9 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:22:10.387 INFO:teuthology.orchestra.run.smithi098.stdout: altname enp7s0f1 2024-09-17T05:22:10.387 INFO:teuthology.orchestra.run.smithi098.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:22:10.388 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:8f:d2:6a brd ff:ff:ff:ff:ff:ff 2024-09-17T05:22:10.388 INFO:teuthology.orchestra.run.smithi098.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:22:10.388 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:8f:d2:6b brd ff:ff:ff:ff:ff:ff 2024-09-17T05:22:10.388 INFO:teuthology.orchestra.run.smithi098.stdout: inet 172.21.15.98/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T05:22:10.388 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft 42772sec preferred_lft 42772sec 2024-09-17T05:22:10.388 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::ec4:7aff:fe8f:d26b/64 scope link noprefixroute 2024-09-17T05:22:10.389 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:10.389 INFO:teuthology.orchestra.run.smithi098.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:22:10.389 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 66:7a:21:b8:75:17 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:22:10.389 INFO:teuthology.orchestra.run.smithi098.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:22:10.389 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:10.389 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::bcd4:a6ff:feee:18c/64 scope link 2024-09-17T05:22:10.389 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:10.389 INFO:teuthology.orchestra.run.smithi098.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:22:10.389 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 66:7a:21:b8:75:17 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:22:10.390 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::647a:21ff:feb8:7517/64 scope link tentative 2024-09-17T05:22:10.390 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:10.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:10.390 DEBUG:teuthology.orchestra.run.smithi098:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:22:10.450 INFO:teuthology.orchestra.run.smithi098.stdout:1 2024-09-17T05:22:10.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:10.451 DEBUG:teuthology.orchestra.run.smithi098:> route 2024-09-17T05:22:10.508 INFO:teuthology.orchestra.run.smithi098.stdout:Kernel IP routing table 2024-09-17T05:22:10.508 INFO:teuthology.orchestra.run.smithi098.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:22:10.508 INFO:teuthology.orchestra.run.smithi098.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T05:22:10.508 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T05:22:10.508 INFO:teuthology.orchestra.run.smithi098.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:22:10.508 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:22:10.508 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2024-09-17T05:22:10.509 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T05:22:10.509 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T05:22:10.509 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T05:22:10.509 DEBUG:teuthology.orchestra.run.smithi098:> ') 2024-09-17T05:22:10.595 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:22:10.626 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:22:10.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:10.633 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list 2024-09-17T05:22:10.648 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T05:22:10.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:10.649 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list-id 2024-09-17T05:22:10.703 INFO:teuthology.orchestra.run.smithi098.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-17T05:22:10.704 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:22:10.704 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2024-09-17T05:22:10.704 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:22:10.704 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-17T05:22:10.704 DEBUG:teuthology.orchestra.run.smithi098:> ') 2024-09-17T05:22:10.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:22:10.813 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:22:10.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:10.820 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-17T05:22:10.844 INFO:teuthology.orchestra.run.smithi098.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:22:10.844 INFO:teuthology.orchestra.run.smithi098.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:22:10.844 INFO:teuthology.orchestra.run.smithi098.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:22:10.844 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:10.844 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 ::1/128 scope host 2024-09-17T05:22:10.844 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:10.845 INFO:teuthology.orchestra.run.smithi098.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:22:10.845 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether e2:7c:00:3e:fb:d9 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-17T05:22:10.845 INFO:teuthology.orchestra.run.smithi098.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-17T05:22:10.845 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:10.845 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::e07c:ff:fe3e:fbd9/64 scope link 2024-09-17T05:22:10.845 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:10.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:10.846 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-17T05:22:10.911 INFO:teuthology.orchestra.run.smithi098.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:22:10.912 INFO:teuthology.orchestra.run.smithi098.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:22:10.912 INFO:teuthology.orchestra.run.smithi098.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:22:10.912 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:10.912 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 ::1/128 scope host 2024-09-17T05:22:10.912 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:10.912 INFO:teuthology.orchestra.run.smithi098.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:22:10.912 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether e2:7c:00:3e:fb:d9 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-17T05:22:10.913 INFO:teuthology.orchestra.run.smithi098.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-17T05:22:10.913 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:10.913 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::e07c:ff:fe3e:fbd9/64 scope link 2024-09-17T05:22:10.913 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:10.915 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-17T05:22:10.915 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:22:10.915 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2024-09-17T05:22:10.915 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-17T05:22:10.915 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-17T05:22:10.915 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-17T05:22:10.915 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-17T05:22:10.915 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-17T05:22:10.915 DEBUG:teuthology.orchestra.run.smithi098:> ') 2024-09-17T05:22:11.002 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:22:11.059 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:22:11.065 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:22:11.065 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2024-09-17T05:22:11.066 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link set brx.1 up 2024-09-17T05:22:11.066 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link set dev brx.1 master ceph-brx 2024-09-17T05:22:11.066 DEBUG:teuthology.orchestra.run.smithi098:> ') 2024-09-17T05:22:11.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:22:11.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:22:11.141 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:22:11.141 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-17T05:22:11.156 INFO:teuthology.orchestra.run.smithi098.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-17T05:22:11.156 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:22:11.157 DEBUG:teuthology.orchestra.run.smithi098:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-17T05:22:11.211 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-09-17T05:22:11.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:11.212 DEBUG:teuthology.orchestra.run.smithi098:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:22:11.295 INFO:teuthology.orchestra.run.smithi098.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:22:11.295 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:22:11.303 INFO:teuthology.orchestra.run.smithi098.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:22:11.304 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:22:11.304 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: resolved to: "172.21.15.98:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-09-17T05:22:11.304 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: trying mount with new device syntax: 2@fcbf5a43-b3d8-497c-b15d-3cc022477cf0.cephfs=/ 2024-09-17T05:22:11.304 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.98:3300/172.21.15.167:3300/172.21.15.167:3301" will pass to kernel 2024-09-17T05:22:11.304 INFO:teuthology.orchestra.run.smithi098.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-09-17T05:22:11.304 INFO:teuthology.orchestra.run.smithi098.stdout: You just mounted a file system that supports labels which does not 2024-09-17T05:22:11.304 INFO:teuthology.orchestra.run.smithi098.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T05:22:11.304 INFO:teuthology.orchestra.run.smithi098.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T05:22:11.305 INFO:teuthology.orchestra.run.smithi098.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T05:22:11.306 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:22:11.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:11.306 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-17T05:22:11.372 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:22:11.461 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:22:11.463 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:22:11.469 INFO:teuthology.orchestra.run.smithi098.stdout:client4636 2024-09-17T05:22:11.469 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T05:22:11.469 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:22:11.486 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:22:11.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:22:11.576 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:22:11.581 INFO:teuthology.orchestra.run.smithi098.stdout:client4636 2024-09-17T05:22:11.582 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:22:11.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:22:11.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:22:11.637 INFO:teuthology.orchestra.run.smithi098.stdout:client4636 2024-09-17T05:22:11.638 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/fcbf5a43-b3d8-497c-b15d-3cc022477cf0.client4636/status') 2024-09-17T05:22:11.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:22:11.695 INFO:teuthology.orchestra.run.smithi098.stdout:instance: client.4636 (3)172.21.15.98:0/805305915 2024-09-17T05:22:11.695 INFO:teuthology.orchestra.run.smithi098.stdout:blocklisted: false 2024-09-17T05:22:11.695 INFO:teuthology.orchestra.run.smithi098.stderr:0+1 records in 2024-09-17T05:22:11.696 INFO:teuthology.orchestra.run.smithi098.stderr:0+1 records out 2024-09-17T05:22:11.696 INFO:teuthology.orchestra.run.smithi098.stderr:69 bytes copied, 2.2133e-05 s, 3.1 MB/s 2024-09-17T05:22:11.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:22:11.702 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-09-17T05:22:11.702 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T05:22:11.702 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T05:22:11.703 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:22:11.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:11.803+0000 7f02e940c640 1 -- 172.21.15.98:0/2373599655 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02e415e090 msgr2=0x7f02e40d23e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:11.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:11.803+0000 7f02e940c640 1 --2- 172.21.15.98:0/2373599655 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02e415e090 0x7f02e40d23e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f02d4009830 tx=0x7f02d402a510 comp rx=0 tx=0).stop 2024-09-17T05:22:11.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:11.804+0000 7f02e940c640 1 -- 172.21.15.98:0/2373599655 shutdown_connections 2024-09-17T05:22:11.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:11.804+0000 7f02e940c640 1 --2- 172.21.15.98:0/2373599655 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02e40d0940 0x7f02e40d0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:11.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:11.804+0000 7f02e940c640 1 --2- 172.21.15.98:0/2373599655 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02e415e090 0x7f02e40d23e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:11.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:11.804+0000 7f02e940c640 1 -- 172.21.15.98:0/2373599655 >> 172.21.15.98:0/2373599655 conn(0x7f02e40d3fa0 msgr2=0x7f02e40d43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:11.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:11.804+0000 7f02e940c640 1 -- 172.21.15.98:0/2373599655 shutdown_connections 2024-09-17T05:22:11.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:11.804+0000 7f02e940c640 1 -- 172.21.15.98:0/2373599655 wait complete. 2024-09-17T05:22:11.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:11.805+0000 7f02e940c640 1 Processor -- start 2024-09-17T05:22:11.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:11.805+0000 7f02e940c640 1 -- start start 2024-09-17T05:22:11.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:11.805+0000 7f02e940c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02e40d0940 0x7f02e40b98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:11.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:11.805+0000 7f02e940c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02e40d4ac0 0x7f02e415aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:11.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:11.805+0000 7f02e940c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02e415e090 0x7f02e40b6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:11.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:11.805+0000 7f02e940c640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f02e40cf880 con 0x7f02e40d0940 2024-09-17T05:22:11.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:11.805+0000 7f02e940c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f02e40cf700 con 0x7f02e40d4ac0 2024-09-17T05:22:11.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:11.805+0000 7f02e940c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f02e40cfa00 con 0x7f02e415e090 2024-09-17T05:22:11.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:11.806+0000 7f02e2ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02e40d0940 0x7f02e40b98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:11.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:11.806+0000 7f02e2ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02e40d0940 0x7f02e40b98f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39876/0 (socket says 172.21.15.98:39876) 2024-09-17T05:22:11.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:11.806+0000 7f02e2ffd640 1 -- 172.21.15.98:0/3268988719 learned_addr learned my addr 172.21.15.98:0/3268988719 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:11.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:11.806+0000 7f02e37fe640 1 --2- 172.21.15.98:0/3268988719 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02e415e090 0x7f02e40b6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:11.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:11.806+0000 7f02dbfff640 1 --2- 172.21.15.98:0/3268988719 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02e40d4ac0 0x7f02e415aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:11.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:11.806+0000 7f02e2ffd640 1 -- 172.21.15.98:0/3268988719 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02e415e090 msgr2=0x7f02e40b6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:11.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:11.806+0000 7f02e2ffd640 1 --2- 172.21.15.98:0/3268988719 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02e415e090 0x7f02e40b6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:11.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:11.806+0000 7f02e2ffd640 1 -- 172.21.15.98:0/3268988719 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02e40d4ac0 msgr2=0x7f02e415aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:11.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:11.806+0000 7f02e2ffd640 1 --2- 172.21.15.98:0/3268988719 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02e40d4ac0 0x7f02e415aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:11.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:11.806+0000 7f02e2ffd640 1 -- 172.21.15.98:0/3268988719 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02e415b4d0 con 0x7f02e40d0940 2024-09-17T05:22:11.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:11.806+0000 7f02dbfff640 1 --2- 172.21.15.98:0/3268988719 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02e40d4ac0 0x7f02e415aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:22:11.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:11.806+0000 7f02e2ffd640 1 --2- 172.21.15.98:0/3268988719 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02e40d0940 0x7f02e40b98f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f02d402ab00 tx=0x7f02d4033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:11.810 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:11.806+0000 7f02db7fe640 1 -- 172.21.15.98:0/3268988719 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d4031d60 con 0x7f02e40d0940 2024-09-17T05:22:11.810 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:11.806+0000 7f02db7fe640 1 -- 172.21.15.98:0/3268988719 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f02d4033e10 con 0x7f02e40d0940 2024-09-17T05:22:11.810 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:11.806+0000 7f02db7fe640 1 -- 172.21.15.98:0/3268988719 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d4005260 con 0x7f02e40d0940 2024-09-17T05:22:11.810 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:11.806+0000 7f02e940c640 1 -- 172.21.15.98:0/3268988719 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02e41f8830 con 0x7f02e40d0940 2024-09-17T05:22:11.810 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:11.806+0000 7f02e940c640 1 -- 172.21.15.98:0/3268988719 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02e41f8df0 con 0x7f02e40d0940 2024-09-17T05:22:11.810 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:11.807+0000 7f02e940c640 1 -- 172.21.15.98:0/3268988719 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02e406a310 con 0x7f02e40d0940 2024-09-17T05:22:11.811 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:11.808+0000 7f02db7fe640 1 -- 172.21.15.98:0/3268988719 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f02d4005400 con 0x7f02e40d0940 2024-09-17T05:22:11.811 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:11.808+0000 7f02db7fe640 1 --2- 172.21.15.98:0/3268988719 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f02c4078b90 0x7f02c407b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:11.811 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:11.808+0000 7f02db7fe640 1 -- 172.21.15.98:0/3268988719 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f02d40bbde0 con 0x7f02e40d0940 2024-09-17T05:22:11.811 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:11.808+0000 7f02dbfff640 1 --2- 172.21.15.98:0/3268988719 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f02c4078b90 0x7f02c407b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:11.811 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:11.809+0000 7f02dbfff640 1 --2- 172.21.15.98:0/3268988719 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f02c4078b90 0x7f02c407b050 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f02e4161520 tx=0x7f02cc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:11.813 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:11.812+0000 7f02db7fe640 1 -- 172.21.15.98:0/3268988719 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f02e406a310 con 0x7f02e40d0940 2024-09-17T05:22:12.025 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:12.024+0000 7f02e940c640 1 -- 172.21.15.98:0/3268988719 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f02e40cfeb0 con 0x7f02e40d0940 2024-09-17T05:22:12.025 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:12.024+0000 7f02db7fe640 1 -- 172.21.15.98:0/3268988719 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7f02d403f030 con 0x7f02e40d0940 2024-09-17T05:22:12.025 INFO:teuthology.orchestra.run.smithi098.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:22:12.027 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:12.026+0000 7f02e940c640 1 -- 172.21.15.98:0/3268988719 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f02c4078b90 msgr2=0x7f02c407b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:12.027 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:12.026+0000 7f02e940c640 1 --2- 172.21.15.98:0/3268988719 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f02c4078b90 0x7f02c407b050 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f02e4161520 tx=0x7f02cc009040 comp rx=0 tx=0).stop 2024-09-17T05:22:12.027 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:12.026+0000 7f02e940c640 1 -- 172.21.15.98:0/3268988719 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02e40d0940 msgr2=0x7f02e40b98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:12.027 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:12.026+0000 7f02e940c640 1 --2- 172.21.15.98:0/3268988719 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02e40d0940 0x7f02e40b98f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f02d402ab00 tx=0x7f02d4033c20 comp rx=0 tx=0).stop 2024-09-17T05:22:12.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:12.026+0000 7f02e940c640 1 -- 172.21.15.98:0/3268988719 shutdown_connections 2024-09-17T05:22:12.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:12.026+0000 7f02e940c640 1 --2- 172.21.15.98:0/3268988719 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f02c4078b90 0x7f02c407b050 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:12.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:12.026+0000 7f02e940c640 1 --2- 172.21.15.98:0/3268988719 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02e415e090 0x7f02e40b6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:12.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:12.026+0000 7f02e940c640 1 --2- 172.21.15.98:0/3268988719 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02e40d4ac0 0x7f02e415aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:12.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:12.026+0000 7f02e940c640 1 --2- 172.21.15.98:0/3268988719 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02e40d0940 0x7f02e40b98f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:12.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:12.026+0000 7f02e940c640 1 -- 172.21.15.98:0/3268988719 >> 172.21.15.98:0/3268988719 conn(0x7f02e40d3fa0 msgr2=0x7f02e40b4980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:12.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:12.026+0000 7f02e940c640 1 -- 172.21.15.98:0/3268988719 shutdown_connections 2024-09-17T05:22:12.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:12.026+0000 7f02e940c640 1 -- 172.21.15.98:0/3268988719 wait complete. 2024-09-17T05:22:12.038 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T05:22:12.038 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:22:12.038 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi167.front.sepia.ceph.com 2024-09-17T05:22:12.039 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T05:22:12.039 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T05:22:12.039 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T05:22:12.039 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T05:22:12.039 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:22:12.039 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:22:12.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:12.040 DEBUG:teuthology.orchestra.run.smithi167:> ip addr 2024-09-17T05:22:12.059 INFO:teuthology.orchestra.run.smithi167.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:22:12.059 INFO:teuthology.orchestra.run.smithi167.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:22:12.059 INFO:teuthology.orchestra.run.smithi167.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:22:12.059 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:12.060 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 ::1/128 scope host 2024-09-17T05:22:12.060 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:12.060 INFO:teuthology.orchestra.run.smithi167.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:22:12.060 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:d9:35:e6 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:22:12.060 INFO:teuthology.orchestra.run.smithi167.stdout: altname enp7s0f0 2024-09-17T05:22:12.060 INFO:teuthology.orchestra.run.smithi167.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:22:12.060 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:d9:35:e7 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:22:12.060 INFO:teuthology.orchestra.run.smithi167.stdout: altname enp7s0f1 2024-09-17T05:22:12.060 INFO:teuthology.orchestra.run.smithi167.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:22:12.060 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:88:73:08 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:22:12.060 INFO:teuthology.orchestra.run.smithi167.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:22:12.060 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:88:73:09 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:22:12.060 INFO:teuthology.orchestra.run.smithi167.stdout: inet 172.21.15.167/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T05:22:12.061 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft 42787sec preferred_lft 42787sec 2024-09-17T05:22:12.061 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 fe80::ec4:7aff:fe88:7309/64 scope link noprefixroute 2024-09-17T05:22:12.061 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:12.061 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-17T05:22:12.061 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:22:12.061 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2024-09-17T05:22:12.061 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link add name ceph-brx type bridge 2024-09-17T05:22:12.061 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip addr flush dev ceph-brx 2024-09-17T05:22:12.061 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link set ceph-brx up 2024-09-17T05:22:12.062 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-17T05:22:12.062 DEBUG:teuthology.orchestra.run.smithi167:> ') 2024-09-17T05:22:12.155 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:22:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:22:12.270 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:22:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:22:12.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:12.278 DEBUG:teuthology.orchestra.run.smithi167:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:22:12.302 INFO:teuthology.orchestra.run.smithi167.stdout:1 2024-09-17T05:22:12.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:12.304 DEBUG:teuthology.orchestra.run.smithi167:> route 2024-09-17T05:22:12.369 INFO:teuthology.orchestra.run.smithi167.stdout:Kernel IP routing table 2024-09-17T05:22:12.370 INFO:teuthology.orchestra.run.smithi167.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:22:12.370 INFO:teuthology.orchestra.run.smithi167.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T05:22:12.370 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T05:22:12.370 INFO:teuthology.orchestra.run.smithi167.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:22:12.370 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:22:12.370 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2024-09-17T05:22:12.370 DEBUG:teuthology.orchestra.run.smithi167:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T05:22:12.371 DEBUG:teuthology.orchestra.run.smithi167:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T05:22:12.371 DEBUG:teuthology.orchestra.run.smithi167:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T05:22:12.371 DEBUG:teuthology.orchestra.run.smithi167:> ') 2024-09-17T05:22:12.458 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:22:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:22:12.705 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:22:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:22:12.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:12.712 DEBUG:teuthology.orchestra.run.smithi167:> ip netns list 2024-09-17T05:22:12.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:12.728 DEBUG:teuthology.orchestra.run.smithi167:> ip netns list-id 2024-09-17T05:22:12.784 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:22:12.784 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2024-09-17T05:22:12.784 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:22:12.784 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-17T05:22:12.785 DEBUG:teuthology.orchestra.run.smithi167:> ') 2024-09-17T05:22:12.874 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:22:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:22:12.899 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:22:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:22:12.905 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-17T05:22:12.905 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:22:12.905 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2024-09-17T05:22:12.905 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-17T05:22:12.905 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-17T05:22:12.905 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-17T05:22:12.906 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-17T05:22:12.906 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-17T05:22:12.906 DEBUG:teuthology.orchestra.run.smithi167:> ') 2024-09-17T05:22:12.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:22:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:22:13.029 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:22:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:22:13.035 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:22:13.035 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2024-09-17T05:22:13.035 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link set brx.0 up 2024-09-17T05:22:13.035 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link set dev brx.0 master ceph-brx 2024-09-17T05:22:13.035 DEBUG:teuthology.orchestra.run.smithi167:> ') 2024-09-17T05:22:13.083 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:22:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:22:13.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:22:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:22:13.112 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:22:13.112 DEBUG:teuthology.orchestra.run.smithi167:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T05:22:13.127 INFO:teuthology.orchestra.run.smithi167.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:22:13.128 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:22:13.128 DEBUG:teuthology.orchestra.run.smithi167:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T05:22:13.182 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-17T05:22:13.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:13.183 DEBUG:teuthology.orchestra.run.smithi167:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:22:13.284 INFO:teuthology.orchestra.run.smithi167.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:22:13.284 INFO:teuthology.orchestra.run.smithi167.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:22:13.398 INFO:teuthology.orchestra.run.smithi167.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:22:13.399 INFO:teuthology.orchestra.run.smithi167.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:22:13.399 INFO:teuthology.orchestra.run.smithi167.stdout:mount.ceph: resolved to: "172.21.15.98:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-09-17T05:22:13.399 INFO:teuthology.orchestra.run.smithi167.stdout:mount.ceph: trying mount with new device syntax: 1@fcbf5a43-b3d8-497c-b15d-3cc022477cf0.cephfs=/ 2024-09-17T05:22:13.399 INFO:teuthology.orchestra.run.smithi167.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.98:3300/172.21.15.167:3300/172.21.15.167:3301" will pass to kernel 2024-09-17T05:22:13.399 INFO:teuthology.orchestra.run.smithi167.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-17T05:22:13.399 INFO:teuthology.orchestra.run.smithi167.stdout: You just mounted a file system that supports labels which does not 2024-09-17T05:22:13.399 INFO:teuthology.orchestra.run.smithi167.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T05:22:13.400 INFO:teuthology.orchestra.run.smithi167.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T05:22:13.400 INFO:teuthology.orchestra.run.smithi167.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T05:22:13.401 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:22:13.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:13.401 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T05:22:13.426 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:22:13.515 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:22:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:22:13.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:22:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:22:13.522 INFO:teuthology.orchestra.run.smithi167.stdout:client4710 2024-09-17T05:22:13.522 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-17T05:22:13.522 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:22:13.538 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:22:13.626 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:22:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:22:13.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:22:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:22:13.634 INFO:teuthology.orchestra.run.smithi167.stdout:client4710 2024-09-17T05:22:13.634 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:22:13.682 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:22:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:22:13.684 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:22:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:22:13.690 INFO:teuthology.orchestra.run.smithi167.stdout:client4710 2024-09-17T05:22:13.691 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/fcbf5a43-b3d8-497c-b15d-3cc022477cf0.client4710/status') 2024-09-17T05:22:13.739 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:22:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:22:13.750 INFO:teuthology.orchestra.run.smithi167.stdout:instance: client.4710 (3)172.21.15.167:0/3085274862 2024-09-17T05:22:13.750 INFO:teuthology.orchestra.run.smithi167.stdout:blocklisted: false 2024-09-17T05:22:13.750 INFO:teuthology.orchestra.run.smithi167.stderr:0+1 records in 2024-09-17T05:22:13.750 INFO:teuthology.orchestra.run.smithi167.stderr:0+1 records out 2024-09-17T05:22:13.750 INFO:teuthology.orchestra.run.smithi167.stderr:71 bytes copied, 2.316e-05 s, 3.1 MB/s 2024-09-17T05:22:13.751 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:22:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:22:13.758 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-09-17T05:22:13.758 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T05:22:13.758 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-17T05:22:13.759 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:22:13.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:13.872+0000 7f23a9b52640 1 -- 172.21.15.98:0/3158236432 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23a40ad270 msgr2=0x7f23a4073fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:13.874 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:13.872+0000 7f23a9b52640 1 --2- 172.21.15.98:0/3158236432 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23a40ad270 0x7f23a4073fb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f23a40723f0 tx=0x7f239c02a4d0 comp rx=0 tx=0).stop 2024-09-17T05:22:13.874 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:13.872+0000 7f23a9b52640 1 -- 172.21.15.98:0/3158236432 shutdown_connections 2024-09-17T05:22:13.874 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:13.872+0000 7f23a9b52640 1 --2- 172.21.15.98:0/3158236432 >> v2:172.21.15.167:3300/0 conn(0x7f23a40ccf00 0x7f23a40acd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:13.874 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:13.872+0000 7f23a9b52640 1 --2- 172.21.15.98:0/3158236432 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23a40ad270 0x7f23a4073fb0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:13.874 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:13.872+0000 7f23a9b52640 1 --2- 172.21.15.98:0/3158236432 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23a415f5a0 0x7f23a40b2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:13.874 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:13.872+0000 7f23a9b52640 1 -- 172.21.15.98:0/3158236432 >> 172.21.15.98:0/3158236432 conn(0x7f23a40b1950 msgr2=0x7f23a40b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:13.874 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:13.872+0000 7f23a9b52640 1 -- 172.21.15.98:0/3158236432 shutdown_connections 2024-09-17T05:22:13.874 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:13.872+0000 7f23a9b52640 1 -- 172.21.15.98:0/3158236432 wait complete. 2024-09-17T05:22:13.878 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:13.873+0000 7f23a9b52640 1 Processor -- start 2024-09-17T05:22:13.878 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:13.874+0000 7f23a9b52640 1 -- start start 2024-09-17T05:22:13.878 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:13.874+0000 7f23a9b52640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23a40ad270 0x7f23a40b4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:13.878 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:13.874+0000 7f23a9b52640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23a40ccf00 0x7f23a4154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:13.879 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:13.874+0000 7f23a9b52640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23a415f5a0 0x7f23a414c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:13.879 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:13.874+0000 7f23a9b52640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f23a406f160 con 0x7f23a40ad270 2024-09-17T05:22:13.879 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:13.874+0000 7f23a9b52640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f23a4074780 con 0x7f23a40ccf00 2024-09-17T05:22:13.879 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:13.874+0000 7f23a9b52640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f23a406f2e0 con 0x7f23a415f5a0 2024-09-17T05:22:13.879 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:13.874+0000 7f23a37fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23a40ad270 0x7f23a40b4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:13.879 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:13.874+0000 7f23a37fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23a40ad270 0x7f23a40b4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39898/0 (socket says 172.21.15.98:39898) 2024-09-17T05:22:13.879 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:13.874+0000 7f23a37fe640 1 -- 172.21.15.98:0/2557605006 learned_addr learned my addr 172.21.15.98:0/2557605006 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:13.879 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:13.875+0000 7f23a3fff640 1 --2- 172.21.15.98:0/2557605006 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23a415f5a0 0x7f23a414c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:13.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:13.875+0000 7f23a2ffd640 1 --2- 172.21.15.98:0/2557605006 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23a40ccf00 0x7f23a4154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:13.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:13.875+0000 7f23a37fe640 1 -- 172.21.15.98:0/2557605006 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23a415f5a0 msgr2=0x7f23a414c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:13.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:13.875+0000 7f23a37fe640 1 --2- 172.21.15.98:0/2557605006 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23a415f5a0 0x7f23a414c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:13.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:13.875+0000 7f23a37fe640 1 -- 172.21.15.98:0/2557605006 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23a40ccf00 msgr2=0x7f23a4154a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:13.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:13.875+0000 7f23a37fe640 1 --2- 172.21.15.98:0/2557605006 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23a40ccf00 0x7f23a4154a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:13.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:13.875+0000 7f23a37fe640 1 -- 172.21.15.98:0/2557605006 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23a415e600 con 0x7f23a40ad270 2024-09-17T05:22:13.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:13.875+0000 7f23a37fe640 1 --2- 172.21.15.98:0/2557605006 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23a40ad270 0x7f23a40b4970 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f239400eb00 tx=0x7f239400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:13.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:13.875+0000 7f238bfff640 1 -- 172.21.15.98:0/2557605006 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2394004b20 con 0x7f23a40ad270 2024-09-17T05:22:13.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:13.875+0000 7f238bfff640 1 -- 172.21.15.98:0/2557605006 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2394004ce0 con 0x7f23a40ad270 2024-09-17T05:22:13.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:13.875+0000 7f238bfff640 1 -- 172.21.15.98:0/2557605006 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2394005280 con 0x7f23a40ad270 2024-09-17T05:22:13.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:13.875+0000 7f23a9b52640 1 -- 172.21.15.98:0/2557605006 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23a415e9a0 con 0x7f23a40ad270 2024-09-17T05:22:13.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:13.875+0000 7f23a9b52640 1 -- 172.21.15.98:0/2557605006 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23a40c9570 con 0x7f23a40ad270 2024-09-17T05:22:13.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:13.876+0000 7f23a9b52640 1 -- 172.21.15.98:0/2557605006 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23a406f870 con 0x7f23a40ad270 2024-09-17T05:22:13.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:13.877+0000 7f238bfff640 1 -- 172.21.15.98:0/2557605006 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2394005420 con 0x7f23a40ad270 2024-09-17T05:22:13.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:13.877+0000 7f238bfff640 1 --2- 172.21.15.98:0/2557605006 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f2390078b90 0x7f239007b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:13.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:13.877+0000 7f238bfff640 1 -- 172.21.15.98:0/2557605006 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f239409b930 con 0x7f23a40ad270 2024-09-17T05:22:13.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:13.877+0000 7f23a2ffd640 1 --2- 172.21.15.98:0/2557605006 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f2390078b90 0x7f239007b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:13.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:13.878+0000 7f23a2ffd640 1 --2- 172.21.15.98:0/2557605006 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f2390078b90 0x7f239007b050 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2398005e00 tx=0x7f2398005c50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:13.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:13.881+0000 7f238bfff640 1 -- 172.21.15.98:0/2557605006 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f2394063e90 con 0x7f23a40ad270 2024-09-17T05:22:14.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:14.093+0000 7f23a9b52640 1 -- 172.21.15.98:0/2557605006 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f23a409c110 con 0x7f23a40ad270 2024-09-17T05:22:14.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:14.094+0000 7f238bfff640 1 -- 172.21.15.98:0/2557605006 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7f2394063790 con 0x7f23a40ad270 2024-09-17T05:22:14.095 INFO:teuthology.orchestra.run.smithi098.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:22:14.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:14.096+0000 7f23a9b52640 1 -- 172.21.15.98:0/2557605006 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f2390078b90 msgr2=0x7f239007b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:14.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:14.096+0000 7f23a9b52640 1 --2- 172.21.15.98:0/2557605006 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f2390078b90 0x7f239007b050 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2398005e00 tx=0x7f2398005c50 comp rx=0 tx=0).stop 2024-09-17T05:22:14.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:14.096+0000 7f23a9b52640 1 -- 172.21.15.98:0/2557605006 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23a40ad270 msgr2=0x7f23a40b4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:14.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:14.096+0000 7f23a9b52640 1 --2- 172.21.15.98:0/2557605006 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23a40ad270 0x7f23a40b4970 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f239400eb00 tx=0x7f239400c2d0 comp rx=0 tx=0).stop 2024-09-17T05:22:14.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:14.096+0000 7f23a9b52640 1 -- 172.21.15.98:0/2557605006 shutdown_connections 2024-09-17T05:22:14.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:14.096+0000 7f23a9b52640 1 --2- 172.21.15.98:0/2557605006 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f2390078b90 0x7f239007b050 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:14.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:14.096+0000 7f23a9b52640 1 --2- 172.21.15.98:0/2557605006 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23a415f5a0 0x7f23a414c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:14.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:14.096+0000 7f23a9b52640 1 --2- 172.21.15.98:0/2557605006 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23a40ccf00 0x7f23a4154a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:14.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:14.096+0000 7f23a9b52640 1 --2- 172.21.15.98:0/2557605006 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23a40ad270 0x7f23a40b4970 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:14.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:14.096+0000 7f23a9b52640 1 -- 172.21.15.98:0/2557605006 >> 172.21.15.98:0/2557605006 conn(0x7f23a40b1950 msgr2=0x7f23a40cc390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:14.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:14.096+0000 7f23a9b52640 1 -- 172.21.15.98:0/2557605006 shutdown_connections 2024-09-17T05:22:14.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:14.096+0000 7f23a9b52640 1 -- 172.21.15.98:0/2557605006 wait complete. 2024-09-17T05:22:14.108 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T05:22:14.108 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:22:14.108 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi167.front.sepia.ceph.com 2024-09-17T05:22:14.108 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-17T05:22:14.108 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-17T05:22:14.108 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T05:22:14.108 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T05:22:14.108 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:22:14.108 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-17T05:22:14.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:14.109 DEBUG:teuthology.orchestra.run.smithi167:> ip addr 2024-09-17T05:22:14.125 INFO:teuthology.orchestra.run.smithi167.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:22:14.125 INFO:teuthology.orchestra.run.smithi167.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:22:14.125 INFO:teuthology.orchestra.run.smithi167.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:22:14.125 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:14.125 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 ::1/128 scope host 2024-09-17T05:22:14.125 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:14.125 INFO:teuthology.orchestra.run.smithi167.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:22:14.126 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:d9:35:e6 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:22:14.126 INFO:teuthology.orchestra.run.smithi167.stdout: altname enp7s0f0 2024-09-17T05:22:14.126 INFO:teuthology.orchestra.run.smithi167.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:22:14.126 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:d9:35:e7 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:22:14.126 INFO:teuthology.orchestra.run.smithi167.stdout: altname enp7s0f1 2024-09-17T05:22:14.126 INFO:teuthology.orchestra.run.smithi167.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:22:14.126 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:88:73:08 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:22:14.126 INFO:teuthology.orchestra.run.smithi167.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:22:14.126 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:88:73:09 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:22:14.126 INFO:teuthology.orchestra.run.smithi167.stdout: inet 172.21.15.167/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T05:22:14.126 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft 42785sec preferred_lft 42785sec 2024-09-17T05:22:14.126 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 fe80::ec4:7aff:fe88:7309/64 scope link noprefixroute 2024-09-17T05:22:14.126 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:14.127 INFO:teuthology.orchestra.run.smithi167.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:22:14.127 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether fa:5a:2f:53:c0:39 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:22:14.127 INFO:teuthology.orchestra.run.smithi167.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:22:14.127 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:14.127 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 fe80::50d3:3bff:fea3:1a75/64 scope link 2024-09-17T05:22:14.127 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:14.127 INFO:teuthology.orchestra.run.smithi167.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:22:14.127 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether fa:5a:2f:53:c0:39 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:22:14.127 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 fe80::f85a:2fff:fe53:c039/64 scope link tentative 2024-09-17T05:22:14.127 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:14.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:14.128 DEBUG:teuthology.orchestra.run.smithi167:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:22:14.189 INFO:teuthology.orchestra.run.smithi167.stdout:1 2024-09-17T05:22:14.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:14.191 DEBUG:teuthology.orchestra.run.smithi167:> route 2024-09-17T05:22:14.249 INFO:teuthology.orchestra.run.smithi167.stdout:Kernel IP routing table 2024-09-17T05:22:14.249 INFO:teuthology.orchestra.run.smithi167.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:22:14.249 INFO:teuthology.orchestra.run.smithi167.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T05:22:14.249 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T05:22:14.249 INFO:teuthology.orchestra.run.smithi167.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:22:14.250 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:22:14.250 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2024-09-17T05:22:14.250 DEBUG:teuthology.orchestra.run.smithi167:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T05:22:14.250 DEBUG:teuthology.orchestra.run.smithi167:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T05:22:14.250 DEBUG:teuthology.orchestra.run.smithi167:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T05:22:14.250 DEBUG:teuthology.orchestra.run.smithi167:> ') 2024-09-17T05:22:14.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:22:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:22:14.370 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:22:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:22:14.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:14.376 DEBUG:teuthology.orchestra.run.smithi167:> ip netns list 2024-09-17T05:22:14.393 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T05:22:14.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:14.393 DEBUG:teuthology.orchestra.run.smithi167:> ip netns list-id 2024-09-17T05:22:14.448 INFO:teuthology.orchestra.run.smithi167.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-17T05:22:14.448 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:22:14.449 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2024-09-17T05:22:14.449 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:22:14.449 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-17T05:22:14.449 DEBUG:teuthology.orchestra.run.smithi167:> ') 2024-09-17T05:22:14.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:22:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:22:14.558 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:22:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:22:14.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:14.565 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-17T05:22:14.591 INFO:teuthology.orchestra.run.smithi167.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:22:14.591 INFO:teuthology.orchestra.run.smithi167.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:22:14.591 INFO:teuthology.orchestra.run.smithi167.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:22:14.591 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:14.591 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 ::1/128 scope host 2024-09-17T05:22:14.591 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:14.591 INFO:teuthology.orchestra.run.smithi167.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:22:14.591 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 86:88:01:9f:40:be brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-17T05:22:14.591 INFO:teuthology.orchestra.run.smithi167.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-17T05:22:14.592 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:14.592 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 fe80::8488:1ff:fe9f:40be/64 scope link tentative 2024-09-17T05:22:14.592 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:14.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:14.596 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-17T05:22:14.659 INFO:teuthology.orchestra.run.smithi167.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:22:14.660 INFO:teuthology.orchestra.run.smithi167.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:22:14.660 INFO:teuthology.orchestra.run.smithi167.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:22:14.660 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:14.660 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 ::1/128 scope host 2024-09-17T05:22:14.660 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:14.660 INFO:teuthology.orchestra.run.smithi167.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:22:14.660 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 86:88:01:9f:40:be brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-17T05:22:14.660 INFO:teuthology.orchestra.run.smithi167.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-17T05:22:14.660 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:14.660 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 fe80::8488:1ff:fe9f:40be/64 scope link tentative 2024-09-17T05:22:14.661 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:14.662 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-17T05:22:14.662 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:22:14.662 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2024-09-17T05:22:14.662 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-17T05:22:14.662 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-17T05:22:14.662 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-17T05:22:14.662 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-17T05:22:14.662 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-17T05:22:14.662 DEBUG:teuthology.orchestra.run.smithi167:> ') 2024-09-17T05:22:14.751 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:22:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:22:14.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:22:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:22:14.815 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:22:14.815 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2024-09-17T05:22:14.815 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link set brx.1 up 2024-09-17T05:22:14.815 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link set dev brx.1 master ceph-brx 2024-09-17T05:22:14.815 DEBUG:teuthology.orchestra.run.smithi167:> ') 2024-09-17T05:22:14.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:22:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:22:14.886 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:22:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:22:14.892 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:22:14.892 DEBUG:teuthology.orchestra.run.smithi167:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-17T05:22:14.907 INFO:teuthology.orchestra.run.smithi167.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-17T05:22:14.908 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:22:14.908 DEBUG:teuthology.orchestra.run.smithi167:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-17T05:22:14.963 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-09-17T05:22:14.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:14.964 DEBUG:teuthology.orchestra.run.smithi167:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:22:15.048 INFO:teuthology.orchestra.run.smithi167.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:22:15.048 INFO:teuthology.orchestra.run.smithi167.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:22:15.055 INFO:teuthology.orchestra.run.smithi167.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:22:15.055 INFO:teuthology.orchestra.run.smithi167.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:22:15.055 INFO:teuthology.orchestra.run.smithi167.stdout:mount.ceph: resolved to: "172.21.15.98:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-09-17T05:22:15.055 INFO:teuthology.orchestra.run.smithi167.stdout:mount.ceph: trying mount with new device syntax: 3@fcbf5a43-b3d8-497c-b15d-3cc022477cf0.cephfs=/ 2024-09-17T05:22:15.055 INFO:teuthology.orchestra.run.smithi167.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.98:3300/172.21.15.167:3300/172.21.15.167:3301" will pass to kernel 2024-09-17T05:22:15.056 INFO:teuthology.orchestra.run.smithi167.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-09-17T05:22:15.056 INFO:teuthology.orchestra.run.smithi167.stdout: You just mounted a file system that supports labels which does not 2024-09-17T05:22:15.056 INFO:teuthology.orchestra.run.smithi167.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T05:22:15.056 INFO:teuthology.orchestra.run.smithi167.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T05:22:15.056 INFO:teuthology.orchestra.run.smithi167.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T05:22:15.058 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:22:15.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:15.058 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-17T05:22:15.123 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:22:15.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:22:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:22:15.214 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:22:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:22:15.220 INFO:teuthology.orchestra.run.smithi167.stdout:client4469 2024-09-17T05:22:15.220 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-17T05:22:15.220 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:22:15.236 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:22:15.325 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:22:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:22:15.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:22:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:22:15.333 INFO:teuthology.orchestra.run.smithi167.stdout:client4469 2024-09-17T05:22:15.334 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:22:15.382 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:22:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:22:15.384 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:22:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:22:15.389 INFO:teuthology.orchestra.run.smithi167.stdout:client4469 2024-09-17T05:22:15.390 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/fcbf5a43-b3d8-497c-b15d-3cc022477cf0.client4469/status') 2024-09-17T05:22:15.437 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:22:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:22:15.447 INFO:teuthology.orchestra.run.smithi167.stdout:instance: client.4469 (3)192.168.0.2:0/3206047860 2024-09-17T05:22:15.447 INFO:teuthology.orchestra.run.smithi167.stdout:blocklisted: false 2024-09-17T05:22:15.448 INFO:teuthology.orchestra.run.smithi167.stderr:0+1 records in 2024-09-17T05:22:15.448 INFO:teuthology.orchestra.run.smithi167.stderr:0+1 records out 2024-09-17T05:22:15.448 INFO:teuthology.orchestra.run.smithi167.stderr:69 bytes copied, 3.7989e-05 s, 1.8 MB/s 2024-09-17T05:22:15.448 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:22:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:22:15.454 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-17T05:22:15.465 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-17T05:22:15.595 INFO:tasks.cephfs_test_runner:Starting test: test_volumes_module_finisher_thread (tasks.cephfs.test_volumes.TestPerModuleFinsherThread) 2024-09-17T05:22:15.595 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:22:15.709 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:15.708+0000 7f578ec9b640 1 -- 172.21.15.98:0/2093224351 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57880cf300 msgr2=0x7f57880729a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:15.710 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:15.708+0000 7f578ec9b640 1 --2- 172.21.15.98:0/2093224351 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57880cf300 0x7f57880729a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f577c009830 tx=0x7f577c02a5a0 comp rx=0 tx=0).stop 2024-09-17T05:22:15.710 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:15.708+0000 7f578ec9b640 1 -- 172.21.15.98:0/2093224351 shutdown_connections 2024-09-17T05:22:15.710 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:15.708+0000 7f578ec9b640 1 --2- 172.21.15.98:0/2093224351 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57880ccfd0 0x7f5788072ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:15.710 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:15.708+0000 7f578ec9b640 1 --2- 172.21.15.98:0/2093224351 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57880cf300 0x7f57880729a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:15.710 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:15.708+0000 7f578ec9b640 1 -- 172.21.15.98:0/2093224351 >> 172.21.15.98:0/2093224351 conn(0x7f57880b1950 msgr2=0x7f57880b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:15.710 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:15.708+0000 7f578ec9b640 1 -- 172.21.15.98:0/2093224351 shutdown_connections 2024-09-17T05:22:15.710 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:15.708+0000 7f578ec9b640 1 -- 172.21.15.98:0/2093224351 wait complete. 2024-09-17T05:22:15.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:15.710+0000 7f578ec9b640 1 Processor -- start 2024-09-17T05:22:15.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:15.710+0000 7f578ec9b640 1 -- start start 2024-09-17T05:22:15.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:15.710+0000 7f578ec9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57880ccfd0 0x7f578806fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:15.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:15.710+0000 7f578ec9b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57880cf300 0x7f57881f8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:15.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:15.711+0000 7f578ec9b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57881445d0 0x7f57881582e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:15.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:15.711+0000 7f578ec9b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5788073420 con 0x7f57880cf300 2024-09-17T05:22:15.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:15.711+0000 7f578ec9b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f57880b4eb0 con 0x7f57880ccfd0 2024-09-17T05:22:15.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:15.711+0000 7f578ec9b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f57880735a0 con 0x7f57881445d0 2024-09-17T05:22:15.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:15.711+0000 7f5787fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57880cf300 0x7f57881f8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:15.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:15.711+0000 7f5787fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57880cf300 0x7f57881f8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39928/0 (socket says 172.21.15.98:39928) 2024-09-17T05:22:15.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:15.711+0000 7f5787fff640 1 -- 172.21.15.98:0/3404555753 learned_addr learned my addr 172.21.15.98:0/3404555753 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:15.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:15.711+0000 7f578ca37640 1 --2- 172.21.15.98:0/3404555753 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57880ccfd0 0x7f578806fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:15.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:15.711+0000 7f578d238640 1 --2- 172.21.15.98:0/3404555753 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57881445d0 0x7f57881582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:15.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:15.711+0000 7f5787fff640 1 -- 172.21.15.98:0/3404555753 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57881445d0 msgr2=0x7f57881582e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:15.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:15.711+0000 7f5787fff640 1 --2- 172.21.15.98:0/3404555753 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57881445d0 0x7f57881582e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:15.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:15.711+0000 7f5787fff640 1 -- 172.21.15.98:0/3404555753 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57880ccfd0 msgr2=0x7f578806fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:15.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:15.711+0000 7f5787fff640 1 --2- 172.21.15.98:0/3404555753 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57880ccfd0 0x7f578806fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:15.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:15.711+0000 7f5787fff640 1 -- 172.21.15.98:0/3404555753 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f578806eb80 con 0x7f57880cf300 2024-09-17T05:22:15.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:15.711+0000 7f5787fff640 1 --2- 172.21.15.98:0/3404555753 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57880cf300 0x7f57881f8290 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f577c000c00 tx=0x7f577c032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:15.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:15.711+0000 7f57857fa640 1 -- 172.21.15.98:0/3404555753 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f577c040070 con 0x7f57880cf300 2024-09-17T05:22:15.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:15.711+0000 7f57857fa640 1 -- 172.21.15.98:0/3404555753 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f577c0038e0 con 0x7f57880cf300 2024-09-17T05:22:15.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:15.711+0000 7f578ec9b640 1 -- 172.21.15.98:0/3404555753 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f578806ee60 con 0x7f57880cf300 2024-09-17T05:22:15.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:15.711+0000 7f57857fa640 1 -- 172.21.15.98:0/3404555753 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f577c003d30 con 0x7f57880cf300 2024-09-17T05:22:15.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:15.711+0000 7f578ec9b640 1 -- 172.21.15.98:0/3404555753 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f578806f420 con 0x7f57880cf300 2024-09-17T05:22:15.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:15.713+0000 7f578ec9b640 1 -- 172.21.15.98:0/3404555753 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5788073a80 con 0x7f57880cf300 2024-09-17T05:22:15.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:15.713+0000 7f57857fa640 1 -- 172.21.15.98:0/3404555753 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f577c039040 con 0x7f57880cf300 2024-09-17T05:22:15.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:15.714+0000 7f57857fa640 1 --2- 172.21.15.98:0/3404555753 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f5774078b90 0x7f577407b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:15.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:15.714+0000 7f57857fa640 1 -- 172.21.15.98:0/3404555753 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f577c0bc230 con 0x7f57880cf300 2024-09-17T05:22:15.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:15.714+0000 7f578ca37640 1 --2- 172.21.15.98:0/3404555753 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f5774078b90 0x7f577407b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:15.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:15.714+0000 7f578ca37640 1 --2- 172.21.15.98:0/3404555753 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f5774078b90 0x7f577407b050 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5778000f60 tx=0x7f5778009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:15.718 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:15.718+0000 7f57857fa640 1 -- 172.21.15.98:0/3404555753 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f577c084140 con 0x7f57880cf300 2024-09-17T05:22:15.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:15.895+0000 7f578ec9b640 1 -- 172.21.15.98:0/3404555753 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5788070a20 con 0x7f57880cf300 2024-09-17T05:22:15.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:15.896+0000 7f57857fa640 1 -- 172.21.15.98:0/3404555753 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16653 (secure 0 0 0) 0x7f577c088b70 con 0x7f57880cf300 2024-09-17T05:22:15.897 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:22:15.897 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":21,"fsid":"fcbf5a43-b3d8-497c-b15d-3cc022477cf0","created":"2024-09-17T05:21:29.852143+0000","modified":"2024-09-17T05:21:55.491401+0000","last_up_change":"2024-09-17T05:21:42.925756+0000","last_in_change":"2024-09-17T05:21:32.893880+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:21:42.263011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:21:51.665719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T05:21:52.780673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ad711a-df74-438b-b0dc-1499d685c958","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6825","nonce":3644101529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6827","nonce":3644101529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6831","nonce":3644101529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6829","nonce":3644101529}]},"public_addr":"172.21.15.98:6825/3644101529","cluster_addr":"172.21.15.98:6827/3644101529","heartbeat_back_addr":"172.21.15.98:6831/3644101529","heartbeat_front_addr":"172.21.15.98:6829/3644101529","state":["exists","up"]},{"osd":1,"uuid":"f0ccb08d-4d8d-47b8-9320-8c372a6605b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6817","nonce":3902180920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6819","nonce":3902180920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6823","nonce":3902180920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6821","nonce":3902180920}]},"public_addr":"172.21.15.98:6817/3902180920","cluster_addr":"172.21.15.98:6819/3902180920","heartbeat_back_addr":"172.21.15.98:6823/3902180920","heartbeat_front_addr":"172.21.15.98:6821/3902180920","state":["exists","up"]},{"osd":2,"uuid":"a0985398-5e5f-494f-8abf-f785f19e94ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6801","nonce":1518887101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6803","nonce":1518887101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6807","nonce":1518887101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6805","nonce":1518887101}]},"public_addr":"172.21.15.98:6801/1518887101","cluster_addr":"172.21.15.98:6803/1518887101","heartbeat_back_addr":"172.21.15.98:6807/1518887101","heartbeat_front_addr":"172.21.15.98:6805/1518887101","state":["exists","up"]},{"osd":3,"uuid":"e960be2e-0c3a-426e-9507-d3be5895f9e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6809","nonce":4125246091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6811","nonce":4125246091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6815","nonce":4125246091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6813","nonce":4125246091}]},"public_addr":"172.21.15.98:6809/4125246091","cluster_addr":"172.21.15.98:6811/4125246091","heartbeat_back_addr":"172.21.15.98:6815/4125246091","heartbeat_front_addr":"172.21.15.98:6813/4125246091","state":["exists","up"]},{"osd":4,"uuid":"49118c00-3dc1-43ef-8ed4-aca61e56a507","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6811","nonce":765789888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6813","nonce":765789888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6817","nonce":765789888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6815","nonce":765789888}]},"public_addr":"172.21.15.167:6811/765789888","cluster_addr":"172.21.15.167:6813/765789888","heartbeat_back_addr":"172.21.15.167:6817/765789888","heartbeat_front_addr":"172.21.15.167:6815/765789888","state":["exists","up"]},{"osd":5,"uuid":"9f4e0143-2b3d-40e4-bfb5-043d9a9f4ba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6803","nonce":2567019914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6805","nonce":2567019914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6809","nonce":2567019914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6807","nonce":2567019914}]},"public_addr":"172.21.15.167:6803/2567019914","cluster_addr":"172.21.15.167:6805/2567019914","heartbeat_back_addr":"172.21.15.167:6809/2567019914","heartbeat_front_addr":"172.21.15.167:6807/2567019914","state":["exists","up"]},{"osd":6,"uuid":"28720514-e627-4dea-8f4d-bd311ec31361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6819","nonce":96262631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6821","nonce":96262631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6825","nonce":96262631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6823","nonce":96262631}]},"public_addr":"172.21.15.167:6819/96262631","cluster_addr":"172.21.15.167:6821/96262631","heartbeat_back_addr":"172.21.15.167:6825/96262631","heartbeat_front_addr":"172.21.15.167:6823/96262631","state":["exists","up"]},{"osd":7,"uuid":"01edaf9c-3898-406e-85b0-774cfda60adf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6827","nonce":4169560909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6829","nonce":4169560909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6833","nonce":4169560909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6831","nonce":4169560909}]},"public_addr":"172.21.15.167:6827/4169560909","cluster_addr":"172.21.15.167:6829/4169560909","heartbeat_back_addr":"172.21.15.167:6833/4169560909","heartbeat_front_addr":"172.21.15.167:6831/4169560909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:40.054920+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.177110+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.749278+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.400155+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.503576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.196417+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.371063+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.212852+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:22:15.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:15.899+0000 7f578ec9b640 1 -- 172.21.15.98:0/3404555753 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f5774078b90 msgr2=0x7f577407b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:15.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:15.899+0000 7f578ec9b640 1 --2- 172.21.15.98:0/3404555753 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f5774078b90 0x7f577407b050 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5778000f60 tx=0x7f5778009040 comp rx=0 tx=0).stop 2024-09-17T05:22:15.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:15.899+0000 7f578ec9b640 1 -- 172.21.15.98:0/3404555753 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57880cf300 msgr2=0x7f57881f8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:15.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:15.899+0000 7f578ec9b640 1 --2- 172.21.15.98:0/3404555753 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57880cf300 0x7f57881f8290 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f577c000c00 tx=0x7f577c032c10 comp rx=0 tx=0).stop 2024-09-17T05:22:15.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:15.899+0000 7f578ec9b640 1 -- 172.21.15.98:0/3404555753 shutdown_connections 2024-09-17T05:22:15.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:15.899+0000 7f578ec9b640 1 --2- 172.21.15.98:0/3404555753 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f5774078b90 0x7f577407b050 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:15.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:15.899+0000 7f578ec9b640 1 --2- 172.21.15.98:0/3404555753 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57881445d0 0x7f57881582e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:15.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:15.899+0000 7f578ec9b640 1 --2- 172.21.15.98:0/3404555753 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57880cf300 0x7f57881f8290 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:15.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:15.899+0000 7f578ec9b640 1 --2- 172.21.15.98:0/3404555753 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57880ccfd0 0x7f578806fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:15.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:15.899+0000 7f578ec9b640 1 -- 172.21.15.98:0/3404555753 >> 172.21.15.98:0/3404555753 conn(0x7f57880b1950 msgr2=0x7f57880adf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:15.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:15.899+0000 7f578ec9b640 1 -- 172.21.15.98:0/3404555753 shutdown_connections 2024-09-17T05:22:15.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:15.899+0000 7f578ec9b640 1 -- 172.21.15.98:0/3404555753 wait complete. 2024-09-17T05:22:15.911 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T05:21:42.263011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-17T05:21:51.665719+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-17T05:21:52.780673+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T05:22:15.911 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T05:22:16.016 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.014+0000 7fc6ef462640 1 -- 172.21.15.98:0/2790971643 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6e8145750 msgr2=0x7fc6e8073440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:16.016 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.014+0000 7fc6ef462640 1 --2- 172.21.15.98:0/2790971643 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6e8145750 0x7fc6e8073440 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc6e80cfb70 tx=0x7fc6e402a980 comp rx=0 tx=0).stop 2024-09-17T05:22:16.016 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.014+0000 7fc6ef462640 1 -- 172.21.15.98:0/2790971643 shutdown_connections 2024-09-17T05:22:16.016 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.014+0000 7fc6ef462640 1 --2- 172.21.15.98:0/2790971643 >> v2:172.21.15.167:3300/0 conn(0x7fc6e80cccd0 0x7fc6e80cdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:16.016 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.014+0000 7fc6ef462640 1 --2- 172.21.15.98:0/2790971643 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6e8145750 0x7fc6e8073440 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:16.016 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.014+0000 7fc6ef462640 1 -- 172.21.15.98:0/2790971643 >> 172.21.15.98:0/2790971643 conn(0x7fc6e80b1840 msgr2=0x7fc6e80b1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:16.016 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.014+0000 7fc6ef462640 1 -- 172.21.15.98:0/2790971643 shutdown_connections 2024-09-17T05:22:16.016 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.014+0000 7fc6ef462640 1 -- 172.21.15.98:0/2790971643 wait complete. 2024-09-17T05:22:16.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.015+0000 7fc6ef462640 1 Processor -- start 2024-09-17T05:22:16.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.016+0000 7fc6ef462640 1 -- start start 2024-09-17T05:22:16.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.016+0000 7fc6ef462640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6e806efa0 0x7fc6e815ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:16.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.016+0000 7fc6ef462640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc6e80cccd0 0x7fc6e813bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:16.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.016+0000 7fc6ef462640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6e8145750 0x7fc6e8140c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:16.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.016+0000 7fc6ef462640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc6e80ce480 con 0x7fc6e8145750 2024-09-17T05:22:16.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.016+0000 7fc6ef462640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc6e80ce300 con 0x7fc6e806efa0 2024-09-17T05:22:16.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.016+0000 7fc6ef462640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fc6e80ce600 con 0x7fc6e80cccd0 2024-09-17T05:22:16.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.016+0000 7fc6ed9ff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6e8145750 0x7fc6e8140c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:16.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.016+0000 7fc6ed9ff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6e8145750 0x7fc6e8140c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39958/0 (socket says 172.21.15.98:39958) 2024-09-17T05:22:16.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.016+0000 7fc6ed9ff640 1 -- 172.21.15.98:0/3224175426 learned_addr learned my addr 172.21.15.98:0/3224175426 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:16.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.016+0000 7fc6ed1fe640 1 --2- 172.21.15.98:0/3224175426 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6e806efa0 0x7fc6e815ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:16.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.016+0000 7fc6ec9fd640 1 --2- 172.21.15.98:0/3224175426 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc6e80cccd0 0x7fc6e813bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:16.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.017+0000 7fc6ed9ff640 1 -- 172.21.15.98:0/3224175426 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc6e80cccd0 msgr2=0x7fc6e813bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:16.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.017+0000 7fc6ed9ff640 1 --2- 172.21.15.98:0/3224175426 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc6e80cccd0 0x7fc6e813bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:16.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.017+0000 7fc6ed9ff640 1 -- 172.21.15.98:0/3224175426 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6e806efa0 msgr2=0x7fc6e815ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:16.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.017+0000 7fc6ed9ff640 1 --2- 172.21.15.98:0/3224175426 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6e806efa0 0x7fc6e815ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:16.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.017+0000 7fc6ed9ff640 1 -- 172.21.15.98:0/3224175426 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6e813c480 con 0x7fc6e8145750 2024-09-17T05:22:16.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.017+0000 7fc6ed9ff640 1 --2- 172.21.15.98:0/3224175426 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6e8145750 0x7fc6e8140c40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc6e000d740 tx=0x7fc6e000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:16.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.017+0000 7fc6ddffb640 1 -- 172.21.15.98:0/3224175426 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e0017070 con 0x7fc6e8145750 2024-09-17T05:22:16.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.017+0000 7fc6ddffb640 1 -- 172.21.15.98:0/3224175426 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc6e0009d20 con 0x7fc6e8145750 2024-09-17T05:22:16.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.017+0000 7fc6ef462640 1 -- 172.21.15.98:0/3224175426 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6e8141180 con 0x7fc6e8145750 2024-09-17T05:22:16.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.017+0000 7fc6ddffb640 1 -- 172.21.15.98:0/3224175426 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e0004280 con 0x7fc6e8145750 2024-09-17T05:22:16.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.017+0000 7fc6ef462640 1 -- 172.21.15.98:0/3224175426 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6e8141710 con 0x7fc6e8145750 2024-09-17T05:22:16.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.018+0000 7fc6ef462640 1 -- 172.21.15.98:0/3224175426 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6e80cdbb0 con 0x7fc6e8145750 2024-09-17T05:22:16.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.019+0000 7fc6ddffb640 1 -- 172.21.15.98:0/3224175426 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc6e00035f0 con 0x7fc6e8145750 2024-09-17T05:22:16.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.019+0000 7fc6ddffb640 1 --2- 172.21.15.98:0/3224175426 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fc6cc078b90 0x7fc6cc07b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:16.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.019+0000 7fc6ddffb640 1 -- 172.21.15.98:0/3224175426 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc6e009ad80 con 0x7fc6e8145750 2024-09-17T05:22:16.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.019+0000 7fc6ed1fe640 1 --2- 172.21.15.98:0/3224175426 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fc6cc078b90 0x7fc6cc07b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:16.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.020+0000 7fc6ed1fe640 1 --2- 172.21.15.98:0/3224175426 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fc6cc078b90 0x7fc6cc07b050 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4035000 tx=0x7fc6e4004ab0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:16.024 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.023+0000 7fc6ddffb640 1 -- 172.21.15.98:0/3224175426 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fc6e0062c00 con 0x7fc6e8145750 2024-09-17T05:22:16.200 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.199+0000 7fc6ef462640 1 -- 172.21.15.98:0/3224175426 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc6e80cf5f0 con 0x7fc6e8145750 2024-09-17T05:22:16.200 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.199+0000 7fc6ddffb640 1 -- 172.21.15.98:0/3224175426 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7fc6e0067630 con 0x7fc6e8145750 2024-09-17T05:22:16.200 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 1 2024-09-17T05:22:16.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.201+0000 7fc6ef462640 1 -- 172.21.15.98:0/3224175426 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fc6cc078b90 msgr2=0x7fc6cc07b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:16.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.201+0000 7fc6ef462640 1 --2- 172.21.15.98:0/3224175426 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fc6cc078b90 0x7fc6cc07b050 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4035000 tx=0x7fc6e4004ab0 comp rx=0 tx=0).stop 2024-09-17T05:22:16.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.201+0000 7fc6ef462640 1 -- 172.21.15.98:0/3224175426 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6e8145750 msgr2=0x7fc6e8140c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:16.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.201+0000 7fc6ef462640 1 --2- 172.21.15.98:0/3224175426 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6e8145750 0x7fc6e8140c40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc6e000d740 tx=0x7fc6e000dc00 comp rx=0 tx=0).stop 2024-09-17T05:22:16.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.201+0000 7fc6ef462640 1 -- 172.21.15.98:0/3224175426 shutdown_connections 2024-09-17T05:22:16.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.201+0000 7fc6ef462640 1 --2- 172.21.15.98:0/3224175426 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fc6cc078b90 0x7fc6cc07b050 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:16.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.201+0000 7fc6ef462640 1 --2- 172.21.15.98:0/3224175426 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6e8145750 0x7fc6e8140c40 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:16.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.201+0000 7fc6ef462640 1 --2- 172.21.15.98:0/3224175426 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc6e80cccd0 0x7fc6e813bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:16.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.201+0000 7fc6ef462640 1 --2- 172.21.15.98:0/3224175426 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6e806efa0 0x7fc6e815ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:16.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.201+0000 7fc6ef462640 1 -- 172.21.15.98:0/3224175426 >> 172.21.15.98:0/3224175426 conn(0x7fc6e80b1840 msgr2=0x7fc6e806f410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:16.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.201+0000 7fc6ef462640 1 -- 172.21.15.98:0/3224175426 shutdown_connections 2024-09-17T05:22:16.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.201+0000 7fc6ef462640 1 -- 172.21.15.98:0/3224175426 wait complete. 2024-09-17T05:22:16.213 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-17T05:22:16.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.315+0000 7f13dfca9640 1 -- 172.21.15.98:0/934787268 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13d815f090 msgr2=0x7f13d80cf120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:16.318 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.315+0000 7f13dfca9640 1 --2- 172.21.15.98:0/934787268 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13d815f090 0x7f13d80cf120 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f13d806db10 tx=0x7f13d002aac0 comp rx=0 tx=0).stop 2024-09-17T05:22:16.318 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.315+0000 7f13dfca9640 1 -- 172.21.15.98:0/934787268 shutdown_connections 2024-09-17T05:22:16.318 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.315+0000 7f13dfca9640 1 --2- 172.21.15.98:0/934787268 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13d815f090 0x7f13d80cf120 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:16.318 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.315+0000 7f13dfca9640 1 --2- 172.21.15.98:0/934787268 >> v2:172.21.15.167:3300/0 conn(0x7f13d80b3370 0x7f13d80cebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:16.318 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.315+0000 7f13dfca9640 1 -- 172.21.15.98:0/934787268 >> 172.21.15.98:0/934787268 conn(0x7f13d80b1840 msgr2=0x7f13d80b1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:16.319 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.316+0000 7f13dfca9640 1 -- 172.21.15.98:0/934787268 shutdown_connections 2024-09-17T05:22:16.319 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.316+0000 7f13dfca9640 1 -- 172.21.15.98:0/934787268 wait complete. 2024-09-17T05:22:16.319 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.317+0000 7f13dfca9640 1 Processor -- start 2024-09-17T05:22:16.319 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.317+0000 7f13dfca9640 1 -- start start 2024-09-17T05:22:16.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.317+0000 7f13dfca9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13d80b3370 0x7f13d81f4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:16.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.317+0000 7f13dfca9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13d815c080 0x7f13d8138850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:16.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.317+0000 7f13dfca9640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f13d815f090 0x7f13d8163e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:16.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.317+0000 7f13dfca9640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f13d8164e20 con 0x7f13d80b3370 2024-09-17T05:22:16.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.317+0000 7f13dfca9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f13d8164ca0 con 0x7f13d815c080 2024-09-17T05:22:16.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.317+0000 7f13dfca9640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f13d8164fa0 con 0x7f13d815f090 2024-09-17T05:22:16.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.318+0000 7f13dda45640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13d80b3370 0x7f13d81f4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:16.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.318+0000 7f13dda45640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13d80b3370 0x7f13d81f4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35992/0 (socket says 172.21.15.98:35992) 2024-09-17T05:22:16.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.318+0000 7f13dda45640 1 -- 172.21.15.98:0/2239671395 learned_addr learned my addr 172.21.15.98:0/2239671395 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:16.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.318+0000 7f13dda45640 1 -- 172.21.15.98:0/2239671395 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f13d815f090 msgr2=0x7f13d8163e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:16.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.318+0000 7f13dda45640 1 --2- 172.21.15.98:0/2239671395 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f13d815f090 0x7f13d8163e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:16.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.318+0000 7f13dda45640 1 -- 172.21.15.98:0/2239671395 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13d815c080 msgr2=0x7f13d8138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:16.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.318+0000 7f13dda45640 1 --2- 172.21.15.98:0/2239671395 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13d815c080 0x7f13d8138850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:16.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.318+0000 7f13dda45640 1 -- 172.21.15.98:0/2239671395 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13d8137180 con 0x7f13d80b3370 2024-09-17T05:22:16.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.318+0000 7f13dda45640 1 --2- 172.21.15.98:0/2239671395 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13d80b3370 0x7f13d81f4930 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f13d400c890 tx=0x7f13d400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:16.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.318+0000 7f13ce7fc640 1 -- 172.21.15.98:0/2239671395 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d4004220 con 0x7f13d80b3370 2024-09-17T05:22:16.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.318+0000 7f13ce7fc640 1 -- 172.21.15.98:0/2239671395 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f13d40079b0 con 0x7f13d80b3370 2024-09-17T05:22:16.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.318+0000 7f13dfca9640 1 -- 172.21.15.98:0/2239671395 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13d813ae50 con 0x7f13d80b3370 2024-09-17T05:22:16.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.318+0000 7f13ce7fc640 1 -- 172.21.15.98:0/2239671395 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d4007de0 con 0x7f13d80b3370 2024-09-17T05:22:16.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.318+0000 7f13dfca9640 1 -- 172.21.15.98:0/2239671395 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13d8138330 con 0x7f13d80b3370 2024-09-17T05:22:16.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.319+0000 7f13dfca9640 1 -- 172.21.15.98:0/2239671395 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13d815e980 con 0x7f13d80b3370 2024-09-17T05:22:16.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.320+0000 7f13ce7fc640 1 -- 172.21.15.98:0/2239671395 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f13d4005020 con 0x7f13d80b3370 2024-09-17T05:22:16.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.320+0000 7f13ce7fc640 1 --2- 172.21.15.98:0/2239671395 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f13bc078b90 0x7f13bc07b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:16.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.320+0000 7f13ce7fc640 1 -- 172.21.15.98:0/2239671395 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f13d409b110 con 0x7f13d80b3370 2024-09-17T05:22:16.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.321+0000 7f13dd244640 1 --2- 172.21.15.98:0/2239671395 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f13bc078b90 0x7f13bc07b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:16.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.321+0000 7f13dd244640 1 --2- 172.21.15.98:0/2239671395 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f13bc078b90 0x7f13bc07b050 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f13c80013f0 tx=0x7f13c8001360 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:16.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.324+0000 7f13ce7fc640 1 -- 172.21.15.98:0/2239671395 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f13d4014030 con 0x7f13d80b3370 2024-09-17T05:22:16.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.503+0000 7f13dfca9640 1 -- 172.21.15.98:0/2239671395 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f13d815cc20 con 0x7f13d80b3370 2024-09-17T05:22:16.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.503+0000 7f13ce7fc640 1 -- 172.21.15.98:0/2239671395 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f13d4063670 con 0x7f13d80b3370 2024-09-17T05:22:16.504 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 32 2024-09-17T05:22:16.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.505+0000 7f13dfca9640 1 -- 172.21.15.98:0/2239671395 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f13bc078b90 msgr2=0x7f13bc07b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:16.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.505+0000 7f13dfca9640 1 --2- 172.21.15.98:0/2239671395 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f13bc078b90 0x7f13bc07b050 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f13c80013f0 tx=0x7f13c8001360 comp rx=0 tx=0).stop 2024-09-17T05:22:16.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.505+0000 7f13dfca9640 1 -- 172.21.15.98:0/2239671395 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13d80b3370 msgr2=0x7f13d81f4930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:16.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.505+0000 7f13dfca9640 1 --2- 172.21.15.98:0/2239671395 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13d80b3370 0x7f13d81f4930 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f13d400c890 tx=0x7f13d400cd50 comp rx=0 tx=0).stop 2024-09-17T05:22:16.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.505+0000 7f13dfca9640 1 -- 172.21.15.98:0/2239671395 shutdown_connections 2024-09-17T05:22:16.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.505+0000 7f13dfca9640 1 --2- 172.21.15.98:0/2239671395 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f13bc078b90 0x7f13bc07b050 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:16.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.505+0000 7f13dfca9640 1 --2- 172.21.15.98:0/2239671395 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f13d815f090 0x7f13d8163e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:16.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.505+0000 7f13dfca9640 1 --2- 172.21.15.98:0/2239671395 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13d815c080 0x7f13d8138850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:16.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.505+0000 7f13dfca9640 1 --2- 172.21.15.98:0/2239671395 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13d80b3370 0x7f13d81f4930 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:16.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.505+0000 7f13dfca9640 1 -- 172.21.15.98:0/2239671395 >> 172.21.15.98:0/2239671395 conn(0x7f13d80b1840 msgr2=0x7f13d813b530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:16.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.506+0000 7f13dfca9640 1 -- 172.21.15.98:0/2239671395 shutdown_connections 2024-09-17T05:22:16.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.506+0000 7f13dfca9640 1 -- 172.21.15.98:0/2239671395 wait complete. 2024-09-17T05:22:16.517 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-17T05:22:16.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.622+0000 7f28ba1ad640 1 -- 172.21.15.98:0/2622252164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28b40b5630 msgr2=0x7f28b40cf5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:16.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.622+0000 7f28ba1ad640 1 --2- 172.21.15.98:0/2622252164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28b40b5630 0x7f28b40cf5b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f289c005fd0 tx=0x7f289c02a5d0 comp rx=0 tx=0).stop 2024-09-17T05:22:16.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.622+0000 7f28ba1ad640 1 -- 172.21.15.98:0/2622252164 shutdown_connections 2024-09-17T05:22:16.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.622+0000 7f28ba1ad640 1 --2- 172.21.15.98:0/2622252164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28b40cfaf0 0x7f28b40d2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:16.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.622+0000 7f28ba1ad640 1 --2- 172.21.15.98:0/2622252164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28b40b5630 0x7f28b40cf5b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:16.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.622+0000 7f28ba1ad640 1 -- 172.21.15.98:0/2622252164 >> 172.21.15.98:0/2622252164 conn(0x7f28b40d3fb0 msgr2=0x7f28b40d43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:16.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.622+0000 7f28ba1ad640 1 -- 172.21.15.98:0/2622252164 shutdown_connections 2024-09-17T05:22:16.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.622+0000 7f28ba1ad640 1 -- 172.21.15.98:0/2622252164 wait complete. 2024-09-17T05:22:16.624 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.623+0000 7f28ba1ad640 1 Processor -- start 2024-09-17T05:22:16.624 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.623+0000 7f28ba1ad640 1 -- start start 2024-09-17T05:22:16.626 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.624+0000 7f28ba1ad640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28b40b5630 0x7f28b41554d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:16.626 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.624+0000 7f28ba1ad640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28b40cfaf0 0x7f28b40a0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:16.626 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.624+0000 7f28ba1ad640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28b4161590 0x7f28b40b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:16.626 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.624+0000 7f28ba1ad640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f28b40d26f0 con 0x7f28b4161590 2024-09-17T05:22:16.626 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.624+0000 7f28ba1ad640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f28b40d2570 con 0x7f28b40b5630 2024-09-17T05:22:16.626 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.624+0000 7f28ba1ad640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f28b40d2870 con 0x7f28b40cfaf0 2024-09-17T05:22:16.626 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.624+0000 7f28b3fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28b4161590 0x7f28b40b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:16.626 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.624+0000 7f28b3fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28b4161590 0x7f28b40b1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36004/0 (socket says 172.21.15.98:36004) 2024-09-17T05:22:16.626 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.624+0000 7f28b3fff640 1 -- 172.21.15.98:0/4223253928 learned_addr learned my addr 172.21.15.98:0/4223253928 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:16.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.624+0000 7f28b3fff640 1 -- 172.21.15.98:0/4223253928 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28b40cfaf0 msgr2=0x7f28b40a0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:16.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.624+0000 7f28aaffd640 1 --2- 172.21.15.98:0/4223253928 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28b40cfaf0 0x7f28b40a0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:16.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.624+0000 7f28b37fe640 1 --2- 172.21.15.98:0/4223253928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28b40b5630 0x7f28b41554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:16.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.624+0000 7f28b3fff640 1 --2- 172.21.15.98:0/4223253928 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28b40cfaf0 0x7f28b40a0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:16.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.624+0000 7f28b3fff640 1 -- 172.21.15.98:0/4223253928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28b40b5630 msgr2=0x7f28b41554d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:16.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.624+0000 7f28b3fff640 1 --2- 172.21.15.98:0/4223253928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28b40b5630 0x7f28b41554d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:16.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.624+0000 7f28b3fff640 1 -- 172.21.15.98:0/4223253928 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28b40b1b30 con 0x7f28b4161590 2024-09-17T05:22:16.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.624+0000 7f28b37fe640 1 --2- 172.21.15.98:0/4223253928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28b40b5630 0x7f28b41554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:22:16.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.624+0000 7f28b3fff640 1 --2- 172.21.15.98:0/4223253928 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28b4161590 0x7f28b40b1d90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f28ac00eb40 tx=0x7f28ac00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:16.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.624+0000 7f28b0ff9640 1 -- 172.21.15.98:0/4223253928 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28ac004b20 con 0x7f28b4161590 2024-09-17T05:22:16.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.624+0000 7f28b0ff9640 1 -- 172.21.15.98:0/4223253928 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f28ac004ce0 con 0x7f28b4161590 2024-09-17T05:22:16.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.625+0000 7f28ba1ad640 1 -- 172.21.15.98:0/4223253928 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28b40b0d70 con 0x7f28b4161590 2024-09-17T05:22:16.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.625+0000 7f28b0ff9640 1 -- 172.21.15.98:0/4223253928 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28ac005280 con 0x7f28b4161590 2024-09-17T05:22:16.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.625+0000 7f28ba1ad640 1 -- 172.21.15.98:0/4223253928 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28b40b1330 con 0x7f28b4161590 2024-09-17T05:22:16.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.626+0000 7f28ba1ad640 1 -- 172.21.15.98:0/4223253928 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28b40d2d90 con 0x7f28b4161590 2024-09-17T05:22:16.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.626+0000 7f28b0ff9640 1 -- 172.21.15.98:0/4223253928 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f28ac005420 con 0x7f28b4161590 2024-09-17T05:22:16.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.627+0000 7f28b0ff9640 1 --2- 172.21.15.98:0/4223253928 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f2894078bc0 0x7f289407b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:16.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.627+0000 7f28b0ff9640 1 -- 172.21.15.98:0/4223253928 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f28ac09b9c0 con 0x7f28b4161590 2024-09-17T05:22:16.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.627+0000 7f28b37fe640 1 --2- 172.21.15.98:0/4223253928 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f2894078bc0 0x7f289407b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:16.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.628+0000 7f28b37fe640 1 --2- 172.21.15.98:0/4223253928 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f2894078bc0 0x7f289407b080 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f28a4001660 tx=0x7f28a4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:16.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.631+0000 7f28b0ff9640 1 -- 172.21.15.98:0/4223253928 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f28ac09de20 con 0x7f28b4161590 2024-09-17T05:22:16.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.807+0000 7f28ba1ad640 1 -- 172.21.15.98:0/4223253928 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f28b40b9f30 con 0x7f28b4161590 2024-09-17T05:22:16.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.807+0000 7f28b0ff9640 1 -- 172.21.15.98:0/4223253928 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f28ac063f20 con 0x7f28b4161590 2024-09-17T05:22:16.809 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 64 2024-09-17T05:22:16.811 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.809+0000 7f28ba1ad640 1 -- 172.21.15.98:0/4223253928 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f2894078bc0 msgr2=0x7f289407b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:16.811 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.809+0000 7f28ba1ad640 1 --2- 172.21.15.98:0/4223253928 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f2894078bc0 0x7f289407b080 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f28a4001660 tx=0x7f28a4009040 comp rx=0 tx=0).stop 2024-09-17T05:22:16.811 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.809+0000 7f28ba1ad640 1 -- 172.21.15.98:0/4223253928 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28b4161590 msgr2=0x7f28b40b1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:16.811 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.810+0000 7f28ba1ad640 1 --2- 172.21.15.98:0/4223253928 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28b4161590 0x7f28b40b1d90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f28ac00eb40 tx=0x7f28ac00c2d0 comp rx=0 tx=0).stop 2024-09-17T05:22:16.811 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.810+0000 7f28ba1ad640 1 -- 172.21.15.98:0/4223253928 shutdown_connections 2024-09-17T05:22:16.811 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.810+0000 7f28ba1ad640 1 --2- 172.21.15.98:0/4223253928 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f2894078bc0 0x7f289407b080 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:16.811 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.810+0000 7f28ba1ad640 1 --2- 172.21.15.98:0/4223253928 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28b4161590 0x7f28b40b1d90 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:16.811 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.810+0000 7f28ba1ad640 1 --2- 172.21.15.98:0/4223253928 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28b40cfaf0 0x7f28b40a0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:16.811 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.810+0000 7f28ba1ad640 1 --2- 172.21.15.98:0/4223253928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28b40b5630 0x7f28b41554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:16.811 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.810+0000 7f28ba1ad640 1 -- 172.21.15.98:0/4223253928 >> 172.21.15.98:0/4223253928 conn(0x7f28b40d3fb0 msgr2=0x7f28b406d490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:16.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.810+0000 7f28ba1ad640 1 -- 172.21.15.98:0/4223253928 shutdown_connections 2024-09-17T05:22:16.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.810+0000 7f28ba1ad640 1 -- 172.21.15.98:0/4223253928 wait complete. 2024-09-17T05:22:16.821 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread' 2024-09-17T05:22:16.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.922+0000 7f46f5ba3640 1 -- 172.21.15.98:0/1791390011 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46f00d1610 msgr2=0x7f46f00cecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:16.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.922+0000 7f46f5ba3640 1 --2- 172.21.15.98:0/1791390011 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46f00d1610 0x7f46f00cecc0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f46e8005fd0 tx=0x7f46e802aa90 comp rx=0 tx=0).stop 2024-09-17T05:22:16.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.922+0000 7f46f5ba3640 1 -- 172.21.15.98:0/1791390011 shutdown_connections 2024-09-17T05:22:16.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.922+0000 7f46f5ba3640 1 --2- 172.21.15.98:0/1791390011 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46f00d1610 0x7f46f00cecc0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:16.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.922+0000 7f46f5ba3640 1 --2- 172.21.15.98:0/1791390011 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46f015e0d0 0x7f46f00d09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:16.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.922+0000 7f46f5ba3640 1 -- 172.21.15.98:0/1791390011 >> 172.21.15.98:0/1791390011 conn(0x7f46f00d3fe0 msgr2=0x7f46f00d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:16.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.922+0000 7f46f5ba3640 1 -- 172.21.15.98:0/1791390011 shutdown_connections 2024-09-17T05:22:16.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.922+0000 7f46f5ba3640 1 -- 172.21.15.98:0/1791390011 wait complete. 2024-09-17T05:22:16.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.923+0000 7f46f5ba3640 1 Processor -- start 2024-09-17T05:22:16.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.924+0000 7f46f5ba3640 1 -- start start 2024-09-17T05:22:16.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.924+0000 7f46f5ba3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46f00d1610 0x7f46f00ca680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:16.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.924+0000 7f46f5ba3640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46f00d2050 0x7f46f00b5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:16.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.924+0000 7f46f5ba3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46f015e0d0 0x7f46f01f4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:16.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.924+0000 7f46f5ba3640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f46f00cf590 con 0x7f46f00d1610 2024-09-17T05:22:16.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.924+0000 7f46f5ba3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f46f00cf410 con 0x7f46f015e0d0 2024-09-17T05:22:16.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.924+0000 7f46f5ba3640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f46f00cf710 con 0x7f46f00d2050 2024-09-17T05:22:16.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.924+0000 7f46ef7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46f00d1610 0x7f46f00ca680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:16.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.924+0000 7f46ef7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46f00d1610 0x7f46f00ca680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36014/0 (socket says 172.21.15.98:36014) 2024-09-17T05:22:16.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.924+0000 7f46ef7fe640 1 -- 172.21.15.98:0/2371980053 learned_addr learned my addr 172.21.15.98:0/2371980053 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:16.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.925+0000 7f46e6ffd640 1 --2- 172.21.15.98:0/2371980053 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46f00d2050 0x7f46f00b5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:16.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.925+0000 7f46effff640 1 --2- 172.21.15.98:0/2371980053 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46f015e0d0 0x7f46f01f4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:16.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.925+0000 7f46ef7fe640 1 -- 172.21.15.98:0/2371980053 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46f00d2050 msgr2=0x7f46f00b5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:16.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.925+0000 7f46ef7fe640 1 --2- 172.21.15.98:0/2371980053 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46f00d2050 0x7f46f00b5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:16.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.925+0000 7f46ef7fe640 1 -- 172.21.15.98:0/2371980053 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46f015e0d0 msgr2=0x7f46f01f4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:16.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.925+0000 7f46ef7fe640 1 --2- 172.21.15.98:0/2371980053 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46f015e0d0 0x7f46f01f4470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:16.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.925+0000 7f46ef7fe640 1 -- 172.21.15.98:0/2371980053 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46f00b5bf0 con 0x7f46f00d1610 2024-09-17T05:22:16.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.925+0000 7f46e6ffd640 1 --2- 172.21.15.98:0/2371980053 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46f00d2050 0x7f46f00b5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:22:16.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.925+0000 7f46ef7fe640 1 --2- 172.21.15.98:0/2371980053 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46f00d1610 0x7f46f00ca680 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f46e000c970 tx=0x7f46e000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:16.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.925+0000 7f46ecff9640 1 -- 172.21.15.98:0/2371980053 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e0007b50 con 0x7f46f00d1610 2024-09-17T05:22:16.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.925+0000 7f46ecff9640 1 -- 172.21.15.98:0/2371980053 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f46e0007de0 con 0x7f46f00d1610 2024-09-17T05:22:16.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.925+0000 7f46f5ba3640 1 -- 172.21.15.98:0/2371980053 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46f00b5ed0 con 0x7f46f00d1610 2024-09-17T05:22:16.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.925+0000 7f46ecff9640 1 -- 172.21.15.98:0/2371980053 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e000f6b0 con 0x7f46f00d1610 2024-09-17T05:22:16.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.925+0000 7f46f5ba3640 1 -- 172.21.15.98:0/2371980053 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46f00b5670 con 0x7f46f00d1610 2024-09-17T05:22:16.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.926+0000 7f46f5ba3640 1 -- 172.21.15.98:0/2371980053 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46f00cecc0 con 0x7f46f00d1610 2024-09-17T05:22:16.929 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.927+0000 7f46ecff9640 1 -- 172.21.15.98:0/2371980053 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f46e000f850 con 0x7f46f00d1610 2024-09-17T05:22:16.929 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.927+0000 7f46ecff9640 1 --2- 172.21.15.98:0/2371980053 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f46d0078bc0 0x7f46d007b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:16.929 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.927+0000 7f46ecff9640 1 -- 172.21.15.98:0/2371980053 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f46e009b3e0 con 0x7f46f00d1610 2024-09-17T05:22:16.929 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.927+0000 7f46e6ffd640 1 --2- 172.21.15.98:0/2371980053 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f46d0078bc0 0x7f46d007b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:16.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.928+0000 7f46e6ffd640 1 --2- 172.21.15.98:0/2371980053 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f46d0078bc0 0x7f46d007b080 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f46f00ce5c0 tx=0x7f46d8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:16.932 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:16.931+0000 7f46ecff9640 1 -- 172.21.15.98:0/2371980053 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f46e0014030 con 0x7f46f00d1610 2024-09-17T05:22:17.172 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.171+0000 7f46f5ba3640 1 -- 172.21.15.98:0/2371980053 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread"]} v 0) -- 0x7f46f00b5930 con 0x7f46f00d1610 2024-09-17T05:22:17.576 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.575+0000 7f46ecff9640 1 -- 172.21.15.98:0/2371980053 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread"]}]=0 v46) ==== 170+0+0 (secure 0 0 0) 0x7f46e0063940 con 0x7f46f00d1610 2024-09-17T05:22:17.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.578+0000 7f46f5ba3640 1 -- 172.21.15.98:0/2371980053 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f46d0078bc0 msgr2=0x7f46d007b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:17.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.578+0000 7f46f5ba3640 1 --2- 172.21.15.98:0/2371980053 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f46d0078bc0 0x7f46d007b080 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f46f00ce5c0 tx=0x7f46d8009040 comp rx=0 tx=0).stop 2024-09-17T05:22:17.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.578+0000 7f46f5ba3640 1 -- 172.21.15.98:0/2371980053 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46f00d1610 msgr2=0x7f46f00ca680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:17.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.578+0000 7f46f5ba3640 1 --2- 172.21.15.98:0/2371980053 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46f00d1610 0x7f46f00ca680 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f46e000c970 tx=0x7f46e000ce30 comp rx=0 tx=0).stop 2024-09-17T05:22:17.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.578+0000 7f46f5ba3640 1 -- 172.21.15.98:0/2371980053 shutdown_connections 2024-09-17T05:22:17.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.578+0000 7f46f5ba3640 1 --2- 172.21.15.98:0/2371980053 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f46d0078bc0 0x7f46d007b080 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:17.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.578+0000 7f46f5ba3640 1 --2- 172.21.15.98:0/2371980053 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46f015e0d0 0x7f46f01f4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:17.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.578+0000 7f46f5ba3640 1 --2- 172.21.15.98:0/2371980053 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46f00d2050 0x7f46f00b5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:17.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.578+0000 7f46f5ba3640 1 --2- 172.21.15.98:0/2371980053 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46f00d1610 0x7f46f00ca680 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:17.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.578+0000 7f46f5ba3640 1 -- 172.21.15.98:0/2371980053 >> 172.21.15.98:0/2371980053 conn(0x7f46f00d3fe0 msgr2=0x7f46f0160e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:17.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.578+0000 7f46f5ba3640 1 -- 172.21.15.98:0/2371980053 shutdown_connections 2024-09-17T05:22:17.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.578+0000 7f46f5ba3640 1 -- 172.21.15.98:0/2371980053 wait complete. 2024-09-17T05:22:17.590 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T05:22:17.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.692+0000 7f73e1ff3640 1 -- 172.21.15.98:0/2048391345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73dc0d2050 msgr2=0x7f73dc0d0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:17.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.692+0000 7f73e1ff3640 1 --2- 172.21.15.98:0/2048391345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73dc0d2050 0x7f73dc0d0f00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f73d0005fd0 tx=0x7f73d002a5d0 comp rx=0 tx=0).stop 2024-09-17T05:22:17.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.692+0000 7f73e1ff3640 1 -- 172.21.15.98:0/2048391345 shutdown_connections 2024-09-17T05:22:17.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.692+0000 7f73e1ff3640 1 --2- 172.21.15.98:0/2048391345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73dc0d2050 0x7f73dc0d0f00 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:17.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.692+0000 7f73e1ff3640 1 --2- 172.21.15.98:0/2048391345 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f73dc15e0d0 0x7f73dc0d09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:17.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.692+0000 7f73e1ff3640 1 -- 172.21.15.98:0/2048391345 >> 172.21.15.98:0/2048391345 conn(0x7f73dc0d3fe0 msgr2=0x7f73dc0d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:17.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.693+0000 7f73e1ff3640 1 -- 172.21.15.98:0/2048391345 shutdown_connections 2024-09-17T05:22:17.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.693+0000 7f73e1ff3640 1 -- 172.21.15.98:0/2048391345 wait complete. 2024-09-17T05:22:17.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.694+0000 7f73e1ff3640 1 Processor -- start 2024-09-17T05:22:17.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.694+0000 7f73e1ff3640 1 -- start start 2024-09-17T05:22:17.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.695+0000 7f73e1ff3640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f73dc0d1440 0x7f73dc1f74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:17.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.695+0000 7f73e1ff3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73dc0d2050 0x7f73dc0b0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:17.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.695+0000 7f73e1ff3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73dc15e0d0 0x7f73dc06e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:17.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.695+0000 7f73e1ff3640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f73dc15ebc0 con 0x7f73dc15e0d0 2024-09-17T05:22:17.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.695+0000 7f73e1ff3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f73dc0cfee0 con 0x7f73dc0d2050 2024-09-17T05:22:17.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.695+0000 7f73e1ff3640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f73dc15ed40 con 0x7f73dc0d1440 2024-09-17T05:22:17.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.695+0000 7f73dbfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73dc15e0d0 0x7f73dc06e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:17.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.695+0000 7f73dbfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73dc15e0d0 0x7f73dc06e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36026/0 (socket says 172.21.15.98:36026) 2024-09-17T05:22:17.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.695+0000 7f73dbfff640 1 -- 172.21.15.98:0/1903019774 learned_addr learned my addr 172.21.15.98:0/1903019774 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:17.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.695+0000 7f73db7fe640 1 --2- 172.21.15.98:0/1903019774 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f73dc0d1440 0x7f73dc1f74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:17.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.695+0000 7f73daffd640 1 --2- 172.21.15.98:0/1903019774 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73dc0d2050 0x7f73dc0b0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:17.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.695+0000 7f73dbfff640 1 -- 172.21.15.98:0/1903019774 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f73dc0d1440 msgr2=0x7f73dc1f74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:17.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.695+0000 7f73dbfff640 1 --2- 172.21.15.98:0/1903019774 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f73dc0d1440 0x7f73dc1f74d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:17.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.695+0000 7f73dbfff640 1 -- 172.21.15.98:0/1903019774 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73dc0d2050 msgr2=0x7f73dc0b0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:17.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.695+0000 7f73dbfff640 1 --2- 172.21.15.98:0/1903019774 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73dc0d2050 0x7f73dc0b0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:17.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.695+0000 7f73dbfff640 1 -- 172.21.15.98:0/1903019774 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73dc14fc60 con 0x7f73dc15e0d0 2024-09-17T05:22:17.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.695+0000 7f73dbfff640 1 --2- 172.21.15.98:0/1903019774 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73dc15e0d0 0x7f73dc06e5b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f73d400c400 tx=0x7f73d400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:17.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.695+0000 7f73c3fff640 1 -- 172.21.15.98:0/1903019774 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73d4017070 con 0x7f73dc15e0d0 2024-09-17T05:22:17.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.695+0000 7f73c3fff640 1 -- 172.21.15.98:0/1903019774 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f73d40053c0 con 0x7f73dc15e0d0 2024-09-17T05:22:17.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.695+0000 7f73e1ff3640 1 -- 172.21.15.98:0/1903019774 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73dc14ff40 con 0x7f73dc15e0d0 2024-09-17T05:22:17.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.695+0000 7f73c3fff640 1 -- 172.21.15.98:0/1903019774 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73d4003850 con 0x7f73dc15e0d0 2024-09-17T05:22:17.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.696+0000 7f73e1ff3640 1 -- 172.21.15.98:0/1903019774 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73dc150500 con 0x7f73dc15e0d0 2024-09-17T05:22:17.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.697+0000 7f73e1ff3640 1 -- 172.21.15.98:0/1903019774 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73dc15f260 con 0x7f73dc15e0d0 2024-09-17T05:22:17.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.697+0000 7f73c3fff640 1 -- 172.21.15.98:0/1903019774 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f73d401a070 con 0x7f73dc15e0d0 2024-09-17T05:22:17.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.698+0000 7f73c3fff640 1 --2- 172.21.15.98:0/1903019774 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f73c8078b90 0x7f73c807b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:17.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.698+0000 7f73c3fff640 1 -- 172.21.15.98:0/1903019774 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f73d409a0a0 con 0x7f73dc15e0d0 2024-09-17T05:22:17.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.698+0000 7f73db7fe640 1 --2- 172.21.15.98:0/1903019774 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f73c8078b90 0x7f73c807b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:17.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.698+0000 7f73db7fe640 1 --2- 172.21.15.98:0/1903019774 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f73c8078b90 0x7f73c807b050 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f73cc005fd0 tx=0x7f73cc009500 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:17.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.702+0000 7f73c3fff640 1 -- 172.21.15.98:0/1903019774 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f73d4061ea0 con 0x7f73dc15e0d0 2024-09-17T05:22:17.877 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.876+0000 7f73e1ff3640 1 -- 172.21.15.98:0/1903019774 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f73dc15e6c0 con 0x7f73dc15e0d0 2024-09-17T05:22:17.877 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.877+0000 7f73c3fff640 1 -- 172.21.15.98:0/1903019774 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v27) ==== 59+0+1998 (secure 0 0 0) 0x7f73d40668d0 con 0x7f73dc15e0d0 2024-09-17T05:22:17.878 INFO:teuthology.orchestra.run.smithi098.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T05:22:17.878 INFO:teuthology.orchestra.run.smithi098.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T05:22:17.878 INFO:teuthology.orchestra.run.smithi098.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-17T05:22:17.878 INFO:teuthology.orchestra.run.smithi098.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T05:22:17.878 INFO:teuthology.orchestra.run.smithi098.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 5490.314032 2024-09-17T05:22:17.878 INFO:teuthology.orchestra.run.smithi098.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 8258.942219 2024-09-17T05:22:17.878 INFO:teuthology.orchestra.run.smithi098.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 5790.866113 2024-09-17T05:22:17.879 INFO:teuthology.orchestra.run.smithi098.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 5832.044196 2024-09-17T05:22:17.879 INFO:teuthology.orchestra.run.smithi098.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 6803.123506 2024-09-17T05:22:17.879 INFO:teuthology.orchestra.run.smithi098.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4571.387243 2024-09-17T05:22:17.879 INFO:teuthology.orchestra.run.smithi098.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 6847.767379 2024-09-17T05:22:17.879 INFO:teuthology.orchestra.run.smithi098.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 5227.833579 2024-09-17T05:22:17.879 INFO:teuthology.orchestra.run.smithi098.stdout:mds advanced debug_mds 20/20 2024-09-17T05:22:17.879 INFO:teuthology.orchestra.run.smithi098.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T05:22:17.879 INFO:teuthology.orchestra.run.smithi098.stdout:mds advanced debug_ms 2/2 2024-09-17T05:22:17.879 INFO:teuthology.orchestra.run.smithi098.stdout:mds dev mds_debug_frag true 2024-09-17T05:22:17.879 INFO:teuthology.orchestra.run.smithi098.stdout:mds dev mds_debug_scatterstat true 2024-09-17T05:22:17.880 INFO:teuthology.orchestra.run.smithi098.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T05:22:17.880 INFO:teuthology.orchestra.run.smithi098.stdout:mds dev mds_verify_scatter true 2024-09-17T05:22:17.880 INFO:teuthology.orchestra.run.smithi098.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T05:22:17.880 INFO:teuthology.orchestra.run.smithi098.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T05:22:17.880 INFO:teuthology.orchestra.run.smithi098.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T05:22:17.881 INFO:teuthology.orchestra.run.smithi098.stdout:client advanced client_mount_timeout 600 2024-09-17T05:22:17.881 INFO:teuthology.orchestra.run.smithi098.stdout:client advanced debug_client 20/20 2024-09-17T05:22:17.881 INFO:teuthology.orchestra.run.smithi098.stdout:client advanced debug_ms 1/1 2024-09-17T05:22:17.881 INFO:teuthology.orchestra.run.smithi098.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T05:22:17.881 INFO:teuthology.orchestra.run.smithi098.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T05:22:17.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.879+0000 7f73e1ff3640 1 -- 172.21.15.98:0/1903019774 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f73c8078b90 msgr2=0x7f73c807b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:17.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.879+0000 7f73e1ff3640 1 --2- 172.21.15.98:0/1903019774 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f73c8078b90 0x7f73c807b050 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f73cc005fd0 tx=0x7f73cc009500 comp rx=0 tx=0).stop 2024-09-17T05:22:17.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.879+0000 7f73e1ff3640 1 -- 172.21.15.98:0/1903019774 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73dc15e0d0 msgr2=0x7f73dc06e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:17.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.879+0000 7f73e1ff3640 1 --2- 172.21.15.98:0/1903019774 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73dc15e0d0 0x7f73dc06e5b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f73d400c400 tx=0x7f73d400c8c0 comp rx=0 tx=0).stop 2024-09-17T05:22:17.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.879+0000 7f73e1ff3640 1 -- 172.21.15.98:0/1903019774 shutdown_connections 2024-09-17T05:22:17.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.879+0000 7f73e1ff3640 1 --2- 172.21.15.98:0/1903019774 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f73c8078b90 0x7f73c807b050 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:17.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.879+0000 7f73e1ff3640 1 --2- 172.21.15.98:0/1903019774 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73dc15e0d0 0x7f73dc06e5b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:17.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.879+0000 7f73e1ff3640 1 --2- 172.21.15.98:0/1903019774 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73dc0d2050 0x7f73dc0b0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:17.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.879+0000 7f73e1ff3640 1 --2- 172.21.15.98:0/1903019774 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f73dc0d1440 0x7f73dc1f74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:17.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.879+0000 7f73e1ff3640 1 -- 172.21.15.98:0/1903019774 >> 172.21.15.98:0/1903019774 conn(0x7f73dc0d3fe0 msgr2=0x7f73dc0b97a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:17.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.879+0000 7f73e1ff3640 1 -- 172.21.15.98:0/1903019774 shutdown_connections 2024-09-17T05:22:17.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.879+0000 7f73e1ff3640 1 -- 172.21.15.98:0/1903019774 wait complete. 2024-09-17T05:22:17.890 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:22:17.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.995+0000 7f3931953640 1 -- 172.21.15.98:0/3727916636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f392c0cd490 msgr2=0x7f392c0cdad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:17.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.995+0000 7f3931953640 1 --2- 172.21.15.98:0/3727916636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f392c0cd490 0x7f392c0cdad0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f392c072fb0 tx=0x7f392002a530 comp rx=0 tx=0).stop 2024-09-17T05:22:17.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.995+0000 7f3931953640 1 -- 172.21.15.98:0/3727916636 shutdown_connections 2024-09-17T05:22:17.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.995+0000 7f3931953640 1 --2- 172.21.15.98:0/3727916636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f392c0cd490 0x7f392c0cdad0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:17.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.995+0000 7f3931953640 1 -- 172.21.15.98:0/3727916636 >> 172.21.15.98:0/3727916636 conn(0x7f392c0b1840 msgr2=0x7f392c0b1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:17.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.995+0000 7f3931953640 1 -- 172.21.15.98:0/3727916636 shutdown_connections 2024-09-17T05:22:17.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.995+0000 7f3931953640 1 -- 172.21.15.98:0/3727916636 wait complete. 2024-09-17T05:22:17.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.996+0000 7f3931953640 1 Processor -- start 2024-09-17T05:22:17.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.996+0000 7f3931953640 1 -- start start 2024-09-17T05:22:17.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.997+0000 7f3931953640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f392c0739d0 0x7f392c06e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:17.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.997+0000 7f3931953640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f392c0cd490 0x7f392c0cfa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:17.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.997+0000 7f3931953640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f392c1517a0 0x7f392c143220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:17.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.997+0000 7f3931953640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f392c0cc7d0 con 0x7f392c0739d0 2024-09-17T05:22:18.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.997+0000 7f3931953640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f392c0cc650 con 0x7f392c1517a0 2024-09-17T05:22:18.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.997+0000 7f3931953640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f392c0cc950 con 0x7f392c0cd490 2024-09-17T05:22:18.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.997+0000 7f392affd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f392c0739d0 0x7f392c06e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:18.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.997+0000 7f392affd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f392c0739d0 0x7f392c06e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36038/0 (socket says 172.21.15.98:36038) 2024-09-17T05:22:18.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.997+0000 7f392affd640 1 -- 172.21.15.98:0/1752694179 learned_addr learned my addr 172.21.15.98:0/1752694179 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:18.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.997+0000 7f392a7fc640 1 --2- 172.21.15.98:0/1752694179 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f392c0cd490 0x7f392c0cfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:18.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.997+0000 7f392b7fe640 1 --2- 172.21.15.98:0/1752694179 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f392c1517a0 0x7f392c143220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:18.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.997+0000 7f392affd640 1 -- 172.21.15.98:0/1752694179 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f392c0cd490 msgr2=0x7f392c0cfa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:18.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.997+0000 7f392affd640 1 --2- 172.21.15.98:0/1752694179 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f392c0cd490 0x7f392c0cfa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:18.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.997+0000 7f392affd640 1 -- 172.21.15.98:0/1752694179 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f392c1517a0 msgr2=0x7f392c143220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:18.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.997+0000 7f392affd640 1 --2- 172.21.15.98:0/1752694179 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f392c1517a0 0x7f392c143220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:18.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.997+0000 7f392affd640 1 -- 172.21.15.98:0/1752694179 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f392c154060 con 0x7f392c0739d0 2024-09-17T05:22:18.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.997+0000 7f392b7fe640 1 --2- 172.21.15.98:0/1752694179 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f392c1517a0 0x7f392c143220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:22:18.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.997+0000 7f392a7fc640 1 --2- 172.21.15.98:0/1752694179 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f392c0cd490 0x7f392c0cfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:22:18.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.997+0000 7f392affd640 1 --2- 172.21.15.98:0/1752694179 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f392c0739d0 0x7f392c06e690 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f391c001220 tx=0x7f391c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:18.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.998+0000 7f3913fff640 1 -- 172.21.15.98:0/1752694179 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391c016020 con 0x7f392c0739d0 2024-09-17T05:22:18.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.998+0000 7f3913fff640 1 -- 172.21.15.98:0/1752694179 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f391c012920 con 0x7f392c0739d0 2024-09-17T05:22:18.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.998+0000 7f3931953640 1 -- 172.21.15.98:0/1752694179 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f392c1542d0 con 0x7f392c0739d0 2024-09-17T05:22:18.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.998+0000 7f3913fff640 1 -- 172.21.15.98:0/1752694179 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391c012db0 con 0x7f392c0739d0 2024-09-17T05:22:18.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.998+0000 7f3931953640 1 -- 172.21.15.98:0/1752694179 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f392c1f6c30 con 0x7f392c0739d0 2024-09-17T05:22:18.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.999+0000 7f3931953640 1 -- 172.21.15.98:0/1752694179 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f392c0cdad0 con 0x7f392c0739d0 2024-09-17T05:22:18.002 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:17.999+0000 7f3913fff640 1 -- 172.21.15.98:0/1752694179 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f391c019020 con 0x7f392c0739d0 2024-09-17T05:22:18.002 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.000+0000 7f3913fff640 1 --2- 172.21.15.98:0/1752694179 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f3918078b90 0x7f391807b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:18.002 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.000+0000 7f3913fff640 1 -- 172.21.15.98:0/1752694179 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f391c09aaa0 con 0x7f392c0739d0 2024-09-17T05:22:18.002 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.000+0000 7f392a7fc640 1 --2- 172.21.15.98:0/1752694179 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f3918078b90 0x7f391807b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:18.002 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.000+0000 7f392a7fc640 1 --2- 172.21.15.98:0/1752694179 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f3918078b90 0x7f391807b050 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3920034000 tx=0x7f3920004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:18.004 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.004+0000 7f3913fff640 1 -- 172.21.15.98:0/1752694179 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f391c020030 con 0x7f392c0739d0 2024-09-17T05:22:18.179 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.178+0000 7f3931953640 1 -- 172.21.15.98:0/1752694179 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f392c0b2430 con 0x7f392c0739d0 2024-09-17T05:22:18.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.182+0000 7f3913fff640 1 -- 172.21.15.98:0/1752694179 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v28)=0 v28) ==== 122+0+0 (secure 0 0 0) 0x7f391c062f80 con 0x7f392c0739d0 2024-09-17T05:22:18.185 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.184+0000 7f3931953640 1 -- 172.21.15.98:0/1752694179 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f3918078b90 msgr2=0x7f391807b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:18.185 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.184+0000 7f3931953640 1 --2- 172.21.15.98:0/1752694179 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f3918078b90 0x7f391807b050 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3920034000 tx=0x7f3920004730 comp rx=0 tx=0).stop 2024-09-17T05:22:18.185 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.184+0000 7f3931953640 1 -- 172.21.15.98:0/1752694179 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f392c0739d0 msgr2=0x7f392c06e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:18.185 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.184+0000 7f3931953640 1 --2- 172.21.15.98:0/1752694179 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f392c0739d0 0x7f392c06e690 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f391c001220 tx=0x7f391c00c940 comp rx=0 tx=0).stop 2024-09-17T05:22:18.185 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.184+0000 7f3931953640 1 -- 172.21.15.98:0/1752694179 shutdown_connections 2024-09-17T05:22:18.186 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.184+0000 7f3931953640 1 --2- 172.21.15.98:0/1752694179 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f3918078b90 0x7f391807b050 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:18.186 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.184+0000 7f3931953640 1 --2- 172.21.15.98:0/1752694179 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f392c1517a0 0x7f392c143220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:18.186 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.184+0000 7f3931953640 1 --2- 172.21.15.98:0/1752694179 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f392c0cd490 0x7f392c0cfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:18.186 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.184+0000 7f3931953640 1 --2- 172.21.15.98:0/1752694179 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f392c0739d0 0x7f392c06e690 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:18.186 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.184+0000 7f3931953640 1 -- 172.21.15.98:0/1752694179 >> 172.21.15.98:0/1752694179 conn(0x7f392c0b1840 msgr2=0x7f392c0b0550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:18.186 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.184+0000 7f3931953640 1 -- 172.21.15.98:0/1752694179 shutdown_connections 2024-09-17T05:22:18.186 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.184+0000 7f3931953640 1 -- 172.21.15.98:0/1752694179 wait complete. 2024-09-17T05:22:18.196 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:22:18.196 DEBUG:teuthology.orchestra.run.smithi098:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:22:18.240 DEBUG:teuthology.orchestra.run.smithi167:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:22:18.290 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:22:18.290 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T05:22:18.291 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:22:18.307 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T05:22:18.307 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:22:18.363 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T05:22:18.363 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:22:18.419 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:22:18.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.561+0000 7f48fdd52640 1 -- 172.21.15.98:0/4184645929 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48f80746a0 msgr2=0x7f48f80730e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:18.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.561+0000 7f48fdd52640 1 --2- 172.21.15.98:0/4184645929 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48f80746a0 0x7f48f80730e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f48f0005fd0 tx=0x7f48f002a980 comp rx=0 tx=0).stop 2024-09-17T05:22:18.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.562+0000 7f48fdd52640 1 -- 172.21.15.98:0/4184645929 shutdown_connections 2024-09-17T05:22:18.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.562+0000 7f48fdd52640 1 --2- 172.21.15.98:0/4184645929 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48f80746a0 0x7f48f80730e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:18.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.562+0000 7f48fdd52640 1 --2- 172.21.15.98:0/4184645929 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48f8074150 0x7f48f8072ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:18.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.562+0000 7f48fdd52640 1 -- 172.21.15.98:0/4184645929 >> 172.21.15.98:0/4184645929 conn(0x7f48f80b1950 msgr2=0x7f48f80b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:18.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.562+0000 7f48fdd52640 1 -- 172.21.15.98:0/4184645929 shutdown_connections 2024-09-17T05:22:18.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.562+0000 7f48fdd52640 1 -- 172.21.15.98:0/4184645929 wait complete. 2024-09-17T05:22:18.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.563+0000 7f48fdd52640 1 Processor -- start 2024-09-17T05:22:18.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.563+0000 7f48fdd52640 1 -- start start 2024-09-17T05:22:18.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.563+0000 7f48fdd52640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48f8074150 0x7f48f814c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:18.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.563+0000 7f48fdd52640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48f80746a0 0x7f48f81e5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:18.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.563+0000 7f48fdd52640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48f80b43f0 0x7f48f81e5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:18.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.563+0000 7f48fdd52640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f48f80739b0 con 0x7f48f80b43f0 2024-09-17T05:22:18.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.563+0000 7f48fdd52640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f48f8073830 con 0x7f48f80746a0 2024-09-17T05:22:18.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.563+0000 7f48fdd52640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f48f8073b30 con 0x7f48f8074150 2024-09-17T05:22:18.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.564+0000 7f48f7fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48f80b43f0 0x7f48f81e5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:18.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.564+0000 7f48f7fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48f80b43f0 0x7f48f81e5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36064/0 (socket says 172.21.15.98:36064) 2024-09-17T05:22:18.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.564+0000 7f48f7fff640 1 -- 172.21.15.98:0/257911304 learned_addr learned my addr 172.21.15.98:0/257911304 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:18.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.564+0000 7f48f7fff640 1 -- 172.21.15.98:0/257911304 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48f8074150 msgr2=0x7f48f814c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:18.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.564+0000 7f48f7fff640 1 --2- 172.21.15.98:0/257911304 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48f8074150 0x7f48f814c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:18.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.564+0000 7f48f7fff640 1 -- 172.21.15.98:0/257911304 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48f80746a0 msgr2=0x7f48f81e5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:18.567 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.564+0000 7f48f7fff640 1 --2- 172.21.15.98:0/257911304 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48f80746a0 0x7f48f81e5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:18.567 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.564+0000 7f48f7fff640 1 -- 172.21.15.98:0/257911304 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48f81e6b20 con 0x7f48f80b43f0 2024-09-17T05:22:18.567 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.564+0000 7f48f7fff640 1 --2- 172.21.15.98:0/257911304 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48f80b43f0 0x7f48f81e5a90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f48f0006010 tx=0x7f48f0003ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:18.567 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.564+0000 7f48f4ff9640 1 -- 172.21.15.98:0/257911304 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f0047070 con 0x7f48f80b43f0 2024-09-17T05:22:18.567 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.564+0000 7f48f4ff9640 1 -- 172.21.15.98:0/257911304 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f48f00045c0 con 0x7f48f80b43f0 2024-09-17T05:22:18.567 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.564+0000 7f48f4ff9640 1 -- 172.21.15.98:0/257911304 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f0034070 con 0x7f48f80b43f0 2024-09-17T05:22:18.567 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.564+0000 7f48fdd52640 1 -- 172.21.15.98:0/257911304 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48f81e6e00 con 0x7f48f80b43f0 2024-09-17T05:22:18.567 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.564+0000 7f48fdd52640 1 -- 172.21.15.98:0/257911304 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48f81e73c0 con 0x7f48f80b43f0 2024-09-17T05:22:18.568 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.565+0000 7f48fdd52640 1 -- 172.21.15.98:0/257911304 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48f80b47d0 con 0x7f48f80b43f0 2024-09-17T05:22:18.568 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.566+0000 7f48f4ff9640 1 -- 172.21.15.98:0/257911304 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f48f004a070 con 0x7f48f80b43f0 2024-09-17T05:22:18.568 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.566+0000 7f48f4ff9640 1 --2- 172.21.15.98:0/257911304 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f48d8078b90 0x7f48d807b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:18.568 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.566+0000 7f48f4ff9640 1 -- 172.21.15.98:0/257911304 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f48f00bbf10 con 0x7f48f80b43f0 2024-09-17T05:22:18.568 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.566+0000 7f48f77fe640 1 --2- 172.21.15.98:0/257911304 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f48d8078b90 0x7f48d807b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:18.568 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.567+0000 7f48f77fe640 1 --2- 172.21.15.98:0/257911304 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f48d8078b90 0x7f48d807b050 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f48e8000f60 tx=0x7f48e80079b0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:18.571 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.570+0000 7f48f4ff9640 1 -- 172.21.15.98:0/257911304 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f48f003f070 con 0x7f48f80b43f0 2024-09-17T05:22:18.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.766+0000 7f48fdd52640 1 -- 172.21.15.98:0/257911304 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f48f81e2ed0 con 0x7f48f80b43f0 2024-09-17T05:22:18.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.766+0000 7f48f4ff9640 1 -- 172.21.15.98:0/257911304 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f48f0084470 con 0x7f48f80b43f0 2024-09-17T05:22:18.767 INFO:teuthology.orchestra.run.smithi098.stderr:listed 0 entries 2024-09-17T05:22:18.770 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.769+0000 7f48fdd52640 1 -- 172.21.15.98:0/257911304 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f48d8078b90 msgr2=0x7f48d807b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:18.770 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.769+0000 7f48fdd52640 1 --2- 172.21.15.98:0/257911304 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f48d8078b90 0x7f48d807b050 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f48e8000f60 tx=0x7f48e80079b0 comp rx=0 tx=0).stop 2024-09-17T05:22:18.770 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.769+0000 7f48fdd52640 1 -- 172.21.15.98:0/257911304 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48f80b43f0 msgr2=0x7f48f81e5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:18.770 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.769+0000 7f48fdd52640 1 --2- 172.21.15.98:0/257911304 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48f80b43f0 0x7f48f81e5a90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f48f0006010 tx=0x7f48f0003ef0 comp rx=0 tx=0).stop 2024-09-17T05:22:18.770 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.769+0000 7f48fdd52640 1 -- 172.21.15.98:0/257911304 shutdown_connections 2024-09-17T05:22:18.770 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.769+0000 7f48fdd52640 1 --2- 172.21.15.98:0/257911304 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f48d8078b90 0x7f48d807b050 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:18.770 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.769+0000 7f48fdd52640 1 --2- 172.21.15.98:0/257911304 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48f80b43f0 0x7f48f81e5a90 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:18.771 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.769+0000 7f48fdd52640 1 --2- 172.21.15.98:0/257911304 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48f80746a0 0x7f48f81e5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:18.771 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.769+0000 7f48fdd52640 1 --2- 172.21.15.98:0/257911304 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48f8074150 0x7f48f814c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:18.771 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.769+0000 7f48fdd52640 1 -- 172.21.15.98:0/257911304 >> 172.21.15.98:0/257911304 conn(0x7f48f80b1950 msgr2=0x7f48f8072d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:18.771 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.769+0000 7f48fdd52640 1 -- 172.21.15.98:0/257911304 shutdown_connections 2024-09-17T05:22:18.771 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:18.769+0000 7f48fdd52640 1 -- 172.21.15.98:0/257911304 wait complete. 2024-09-17T05:22:18.780 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T05:22:18.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:18.780 DEBUG:teuthology.orchestra.run.smithi098:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-09-17T05:22:18.806 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi098.front.sepia.ceph.com 2024-09-17T05:22:18.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:18.806 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T05:22:18.882 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-17T05:22:18.882 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:22:18.902 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-17T05:22:18.902 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:22:18.961 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-17T05:22:18.962 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:22:19.021 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:22:19.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.122+0000 7f3474acd640 1 -- 172.21.15.98:0/2761725849 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3470074150 msgr2=0x7f3470072ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:19.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.122+0000 7f3474acd640 1 --2- 172.21.15.98:0/2761725849 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3470074150 0x7f3470072ba0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3458009900 tx=0x7f345802a4f0 comp rx=0 tx=0).stop 2024-09-17T05:22:19.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.122+0000 7f3474acd640 1 -- 172.21.15.98:0/2761725849 shutdown_connections 2024-09-17T05:22:19.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.122+0000 7f3474acd640 1 --2- 172.21.15.98:0/2761725849 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f34700746a0 0x7f34700730e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:19.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.122+0000 7f3474acd640 1 --2- 172.21.15.98:0/2761725849 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3470074150 0x7f3470072ba0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:19.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.122+0000 7f3474acd640 1 -- 172.21.15.98:0/2761725849 >> 172.21.15.98:0/2761725849 conn(0x7f34700b1950 msgr2=0x7f34700b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:19.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.122+0000 7f3474acd640 1 -- 172.21.15.98:0/2761725849 shutdown_connections 2024-09-17T05:22:19.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.122+0000 7f3474acd640 1 -- 172.21.15.98:0/2761725849 wait complete. 2024-09-17T05:22:19.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.124+0000 7f3474acd640 1 Processor -- start 2024-09-17T05:22:19.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.124+0000 7f3474acd640 1 -- start start 2024-09-17T05:22:19.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.124+0000 7f3474acd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3470074150 0x7f34700ce490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:19.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.124+0000 7f3474acd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f34700746a0 0x7f347015bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:19.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.124+0000 7f3474acd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34700b43f0 0x7f34700cb390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:19.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.124+0000 7f3474acd640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f34700cc820 con 0x7f34700b43f0 2024-09-17T05:22:19.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.124+0000 7f3474acd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f34700cc6a0 con 0x7f3470074150 2024-09-17T05:22:19.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.124+0000 7f3474acd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f34700cc9a0 con 0x7f34700746a0 2024-09-17T05:22:19.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.124+0000 7f346ed9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34700b43f0 0x7f34700cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:19.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.125+0000 7f346ed9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34700b43f0 0x7f34700cb390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36076/0 (socket says 172.21.15.98:36076) 2024-09-17T05:22:19.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.125+0000 7f346ed9d640 1 -- 172.21.15.98:0/1318376409 learned_addr learned my addr 172.21.15.98:0/1318376409 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:19.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.125+0000 7f346e59c640 1 --2- 172.21.15.98:0/1318376409 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3470074150 0x7f34700ce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:19.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.125+0000 7f346dd9b640 1 --2- 172.21.15.98:0/1318376409 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f34700746a0 0x7f347015bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:19.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.125+0000 7f346ed9d640 1 -- 172.21.15.98:0/1318376409 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f34700746a0 msgr2=0x7f347015bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:19.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.125+0000 7f346ed9d640 1 --2- 172.21.15.98:0/1318376409 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f34700746a0 0x7f347015bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:19.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.125+0000 7f346ed9d640 1 -- 172.21.15.98:0/1318376409 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3470074150 msgr2=0x7f34700ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:19.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.125+0000 7f346ed9d640 1 --2- 172.21.15.98:0/1318376409 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3470074150 0x7f34700ce490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:19.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.125+0000 7f346ed9d640 1 -- 172.21.15.98:0/1318376409 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34700aec80 con 0x7f34700b43f0 2024-09-17T05:22:19.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.125+0000 7f346ed9d640 1 --2- 172.21.15.98:0/1318376409 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34700b43f0 0x7f34700cb390 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f346800d750 tx=0x7f346800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:19.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.125+0000 7f3466ffd640 1 -- 172.21.15.98:0/1318376409 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3468017070 con 0x7f34700b43f0 2024-09-17T05:22:19.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.125+0000 7f3466ffd640 1 -- 172.21.15.98:0/1318376409 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3468009cc0 con 0x7f34700b43f0 2024-09-17T05:22:19.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.125+0000 7f3466ffd640 1 -- 172.21.15.98:0/1318376409 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f346800de60 con 0x7f34700b43f0 2024-09-17T05:22:19.134 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.125+0000 7f3474acd640 1 -- 172.21.15.98:0/1318376409 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f347015b290 con 0x7f34700b43f0 2024-09-17T05:22:19.134 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.125+0000 7f3474acd640 1 -- 172.21.15.98:0/1318376409 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f347015b850 con 0x7f34700b43f0 2024-09-17T05:22:19.134 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.126+0000 7f3474acd640 1 -- 172.21.15.98:0/1318376409 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34700af260 con 0x7f34700b43f0 2024-09-17T05:22:19.134 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.127+0000 7f3466ffd640 1 -- 172.21.15.98:0/1318376409 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3468005280 con 0x7f34700b43f0 2024-09-17T05:22:19.134 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.127+0000 7f3466ffd640 1 --2- 172.21.15.98:0/1318376409 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f3450078b90 0x7f345007b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:19.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.127+0000 7f3466ffd640 1 -- 172.21.15.98:0/1318376409 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f346809ad70 con 0x7f34700b43f0 2024-09-17T05:22:19.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.127+0000 7f346e59c640 1 --2- 172.21.15.98:0/1318376409 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f3450078b90 0x7f345007b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:19.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.128+0000 7f346e59c640 1 --2- 172.21.15.98:0/1318376409 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f3450078b90 0x7f345007b050 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3460001e20 tx=0x7f3460009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:19.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.131+0000 7f3466ffd640 1 -- 172.21.15.98:0/1318376409 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f34700af260 con 0x7f34700b43f0 2024-09-17T05:22:19.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.319+0000 7f3474acd640 1 -- 172.21.15.98:0/1318376409 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f34700b47d0 con 0x7f34700b43f0 2024-09-17T05:22:19.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.319+0000 7f3466ffd640 1 -- 172.21.15.98:0/1318376409 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f3468062bf0 con 0x7f34700b43f0 2024-09-17T05:22:19.320 INFO:teuthology.orchestra.run.smithi098.stderr:listed 0 entries 2024-09-17T05:22:19.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.321+0000 7f3474acd640 1 -- 172.21.15.98:0/1318376409 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f3450078b90 msgr2=0x7f345007b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:19.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.321+0000 7f3474acd640 1 --2- 172.21.15.98:0/1318376409 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f3450078b90 0x7f345007b050 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3460001e20 tx=0x7f3460009040 comp rx=0 tx=0).stop 2024-09-17T05:22:19.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.321+0000 7f3474acd640 1 -- 172.21.15.98:0/1318376409 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34700b43f0 msgr2=0x7f34700cb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:19.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.321+0000 7f3474acd640 1 --2- 172.21.15.98:0/1318376409 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34700b43f0 0x7f34700cb390 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f346800d750 tx=0x7f346800dc10 comp rx=0 tx=0).stop 2024-09-17T05:22:19.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.321+0000 7f3474acd640 1 -- 172.21.15.98:0/1318376409 shutdown_connections 2024-09-17T05:22:19.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.321+0000 7f3474acd640 1 --2- 172.21.15.98:0/1318376409 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f3450078b90 0x7f345007b050 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:19.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.321+0000 7f3474acd640 1 --2- 172.21.15.98:0/1318376409 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34700b43f0 0x7f34700cb390 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:19.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.321+0000 7f3474acd640 1 --2- 172.21.15.98:0/1318376409 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f34700746a0 0x7f347015bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:19.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.321+0000 7f3474acd640 1 --2- 172.21.15.98:0/1318376409 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3470074150 0x7f34700ce490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:19.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.321+0000 7f3474acd640 1 -- 172.21.15.98:0/1318376409 >> 172.21.15.98:0/1318376409 conn(0x7f34700b1950 msgr2=0x7f34700cef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:19.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.321+0000 7f3474acd640 1 -- 172.21.15.98:0/1318376409 shutdown_connections 2024-09-17T05:22:19.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.321+0000 7f3474acd640 1 -- 172.21.15.98:0/1318376409 wait complete. 2024-09-17T05:22:19.333 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-17T05:22:19.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:19.333 DEBUG:teuthology.orchestra.run.smithi167:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-09-17T05:22:19.365 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi167.front.sepia.ceph.com 2024-09-17T05:22:19.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:19.366 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-17T05:22:19.429 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T05:22:19.430 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:22:19.446 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T05:22:19.447 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:22:19.502 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T05:22:19.503 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:22:19.559 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:22:19.703 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.701+0000 7fc3da518640 1 -- 172.21.15.98:0/2935610031 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3d415bdc0 msgr2=0x7fc3d40b3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:19.703 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.701+0000 7fc3da518640 1 --2- 172.21.15.98:0/2935610031 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3d415bdc0 0x7fc3d40b3d00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4009830 tx=0x7fc3c402a510 comp rx=0 tx=0).stop 2024-09-17T05:22:19.703 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.701+0000 7fc3da518640 1 -- 172.21.15.98:0/2935610031 shutdown_connections 2024-09-17T05:22:19.703 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.701+0000 7fc3da518640 1 --2- 172.21.15.98:0/2935610031 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3d40737d0 0x7fc3d4151750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:19.703 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.701+0000 7fc3da518640 1 --2- 172.21.15.98:0/2935610031 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3d415bdc0 0x7fc3d40b3d00 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:19.703 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.701+0000 7fc3da518640 1 -- 172.21.15.98:0/2935610031 >> 172.21.15.98:0/2935610031 conn(0x7fc3d40b2230 msgr2=0x7fc3d40b2610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:19.703 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.701+0000 7fc3da518640 1 -- 172.21.15.98:0/2935610031 shutdown_connections 2024-09-17T05:22:19.703 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.701+0000 7fc3da518640 1 -- 172.21.15.98:0/2935610031 wait complete. 2024-09-17T05:22:19.706 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.703+0000 7fc3da518640 1 Processor -- start 2024-09-17T05:22:19.706 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.703+0000 7fc3da518640 1 -- start start 2024-09-17T05:22:19.706 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.703+0000 7fc3da518640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3d40737d0 0x7fc3d414f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:19.706 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.703+0000 7fc3da518640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3d40b4240 0x7fc3d414c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:19.706 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.703+0000 7fc3da518640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3d415bdc0 0x7fc3d4154c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:19.706 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.703+0000 7fc3da518640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d4151e10 con 0x7fc3d40737d0 2024-09-17T05:22:19.706 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.703+0000 7fc3da518640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d4151c90 con 0x7fc3d415bdc0 2024-09-17T05:22:19.706 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.703+0000 7fc3da518640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fc3d4151f90 con 0x7fc3d40b4240 2024-09-17T05:22:19.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.703+0000 7fc3d3fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3d40737d0 0x7fc3d414f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:19.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.703+0000 7fc3d3fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3d40737d0 0x7fc3d414f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36096/0 (socket says 172.21.15.98:36096) 2024-09-17T05:22:19.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.703+0000 7fc3d3fff640 1 -- 172.21.15.98:0/3167286781 learned_addr learned my addr 172.21.15.98:0/3167286781 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:19.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.704+0000 7fc3cbfff640 1 --2- 172.21.15.98:0/3167286781 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3d40b4240 0x7fc3d414c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:19.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.704+0000 7fc3d8ab5640 1 --2- 172.21.15.98:0/3167286781 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3d415bdc0 0x7fc3d4154c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:19.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.704+0000 7fc3d3fff640 1 -- 172.21.15.98:0/3167286781 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3d40b4240 msgr2=0x7fc3d414c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:19.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.704+0000 7fc3d3fff640 1 --2- 172.21.15.98:0/3167286781 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3d40b4240 0x7fc3d414c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:19.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.704+0000 7fc3d3fff640 1 -- 172.21.15.98:0/3167286781 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3d415bdc0 msgr2=0x7fc3d4154c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:19.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.704+0000 7fc3d3fff640 1 --2- 172.21.15.98:0/3167286781 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3d415bdc0 0x7fc3d4154c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:19.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.704+0000 7fc3d3fff640 1 -- 172.21.15.98:0/3167286781 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3d414c6b0 con 0x7fc3d40737d0 2024-09-17T05:22:19.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.704+0000 7fc3d8ab5640 1 --2- 172.21.15.98:0/3167286781 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3d415bdc0 0x7fc3d4154c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:22:19.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.704+0000 7fc3d3fff640 1 --2- 172.21.15.98:0/3167286781 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3d40737d0 0x7fc3d414f740 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4009950 tx=0x7fc3c4033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:19.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.704+0000 7fc3d17fa640 1 -- 172.21.15.98:0/3167286781 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c4031d60 con 0x7fc3d40737d0 2024-09-17T05:22:19.708 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.704+0000 7fc3d17fa640 1 -- 172.21.15.98:0/3167286781 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc3c4033e10 con 0x7fc3d40737d0 2024-09-17T05:22:19.708 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.704+0000 7fc3d17fa640 1 -- 172.21.15.98:0/3167286781 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c4005260 con 0x7fc3d40737d0 2024-09-17T05:22:19.708 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.704+0000 7fc3da518640 1 -- 172.21.15.98:0/3167286781 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3d41527d0 con 0x7fc3d40737d0 2024-09-17T05:22:19.708 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.704+0000 7fc3da518640 1 -- 172.21.15.98:0/3167286781 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3d415d9d0 con 0x7fc3d40737d0 2024-09-17T05:22:19.708 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.705+0000 7fc3da518640 1 -- 172.21.15.98:0/3167286781 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3d4151750 con 0x7fc3d40737d0 2024-09-17T05:22:19.709 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.706+0000 7fc3d17fa640 1 -- 172.21.15.98:0/3167286781 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc3c4005400 con 0x7fc3d40737d0 2024-09-17T05:22:19.709 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.706+0000 7fc3d17fa640 1 --2- 172.21.15.98:0/3167286781 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fc3b4078b90 0x7fc3b407b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:19.709 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.706+0000 7fc3d17fa640 1 -- 172.21.15.98:0/3167286781 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc3c40bbda0 con 0x7fc3d40737d0 2024-09-17T05:22:19.709 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.706+0000 7fc3cbfff640 1 --2- 172.21.15.98:0/3167286781 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fc3b4078b90 0x7fc3b407b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:19.709 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.707+0000 7fc3cbfff640 1 --2- 172.21.15.98:0/3167286781 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fc3b4078b90 0x7fc3b407b050 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc007fd0 tx=0x7fc3bc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:19.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.710+0000 7fc3d17fa640 1 -- 172.21.15.98:0/3167286781 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fc3d414c6b0 con 0x7fc3d40737d0 2024-09-17T05:22:19.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.897+0000 7fc3da518640 1 -- 172.21.15.98:0/3167286781 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc3d40b38d0 con 0x7fc3d40737d0 2024-09-17T05:22:19.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.898+0000 7fc3d17fa640 1 -- 172.21.15.98:0/3167286781 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7fc3c403f030 con 0x7fc3d40737d0 2024-09-17T05:22:19.899 INFO:teuthology.orchestra.run.smithi098.stderr:listed 0 entries 2024-09-17T05:22:19.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.900+0000 7fc3da518640 1 -- 172.21.15.98:0/3167286781 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fc3b4078b90 msgr2=0x7fc3b407b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:19.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.900+0000 7fc3da518640 1 --2- 172.21.15.98:0/3167286781 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fc3b4078b90 0x7fc3b407b050 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc007fd0 tx=0x7fc3bc009040 comp rx=0 tx=0).stop 2024-09-17T05:22:19.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.900+0000 7fc3da518640 1 -- 172.21.15.98:0/3167286781 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3d40737d0 msgr2=0x7fc3d414f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:19.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.900+0000 7fc3da518640 1 --2- 172.21.15.98:0/3167286781 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3d40737d0 0x7fc3d414f740 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4009950 tx=0x7fc3c4033c20 comp rx=0 tx=0).stop 2024-09-17T05:22:19.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.900+0000 7fc3da518640 1 -- 172.21.15.98:0/3167286781 shutdown_connections 2024-09-17T05:22:19.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.900+0000 7fc3da518640 1 --2- 172.21.15.98:0/3167286781 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fc3b4078b90 0x7fc3b407b050 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:19.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.900+0000 7fc3da518640 1 --2- 172.21.15.98:0/3167286781 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3d415bdc0 0x7fc3d4154c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:19.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.900+0000 7fc3da518640 1 --2- 172.21.15.98:0/3167286781 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3d40b4240 0x7fc3d414c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:19.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.900+0000 7fc3da518640 1 --2- 172.21.15.98:0/3167286781 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3d40737d0 0x7fc3d414f740 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:19.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.900+0000 7fc3da518640 1 -- 172.21.15.98:0/3167286781 >> 172.21.15.98:0/3167286781 conn(0x7fc3d40b2230 msgr2=0x7fc3d4151030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:19.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.900+0000 7fc3da518640 1 -- 172.21.15.98:0/3167286781 shutdown_connections 2024-09-17T05:22:19.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:19.900+0000 7fc3da518640 1 -- 172.21.15.98:0/3167286781 wait complete. 2024-09-17T05:22:19.912 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-09-17T05:22:19.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:19.916 DEBUG:teuthology.orchestra.run.smithi098:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-09-17T05:22:19.942 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi098.front.sepia.ceph.com 2024-09-17T05:22:19.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:19.942 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-17T05:22:20.000 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-17T05:22:20.000 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:22:20.020 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-17T05:22:20.020 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:22:20.081 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-17T05:22:20.081 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:22:20.140 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:22:20.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.243+0000 7fad9c752640 1 -- 172.21.15.98:0/3240063162 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad94161550 msgr2=0x7fad9406ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:20.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.243+0000 7fad9c752640 1 --2- 172.21.15.98:0/3240063162 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad94161550 0x7fad9406ef50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fad940cd5d0 tx=0x7fad9002a4a0 comp rx=0 tx=0).stop 2024-09-17T05:22:20.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.243+0000 7fad9c752640 1 -- 172.21.15.98:0/3240063162 shutdown_connections 2024-09-17T05:22:20.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.243+0000 7fad9c752640 1 --2- 172.21.15.98:0/3240063162 >> v2:172.21.15.167:3300/0 conn(0x7fad94072df0 0x7fad940732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:20.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.243+0000 7fad9c752640 1 --2- 172.21.15.98:0/3240063162 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad94161550 0x7fad9406ef50 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:20.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.243+0000 7fad9c752640 1 -- 172.21.15.98:0/3240063162 >> 172.21.15.98:0/3240063162 conn(0x7fad940b1950 msgr2=0x7fad940b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:20.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.243+0000 7fad9c752640 1 -- 172.21.15.98:0/3240063162 shutdown_connections 2024-09-17T05:22:20.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.243+0000 7fad9c752640 1 -- 172.21.15.98:0/3240063162 wait complete. 2024-09-17T05:22:20.246 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.244+0000 7fad9c752640 1 Processor -- start 2024-09-17T05:22:20.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.244+0000 7fad9c752640 1 -- start start 2024-09-17T05:22:20.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.245+0000 7fad9c752640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad94072df0 0x7fad940d04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:20.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.245+0000 7fad9c752640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad940af3d0 0x7fad9409c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:20.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.245+0000 7fad9c752640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad94161550 0x7fad941f7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:20.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.245+0000 7fad9c752640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fad940737e0 con 0x7fad94161550 2024-09-17T05:22:20.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.245+0000 7fad9c752640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fad9406fdb0 con 0x7fad940af3d0 2024-09-17T05:22:20.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.245+0000 7fad9c752640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fad94073960 con 0x7fad94072df0 2024-09-17T05:22:20.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.245+0000 7fad9acef640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad94161550 0x7fad941f7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:20.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.245+0000 7fad9acef640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad94161550 0x7fad941f7e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36120/0 (socket says 172.21.15.98:36120) 2024-09-17T05:22:20.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.245+0000 7fad9acef640 1 -- 172.21.15.98:0/2932567129 learned_addr learned my addr 172.21.15.98:0/2932567129 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:20.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.245+0000 7fad99ced640 1 --2- 172.21.15.98:0/2932567129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad940af3d0 0x7fad9409c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:20.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.245+0000 7fad9a4ee640 1 --2- 172.21.15.98:0/2932567129 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad94072df0 0x7fad940d04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:20.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.245+0000 7fad9acef640 1 -- 172.21.15.98:0/2932567129 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad94072df0 msgr2=0x7fad940d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:20.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.245+0000 7fad9acef640 1 --2- 172.21.15.98:0/2932567129 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad94072df0 0x7fad940d04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:20.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.245+0000 7fad9acef640 1 -- 172.21.15.98:0/2932567129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad940af3d0 msgr2=0x7fad9409c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:20.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.245+0000 7fad9acef640 1 --2- 172.21.15.98:0/2932567129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad940af3d0 0x7fad9409c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:20.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.245+0000 7fad9acef640 1 -- 172.21.15.98:0/2932567129 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad9409d150 con 0x7fad94161550 2024-09-17T05:22:20.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.245+0000 7fad99ced640 1 --2- 172.21.15.98:0/2932567129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad940af3d0 0x7fad9409c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:22:20.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.245+0000 7fad9a4ee640 1 --2- 172.21.15.98:0/2932567129 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad94072df0 0x7fad940d04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:22:20.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.245+0000 7fad9acef640 1 --2- 172.21.15.98:0/2932567129 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad94161550 0x7fad941f7e60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fad8c00b970 tx=0x7fad8c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:20.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.245+0000 7fad8affd640 1 -- 172.21.15.98:0/2932567129 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad8c019070 con 0x7fad94161550 2024-09-17T05:22:20.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.245+0000 7fad8affd640 1 -- 172.21.15.98:0/2932567129 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fad8c00cc50 con 0x7fad94161550 2024-09-17T05:22:20.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.245+0000 7fad8affd640 1 -- 172.21.15.98:0/2932567129 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad8c0146a0 con 0x7fad94161550 2024-09-17T05:22:20.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.245+0000 7fad9c752640 1 -- 172.21.15.98:0/2932567129 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad9409d430 con 0x7fad94161550 2024-09-17T05:22:20.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.245+0000 7fad9c752640 1 -- 172.21.15.98:0/2932567129 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad9409d9f0 con 0x7fad94161550 2024-09-17T05:22:20.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.246+0000 7fad9c752640 1 -- 172.21.15.98:0/2932567129 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad940b3310 con 0x7fad94161550 2024-09-17T05:22:20.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.247+0000 7fad8affd640 1 -- 172.21.15.98:0/2932567129 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fad8c01c070 con 0x7fad94161550 2024-09-17T05:22:20.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.247+0000 7fad8affd640 1 --2- 172.21.15.98:0/2932567129 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fad78078bc0 0x7fad7807b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:20.250 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.248+0000 7fad8affd640 1 -- 172.21.15.98:0/2932567129 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fad8c09a990 con 0x7fad94161550 2024-09-17T05:22:20.250 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.248+0000 7fad9a4ee640 1 --2- 172.21.15.98:0/2932567129 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fad78078bc0 0x7fad7807b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:20.250 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.248+0000 7fad9a4ee640 1 --2- 172.21.15.98:0/2932567129 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fad78078bc0 0x7fad7807b080 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fad90034000 tx=0x7fad90004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:20.252 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.252+0000 7fad8affd640 1 -- 172.21.15.98:0/2932567129 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fad940b3310 con 0x7fad94161550 2024-09-17T05:22:20.439 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.438+0000 7fad9c752640 1 -- 172.21.15.98:0/2932567129 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fad94155010 con 0x7fad94161550 2024-09-17T05:22:20.439 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.438+0000 7fad8affd640 1 -- 172.21.15.98:0/2932567129 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7fad94155010 con 0x7fad94161550 2024-09-17T05:22:20.439 INFO:teuthology.orchestra.run.smithi098.stderr:listed 0 entries 2024-09-17T05:22:20.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.440+0000 7fad9c752640 1 -- 172.21.15.98:0/2932567129 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fad78078bc0 msgr2=0x7fad7807b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:20.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.440+0000 7fad9c752640 1 --2- 172.21.15.98:0/2932567129 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fad78078bc0 0x7fad7807b080 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fad90034000 tx=0x7fad90004730 comp rx=0 tx=0).stop 2024-09-17T05:22:20.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.440+0000 7fad9c752640 1 -- 172.21.15.98:0/2932567129 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad94161550 msgr2=0x7fad941f7e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:20.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.440+0000 7fad9c752640 1 --2- 172.21.15.98:0/2932567129 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad94161550 0x7fad941f7e60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fad8c00b970 tx=0x7fad8c00be30 comp rx=0 tx=0).stop 2024-09-17T05:22:20.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.440+0000 7fad9c752640 1 -- 172.21.15.98:0/2932567129 shutdown_connections 2024-09-17T05:22:20.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.440+0000 7fad9c752640 1 --2- 172.21.15.98:0/2932567129 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fad78078bc0 0x7fad7807b080 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:20.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.440+0000 7fad9c752640 1 --2- 172.21.15.98:0/2932567129 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad94161550 0x7fad941f7e60 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:20.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.440+0000 7fad9c752640 1 --2- 172.21.15.98:0/2932567129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad940af3d0 0x7fad9409c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:20.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.440+0000 7fad9c752640 1 --2- 172.21.15.98:0/2932567129 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad94072df0 0x7fad940d04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:20.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.440+0000 7fad9c752640 1 -- 172.21.15.98:0/2932567129 >> 172.21.15.98:0/2932567129 conn(0x7fad940b1950 msgr2=0x7fad940adeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:20.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.440+0000 7fad9c752640 1 -- 172.21.15.98:0/2932567129 shutdown_connections 2024-09-17T05:22:20.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.440+0000 7fad9c752640 1 -- 172.21.15.98:0/2932567129 wait complete. 2024-09-17T05:22:20.452 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-09-17T05:22:20.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:20.452 DEBUG:teuthology.orchestra.run.smithi167:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-09-17T05:22:20.484 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi167.front.sepia.ceph.com 2024-09-17T05:22:20.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:20.485 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-17T05:22:20.546 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T05:22:20.547 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:22:20.648 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.647+0000 7f1f71d2b640 1 -- 172.21.15.98:0/2856684922 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f6c073fb0 msgr2=0x7f1f6c074440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:20.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.647+0000 7f1f71d2b640 1 --2- 172.21.15.98:0/2856684922 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f6c073fb0 0x7f1f6c074440 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1f64009830 tx=0x7f1f6402a480 comp rx=0 tx=0).stop 2024-09-17T05:22:20.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.647+0000 7f1f71d2b640 1 -- 172.21.15.98:0/2856684922 shutdown_connections 2024-09-17T05:22:20.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.647+0000 7f1f71d2b640 1 --2- 172.21.15.98:0/2856684922 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f6c073fb0 0x7f1f6c074440 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:20.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.647+0000 7f1f71d2b640 1 --2- 172.21.15.98:0/2856684922 >> v2:172.21.15.167:3300/0 conn(0x7f1f6c0ccf00 0x7f1f6c0b2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:20.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.647+0000 7f1f71d2b640 1 -- 172.21.15.98:0/2856684922 >> 172.21.15.98:0/2856684922 conn(0x7f1f6c0b1950 msgr2=0x7f1f6c0b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:20.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.647+0000 7f1f71d2b640 1 -- 172.21.15.98:0/2856684922 shutdown_connections 2024-09-17T05:22:20.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.647+0000 7f1f71d2b640 1 -- 172.21.15.98:0/2856684922 wait complete. 2024-09-17T05:22:20.650 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.649+0000 7f1f71d2b640 1 Processor -- start 2024-09-17T05:22:20.650 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.649+0000 7f1f71d2b640 1 -- start start 2024-09-17T05:22:20.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.649+0000 7f1f71d2b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f6c073fb0 0x7f1f6c150560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:20.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.649+0000 7f1f71d2b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f6c0ccf00 0x7f1f6c14d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:20.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.649+0000 7f1f71d2b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f6c15f5a0 0x7f1f6c14db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:20.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.649+0000 7f1f71d2b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1f6c06f2e0 con 0x7f1f6c15f5a0 2024-09-17T05:22:20.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.649+0000 7f1f71d2b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1f6c06f160 con 0x7f1f6c073fb0 2024-09-17T05:22:20.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.649+0000 7f1f71d2b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f1f6c06f460 con 0x7f1f6c0ccf00 2024-09-17T05:22:20.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.650+0000 7f1f6bfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f6c15f5a0 0x7f1f6c14db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:20.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.650+0000 7f1f6bfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f6c15f5a0 0x7f1f6c14db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36124/0 (socket says 172.21.15.98:36124) 2024-09-17T05:22:20.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.650+0000 7f1f6bfff640 1 -- 172.21.15.98:0/829557303 learned_addr learned my addr 172.21.15.98:0/829557303 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:20.653 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.650+0000 7f1f6affd640 1 --2- 172.21.15.98:0/829557303 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f6c0ccf00 0x7f1f6c14d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:20.653 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.650+0000 7f1f6b7fe640 1 --2- 172.21.15.98:0/829557303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f6c073fb0 0x7f1f6c150560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:20.653 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.650+0000 7f1f6bfff640 1 -- 172.21.15.98:0/829557303 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f6c0ccf00 msgr2=0x7f1f6c14d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:20.653 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.650+0000 7f1f6bfff640 1 --2- 172.21.15.98:0/829557303 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f6c0ccf00 0x7f1f6c14d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:20.653 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.650+0000 7f1f6bfff640 1 -- 172.21.15.98:0/829557303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f6c073fb0 msgr2=0x7f1f6c150560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:20.653 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.650+0000 7f1f6bfff640 1 --2- 172.21.15.98:0/829557303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f6c073fb0 0x7f1f6c150560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:20.653 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.650+0000 7f1f6bfff640 1 -- 172.21.15.98:0/829557303 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f6c141030 con 0x7f1f6c15f5a0 2024-09-17T05:22:20.653 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.650+0000 7f1f6b7fe640 1 --2- 172.21.15.98:0/829557303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f6c073fb0 0x7f1f6c150560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:22:20.653 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.650+0000 7f1f6bfff640 1 --2- 172.21.15.98:0/829557303 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f6c15f5a0 0x7f1f6c14db00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1f6402aa70 tx=0x7f1f64032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:20.653 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.650+0000 7f1f53fff640 1 -- 172.21.15.98:0/829557303 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f64040070 con 0x7f1f6c15f5a0 2024-09-17T05:22:20.653 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.650+0000 7f1f53fff640 1 -- 172.21.15.98:0/829557303 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1f640038e0 con 0x7f1f6c15f5a0 2024-09-17T05:22:20.653 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.650+0000 7f1f71d2b640 1 -- 172.21.15.98:0/829557303 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f6c14f7a0 con 0x7f1f6c15f5a0 2024-09-17T05:22:20.653 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.650+0000 7f1f53fff640 1 -- 172.21.15.98:0/829557303 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f64005c90 con 0x7f1f6c15f5a0 2024-09-17T05:22:20.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.650+0000 7f1f71d2b640 1 -- 172.21.15.98:0/829557303 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f6c14fd60 con 0x7f1f6c15f5a0 2024-09-17T05:22:20.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.651+0000 7f1f71d2b640 1 -- 172.21.15.98:0/829557303 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f6c06f980 con 0x7f1f6c15f5a0 2024-09-17T05:22:20.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.652+0000 7f1f53fff640 1 -- 172.21.15.98:0/829557303 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1f64039040 con 0x7f1f6c15f5a0 2024-09-17T05:22:20.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.653+0000 7f1f53fff640 1 --2- 172.21.15.98:0/829557303 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f1f58078b90 0x7f1f5807b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:20.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.653+0000 7f1f53fff640 1 -- 172.21.15.98:0/829557303 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1f640bc0a0 con 0x7f1f6c15f5a0 2024-09-17T05:22:20.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.653+0000 7f1f6b7fe640 1 --2- 172.21.15.98:0/829557303 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f1f58078b90 0x7f1f5807b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:20.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.653+0000 7f1f6b7fe640 1 --2- 172.21.15.98:0/829557303 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f1f58078b90 0x7f1f5807b050 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c002170 tx=0x7f1f5c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:20.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.657+0000 7f1f53fff640 1 -- 172.21.15.98:0/829557303 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f1f64084600 con 0x7f1f6c15f5a0 2024-09-17T05:22:20.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.869+0000 7f1f71d2b640 1 -- 172.21.15.98:0/829557303 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1f6c15d760 con 0x7f1f6c15f5a0 2024-09-17T05:22:20.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.870+0000 7f1f53fff640 1 -- 172.21.15.98:0/829557303 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5217 (secure 0 0 0) 0x7f1f64083f00 con 0x7f1f6c15f5a0 2024-09-17T05:22:20.871 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:22:20.871 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":7,"btime":"2024-09-17T05:21:56:643998+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4368,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/237112225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":237112225},{"type":"v1","addr":"172.21.15.98:6833","nonce":237112225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4377,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/4042308128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":4042308128},{"type":"v1","addr":"172.21.15.98:6835","nonce":4042308128}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4378,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/313781530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":313781530},{"type":"v1","addr":"172.21.15.167:6836","nonce":313781530}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:21:53.826247+0000","modified":"2024-09-17T05:21:55.988646+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4386},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4386":{"gid":4386,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6837/4171766128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":4171766128},{"type":"v1","addr":"172.21.15.167:6837","nonce":4171766128}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4386,"qdb_cluster":[4386]},"id":1}]} 2024-09-17T05:22:20.871 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 7 2024-09-17T05:22:20.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.872+0000 7f1f71d2b640 1 -- 172.21.15.98:0/829557303 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f1f58078b90 msgr2=0x7f1f5807b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:20.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.872+0000 7f1f71d2b640 1 --2- 172.21.15.98:0/829557303 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f1f58078b90 0x7f1f5807b050 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c002170 tx=0x7f1f5c009040 comp rx=0 tx=0).stop 2024-09-17T05:22:20.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.872+0000 7f1f71d2b640 1 -- 172.21.15.98:0/829557303 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f6c15f5a0 msgr2=0x7f1f6c14db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:20.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.872+0000 7f1f71d2b640 1 --2- 172.21.15.98:0/829557303 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f6c15f5a0 0x7f1f6c14db00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1f6402aa70 tx=0x7f1f64032c10 comp rx=0 tx=0).stop 2024-09-17T05:22:20.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.872+0000 7f1f71d2b640 1 -- 172.21.15.98:0/829557303 shutdown_connections 2024-09-17T05:22:20.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.872+0000 7f1f71d2b640 1 --2- 172.21.15.98:0/829557303 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f1f58078b90 0x7f1f5807b050 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:20.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.872+0000 7f1f71d2b640 1 --2- 172.21.15.98:0/829557303 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f6c15f5a0 0x7f1f6c14db00 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:20.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.872+0000 7f1f71d2b640 1 --2- 172.21.15.98:0/829557303 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f6c0ccf00 0x7f1f6c14d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:20.874 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.872+0000 7f1f71d2b640 1 --2- 172.21.15.98:0/829557303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f6c073fb0 0x7f1f6c150560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:20.874 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.872+0000 7f1f71d2b640 1 -- 172.21.15.98:0/829557303 >> 172.21.15.98:0/829557303 conn(0x7f1f6c0b1950 msgr2=0x7f1f6c0acd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:20.874 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.872+0000 7f1f71d2b640 1 -- 172.21.15.98:0/829557303 shutdown_connections 2024-09-17T05:22:20.874 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.872+0000 7f1f71d2b640 1 -- 172.21.15.98:0/829557303 wait complete. 2024-09-17T05:22:20.884 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:22:20.985 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.984+0000 7f3d064e6640 1 -- 172.21.15.98:0/3484124521 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d000d1610 msgr2=0x7f3d000cecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:20.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.984+0000 7f3d064e6640 1 --2- 172.21.15.98:0/3484124521 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d000d1610 0x7f3d000cecc0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3d0008e550 tx=0x7f3cf802aa30 comp rx=0 tx=0).stop 2024-09-17T05:22:20.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.984+0000 7f3d064e6640 1 -- 172.21.15.98:0/3484124521 shutdown_connections 2024-09-17T05:22:20.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.984+0000 7f3d064e6640 1 --2- 172.21.15.98:0/3484124521 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d000d1610 0x7f3d000cecc0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:20.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.984+0000 7f3d064e6640 1 --2- 172.21.15.98:0/3484124521 >> v2:172.21.15.167:3300/0 conn(0x7f3d0015e0d0 0x7f3d000d09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:20.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.984+0000 7f3d064e6640 1 -- 172.21.15.98:0/3484124521 >> 172.21.15.98:0/3484124521 conn(0x7f3d000d3fe0 msgr2=0x7f3d000d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:20.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.984+0000 7f3d064e6640 1 -- 172.21.15.98:0/3484124521 shutdown_connections 2024-09-17T05:22:20.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.984+0000 7f3d064e6640 1 -- 172.21.15.98:0/3484124521 wait complete. 2024-09-17T05:22:20.989 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.985+0000 7f3d064e6640 1 Processor -- start 2024-09-17T05:22:20.989 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.986+0000 7f3d064e6640 1 -- start start 2024-09-17T05:22:20.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.986+0000 7f3d064e6640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d000d1610 0x7f3d000b7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:20.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.986+0000 7f3d064e6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d000d2050 0x7f3d000c9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:20.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.986+0000 7f3d064e6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d0015e0d0 0x7f3d001f8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:20.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.986+0000 7f3d064e6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3d000cf610 con 0x7f3d0015e0d0 2024-09-17T05:22:20.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.986+0000 7f3d064e6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3d000cf490 con 0x7f3d000d2050 2024-09-17T05:22:20.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.986+0000 7f3d064e6640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f3d000cf790 con 0x7f3d000d1610 2024-09-17T05:22:20.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.986+0000 7f3d04a83640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d0015e0d0 0x7f3d001f8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:20.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.986+0000 7f3d04a83640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d0015e0d0 0x7f3d001f8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36152/0 (socket says 172.21.15.98:36152) 2024-09-17T05:22:20.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.986+0000 7f3d04a83640 1 -- 172.21.15.98:0/1983718652 learned_addr learned my addr 172.21.15.98:0/1983718652 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:20.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.987+0000 7f3cfffff640 1 --2- 172.21.15.98:0/1983718652 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d000d1610 0x7f3d000b7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:20.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.987+0000 7f3cff7fe640 1 --2- 172.21.15.98:0/1983718652 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d000d2050 0x7f3d000c9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:20.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.987+0000 7f3d04a83640 1 -- 172.21.15.98:0/1983718652 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d000d1610 msgr2=0x7f3d000b7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:20.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.987+0000 7f3d04a83640 1 --2- 172.21.15.98:0/1983718652 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d000d1610 0x7f3d000b7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:20.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.987+0000 7f3d04a83640 1 -- 172.21.15.98:0/1983718652 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d000d2050 msgr2=0x7f3d000c9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:20.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.987+0000 7f3d04a83640 1 --2- 172.21.15.98:0/1983718652 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d000d2050 0x7f3d000c9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:20.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.987+0000 7f3d04a83640 1 -- 172.21.15.98:0/1983718652 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d000b8780 con 0x7f3d0015e0d0 2024-09-17T05:22:20.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.987+0000 7f3cfffff640 1 --2- 172.21.15.98:0/1983718652 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d000d1610 0x7f3d000b7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:22:20.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.987+0000 7f3d04a83640 1 --2- 172.21.15.98:0/1983718652 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d0015e0d0 0x7f3d001f8270 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3cf802b020 tx=0x7f3cf8003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:20.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.987+0000 7f3cfcff9640 1 -- 172.21.15.98:0/1983718652 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf8046070 con 0x7f3d0015e0d0 2024-09-17T05:22:20.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.987+0000 7f3cfcff9640 1 -- 172.21.15.98:0/1983718652 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3cf8004250 con 0x7f3d0015e0d0 2024-09-17T05:22:20.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.987+0000 7f3cfcff9640 1 -- 172.21.15.98:0/1983718652 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf8033050 con 0x7f3d0015e0d0 2024-09-17T05:22:20.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.987+0000 7f3d064e6640 1 -- 172.21.15.98:0/1983718652 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d000b8a60 con 0x7f3d0015e0d0 2024-09-17T05:22:20.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.987+0000 7f3d064e6640 1 -- 172.21.15.98:0/1983718652 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d000b9300 con 0x7f3d0015e0d0 2024-09-17T05:22:20.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.988+0000 7f3d064e6640 1 -- 172.21.15.98:0/1983718652 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d000b9500 con 0x7f3d0015e0d0 2024-09-17T05:22:20.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.989+0000 7f3cfcff9640 1 -- 172.21.15.98:0/1983718652 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3cf8049070 con 0x7f3d0015e0d0 2024-09-17T05:22:20.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.989+0000 7f3cfcff9640 1 --2- 172.21.15.98:0/1983718652 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f3cec078b90 0x7f3cec07b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:20.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.989+0000 7f3cfcff9640 1 -- 172.21.15.98:0/1983718652 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3cf80bbcb0 con 0x7f3d0015e0d0 2024-09-17T05:22:20.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.989+0000 7f3cfffff640 1 --2- 172.21.15.98:0/1983718652 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f3cec078b90 0x7f3cec07b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:20.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.990+0000 7f3cfffff640 1 --2- 172.21.15.98:0/1983718652 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f3cec078b90 0x7f3cec07b050 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3cf0005fd0 tx=0x7f3cf000f360 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:20.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:20.994+0000 7f3cfcff9640 1 -- 172.21.15.98:0/1983718652 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f3d000b9500 con 0x7f3d0015e0d0 2024-09-17T05:22:21.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.204+0000 7f3d064e6640 1 -- 172.21.15.98:0/1983718652 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3d000b8c30 con 0x7f3d0015e0d0 2024-09-17T05:22:21.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.205+0000 7f3cfcff9640 1 -- 172.21.15.98:0/1983718652 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5217 (secure 0 0 0) 0x7f3cf8084180 con 0x7f3d0015e0d0 2024-09-17T05:22:21.206 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:22:21.206 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":7,"btime":"2024-09-17T05:21:56:643998+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4368,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/237112225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":237112225},{"type":"v1","addr":"172.21.15.98:6833","nonce":237112225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4377,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/4042308128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":4042308128},{"type":"v1","addr":"172.21.15.98:6835","nonce":4042308128}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4378,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/313781530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":313781530},{"type":"v1","addr":"172.21.15.167:6836","nonce":313781530}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:21:53.826247+0000","modified":"2024-09-17T05:21:55.988646+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4386},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4386":{"gid":4386,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6837/4171766128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":4171766128},{"type":"v1","addr":"172.21.15.167:6837","nonce":4171766128}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4386,"qdb_cluster":[4386]},"id":1}]} 2024-09-17T05:22:21.206 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 7 2024-09-17T05:22:21.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.207+0000 7f3d064e6640 1 -- 172.21.15.98:0/1983718652 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f3cec078b90 msgr2=0x7f3cec07b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:21.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.207+0000 7f3d064e6640 1 --2- 172.21.15.98:0/1983718652 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f3cec078b90 0x7f3cec07b050 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3cf0005fd0 tx=0x7f3cf000f360 comp rx=0 tx=0).stop 2024-09-17T05:22:21.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.207+0000 7f3d064e6640 1 -- 172.21.15.98:0/1983718652 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d0015e0d0 msgr2=0x7f3d001f8270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:21.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.207+0000 7f3d064e6640 1 --2- 172.21.15.98:0/1983718652 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d0015e0d0 0x7f3d001f8270 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3cf802b020 tx=0x7f3cf8003f10 comp rx=0 tx=0).stop 2024-09-17T05:22:21.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.207+0000 7f3d064e6640 1 -- 172.21.15.98:0/1983718652 shutdown_connections 2024-09-17T05:22:21.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.207+0000 7f3d064e6640 1 --2- 172.21.15.98:0/1983718652 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f3cec078b90 0x7f3cec07b050 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:21.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.207+0000 7f3d064e6640 1 --2- 172.21.15.98:0/1983718652 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d0015e0d0 0x7f3d001f8270 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:21.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.207+0000 7f3d064e6640 1 --2- 172.21.15.98:0/1983718652 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d000d2050 0x7f3d000c9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:21.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.207+0000 7f3d064e6640 1 --2- 172.21.15.98:0/1983718652 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d000d1610 0x7f3d000b7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:21.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.207+0000 7f3d064e6640 1 -- 172.21.15.98:0/1983718652 >> 172.21.15.98:0/1983718652 conn(0x7f3d000d3fe0 msgr2=0x7f3d0015f980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:21.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.207+0000 7f3d064e6640 1 -- 172.21.15.98:0/1983718652 shutdown_connections 2024-09-17T05:22:21.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.207+0000 7f3d064e6640 1 -- 172.21.15.98:0/1983718652 wait complete. 2024-09-17T05:22:21.219 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:22:21.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.319+0000 7f67f6f90640 1 -- 172.21.15.98:0/807497021 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f67f00b4ca0 msgr2=0x7f67f00cf130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:21.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.319+0000 7f67f6f90640 1 --2- 172.21.15.98:0/807497021 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f67f00b4ca0 0x7f67f00cf130 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f67e8005fd0 tx=0x7f67e802a940 comp rx=0 tx=0).stop 2024-09-17T05:22:21.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.319+0000 7f67f6f90640 1 -- 172.21.15.98:0/807497021 shutdown_connections 2024-09-17T05:22:21.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.319+0000 7f67f6f90640 1 --2- 172.21.15.98:0/807497021 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f67f00b4ca0 0x7f67f00cf130 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:21.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.319+0000 7f67f6f90640 1 --2- 172.21.15.98:0/807497021 >> v2:172.21.15.167:3300/0 conn(0x7f67f01445d0 0x7f67f00cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:21.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.319+0000 7f67f6f90640 1 -- 172.21.15.98:0/807497021 >> 172.21.15.98:0/807497021 conn(0x7f67f00b1950 msgr2=0x7f67f00b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:21.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.319+0000 7f67f6f90640 1 -- 172.21.15.98:0/807497021 shutdown_connections 2024-09-17T05:22:21.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.319+0000 7f67f6f90640 1 -- 172.21.15.98:0/807497021 wait complete. 2024-09-17T05:22:21.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.320+0000 7f67f6f90640 1 Processor -- start 2024-09-17T05:22:21.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.321+0000 7f67f6f90640 1 -- start start 2024-09-17T05:22:21.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.321+0000 7f67f6f90640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f67f00b4ca0 0x7f67f013c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:21.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.321+0000 7f67f6f90640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f67f00ccfd0 0x7f67f013e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:21.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.321+0000 7f67f6f90640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f67f01445d0 0x7f67f013a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:21.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.321+0000 7f67f6f90640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f67f015f080 con 0x7f67f00b4ca0 2024-09-17T05:22:21.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.321+0000 7f67f6f90640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f67f0073bc0 con 0x7f67f00ccfd0 2024-09-17T05:22:21.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.321+0000 7f67f6f90640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f67f015f200 con 0x7f67f01445d0 2024-09-17T05:22:21.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.322+0000 7f67f4d2c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f67f00b4ca0 0x7f67f013c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:21.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.322+0000 7f67f4d2c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f67f00b4ca0 0x7f67f013c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36166/0 (socket says 172.21.15.98:36166) 2024-09-17T05:22:21.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.322+0000 7f67f4d2c640 1 -- 172.21.15.98:0/2556799583 learned_addr learned my addr 172.21.15.98:0/2556799583 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:21.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.322+0000 7f67effff640 1 --2- 172.21.15.98:0/2556799583 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f67f00ccfd0 0x7f67f013e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:21.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.322+0000 7f67f552d640 1 --2- 172.21.15.98:0/2556799583 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f67f01445d0 0x7f67f013a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:21.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.322+0000 7f67f4d2c640 1 -- 172.21.15.98:0/2556799583 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f67f01445d0 msgr2=0x7f67f013a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:21.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.322+0000 7f67f4d2c640 1 --2- 172.21.15.98:0/2556799583 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f67f01445d0 0x7f67f013a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:21.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.322+0000 7f67f4d2c640 1 -- 172.21.15.98:0/2556799583 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f67f00ccfd0 msgr2=0x7f67f013e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:21.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.322+0000 7f67f4d2c640 1 --2- 172.21.15.98:0/2556799583 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f67f00ccfd0 0x7f67f013e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:21.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.322+0000 7f67f4d2c640 1 -- 172.21.15.98:0/2556799583 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67f013ea10 con 0x7f67f00b4ca0 2024-09-17T05:22:21.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.322+0000 7f67effff640 1 --2- 172.21.15.98:0/2556799583 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f67f00ccfd0 0x7f67f013e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:22:21.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.322+0000 7f67f4d2c640 1 --2- 172.21.15.98:0/2556799583 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f67f00b4ca0 0x7f67f013c690 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f67e000e7c0 tx=0x7f67e000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:21.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.322+0000 7f67ed7fa640 1 -- 172.21.15.98:0/2556799583 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e000ccc0 con 0x7f67f00b4ca0 2024-09-17T05:22:21.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.322+0000 7f67ed7fa640 1 -- 172.21.15.98:0/2556799583 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f67e0010430 con 0x7f67f00b4ca0 2024-09-17T05:22:21.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.322+0000 7f67f6f90640 1 -- 172.21.15.98:0/2556799583 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67f013ecf0 con 0x7f67f00b4ca0 2024-09-17T05:22:21.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.322+0000 7f67ed7fa640 1 -- 172.21.15.98:0/2556799583 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e0010860 con 0x7f67f00b4ca0 2024-09-17T05:22:21.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.322+0000 7f67f6f90640 1 -- 172.21.15.98:0/2556799583 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67f013f2b0 con 0x7f67f00b4ca0 2024-09-17T05:22:21.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.323+0000 7f67f6f90640 1 -- 172.21.15.98:0/2556799583 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67f015f6b0 con 0x7f67f00b4ca0 2024-09-17T05:22:21.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.324+0000 7f67ed7fa640 1 -- 172.21.15.98:0/2556799583 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f67e0010a00 con 0x7f67f00b4ca0 2024-09-17T05:22:21.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.324+0000 7f67ed7fa640 1 --2- 172.21.15.98:0/2556799583 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f67dc078b90 0x7f67dc07b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:21.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.324+0000 7f67ed7fa640 1 -- 172.21.15.98:0/2556799583 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f67e009b790 con 0x7f67f00b4ca0 2024-09-17T05:22:21.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.324+0000 7f67effff640 1 --2- 172.21.15.98:0/2556799583 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f67dc078b90 0x7f67dc07b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:21.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.325+0000 7f67effff640 1 --2- 172.21.15.98:0/2556799583 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f67dc078b90 0x7f67dc07b050 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f67f013a160 tx=0x7f67e4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:21.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.328+0000 7f67ed7fa640 1 -- 172.21.15.98:0/2556799583 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f67e0063be0 con 0x7f67f00b4ca0 2024-09-17T05:22:21.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.506+0000 7f67f6f90640 1 -- 172.21.15.98:0/2556799583 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f67f015b160 con 0x7f67f00b4ca0 2024-09-17T05:22:21.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.507+0000 7f67ed7fa640 1 -- 172.21.15.98:0/2556799583 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16653 (secure 0 0 0) 0x7f67e00634e0 con 0x7f67f00b4ca0 2024-09-17T05:22:21.508 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:22:21.508 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":21,"fsid":"fcbf5a43-b3d8-497c-b15d-3cc022477cf0","created":"2024-09-17T05:21:29.852143+0000","modified":"2024-09-17T05:21:55.491401+0000","last_up_change":"2024-09-17T05:21:42.925756+0000","last_in_change":"2024-09-17T05:21:32.893880+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:21:42.263011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:21:51.665719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T05:21:52.780673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ad711a-df74-438b-b0dc-1499d685c958","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6825","nonce":3644101529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6827","nonce":3644101529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6831","nonce":3644101529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6829","nonce":3644101529}]},"public_addr":"172.21.15.98:6825/3644101529","cluster_addr":"172.21.15.98:6827/3644101529","heartbeat_back_addr":"172.21.15.98:6831/3644101529","heartbeat_front_addr":"172.21.15.98:6829/3644101529","state":["exists","up"]},{"osd":1,"uuid":"f0ccb08d-4d8d-47b8-9320-8c372a6605b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6817","nonce":3902180920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6819","nonce":3902180920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6823","nonce":3902180920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6821","nonce":3902180920}]},"public_addr":"172.21.15.98:6817/3902180920","cluster_addr":"172.21.15.98:6819/3902180920","heartbeat_back_addr":"172.21.15.98:6823/3902180920","heartbeat_front_addr":"172.21.15.98:6821/3902180920","state":["exists","up"]},{"osd":2,"uuid":"a0985398-5e5f-494f-8abf-f785f19e94ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6801","nonce":1518887101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6803","nonce":1518887101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6807","nonce":1518887101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6805","nonce":1518887101}]},"public_addr":"172.21.15.98:6801/1518887101","cluster_addr":"172.21.15.98:6803/1518887101","heartbeat_back_addr":"172.21.15.98:6807/1518887101","heartbeat_front_addr":"172.21.15.98:6805/1518887101","state":["exists","up"]},{"osd":3,"uuid":"e960be2e-0c3a-426e-9507-d3be5895f9e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6809","nonce":4125246091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6811","nonce":4125246091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6815","nonce":4125246091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6813","nonce":4125246091}]},"public_addr":"172.21.15.98:6809/4125246091","cluster_addr":"172.21.15.98:6811/4125246091","heartbeat_back_addr":"172.21.15.98:6815/4125246091","heartbeat_front_addr":"172.21.15.98:6813/4125246091","state":["exists","up"]},{"osd":4,"uuid":"49118c00-3dc1-43ef-8ed4-aca61e56a507","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6811","nonce":765789888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6813","nonce":765789888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6817","nonce":765789888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6815","nonce":765789888}]},"public_addr":"172.21.15.167:6811/765789888","cluster_addr":"172.21.15.167:6813/765789888","heartbeat_back_addr":"172.21.15.167:6817/765789888","heartbeat_front_addr":"172.21.15.167:6815/765789888","state":["exists","up"]},{"osd":5,"uuid":"9f4e0143-2b3d-40e4-bfb5-043d9a9f4ba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6803","nonce":2567019914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6805","nonce":2567019914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6809","nonce":2567019914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6807","nonce":2567019914}]},"public_addr":"172.21.15.167:6803/2567019914","cluster_addr":"172.21.15.167:6805/2567019914","heartbeat_back_addr":"172.21.15.167:6809/2567019914","heartbeat_front_addr":"172.21.15.167:6807/2567019914","state":["exists","up"]},{"osd":6,"uuid":"28720514-e627-4dea-8f4d-bd311ec31361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6819","nonce":96262631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6821","nonce":96262631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6825","nonce":96262631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6823","nonce":96262631}]},"public_addr":"172.21.15.167:6819/96262631","cluster_addr":"172.21.15.167:6821/96262631","heartbeat_back_addr":"172.21.15.167:6825/96262631","heartbeat_front_addr":"172.21.15.167:6823/96262631","state":["exists","up"]},{"osd":7,"uuid":"01edaf9c-3898-406e-85b0-774cfda60adf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6827","nonce":4169560909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6829","nonce":4169560909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6833","nonce":4169560909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6831","nonce":4169560909}]},"public_addr":"172.21.15.167:6827/4169560909","cluster_addr":"172.21.15.167:6829/4169560909","heartbeat_back_addr":"172.21.15.167:6833/4169560909","heartbeat_front_addr":"172.21.15.167:6831/4169560909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:40.054920+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.177110+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.749278+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.400155+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.503576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.196417+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.371063+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.212852+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:22:21.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.509+0000 7f67f6f90640 1 -- 172.21.15.98:0/2556799583 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f67dc078b90 msgr2=0x7f67dc07b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:21.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.509+0000 7f67f6f90640 1 --2- 172.21.15.98:0/2556799583 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f67dc078b90 0x7f67dc07b050 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f67f013a160 tx=0x7f67e4009040 comp rx=0 tx=0).stop 2024-09-17T05:22:21.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.509+0000 7f67f6f90640 1 -- 172.21.15.98:0/2556799583 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f67f00b4ca0 msgr2=0x7f67f013c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:21.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.509+0000 7f67f6f90640 1 --2- 172.21.15.98:0/2556799583 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f67f00b4ca0 0x7f67f013c690 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f67e000e7c0 tx=0x7f67e000ec80 comp rx=0 tx=0).stop 2024-09-17T05:22:21.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.509+0000 7f67f6f90640 1 -- 172.21.15.98:0/2556799583 shutdown_connections 2024-09-17T05:22:21.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.509+0000 7f67f6f90640 1 --2- 172.21.15.98:0/2556799583 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f67dc078b90 0x7f67dc07b050 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:21.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.509+0000 7f67f6f90640 1 --2- 172.21.15.98:0/2556799583 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f67f01445d0 0x7f67f013a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:21.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.509+0000 7f67f6f90640 1 --2- 172.21.15.98:0/2556799583 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f67f00ccfd0 0x7f67f013e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:21.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.509+0000 7f67f6f90640 1 --2- 172.21.15.98:0/2556799583 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f67f00b4ca0 0x7f67f013c690 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:21.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.509+0000 7f67f6f90640 1 -- 172.21.15.98:0/2556799583 >> 172.21.15.98:0/2556799583 conn(0x7f67f00b1950 msgr2=0x7f67f00af8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:21.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.509+0000 7f67f6f90640 1 -- 172.21.15.98:0/2556799583 shutdown_connections 2024-09-17T05:22:21.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.509+0000 7f67f6f90640 1 -- 172.21.15.98:0/2556799583 wait complete. 2024-09-17T05:22:21.593 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T05:22:21.593 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:22:21.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.693+0000 7fc29b9f4640 1 -- 172.21.15.98:0/211002446 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc2940ad270 msgr2=0x7fc294073fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:21.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.693+0000 7fc29b9f4640 1 --2- 172.21.15.98:0/211002446 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc2940ad270 0x7fc294073fb0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc294075130 tx=0x7fc28c02a4d0 comp rx=0 tx=0).stop 2024-09-17T05:22:21.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.693+0000 7fc29b9f4640 1 -- 172.21.15.98:0/211002446 shutdown_connections 2024-09-17T05:22:21.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.693+0000 7fc29b9f4640 1 --2- 172.21.15.98:0/211002446 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc2940ad270 0x7fc294073fb0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:21.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.693+0000 7fc29b9f4640 1 --2- 172.21.15.98:0/211002446 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc2940ccf00 0x7fc2940acd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:21.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.693+0000 7fc29b9f4640 1 --2- 172.21.15.98:0/211002446 >> v2:172.21.15.167:3300/0 conn(0x7fc29415f5a0 0x7fc2940b2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:21.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.693+0000 7fc29b9f4640 1 -- 172.21.15.98:0/211002446 >> 172.21.15.98:0/211002446 conn(0x7fc2940b1950 msgr2=0x7fc2940b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:21.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.693+0000 7fc29b9f4640 1 -- 172.21.15.98:0/211002446 shutdown_connections 2024-09-17T05:22:21.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.693+0000 7fc29b9f4640 1 -- 172.21.15.98:0/211002446 wait complete. 2024-09-17T05:22:21.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.694+0000 7fc29b9f4640 1 Processor -- start 2024-09-17T05:22:21.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.694+0000 7fc29b9f4640 1 -- start start 2024-09-17T05:22:21.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.695+0000 7fc29b9f4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2940ad270 0x7fc294154280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:21.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.695+0000 7fc29b9f4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc2940ccf00 0x7fc2941f1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:21.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.695+0000 7fc29b9f4640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc29415f5a0 0x7fc29415bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:21.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.695+0000 7fc29b9f4640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc29406f160 con 0x7fc2940ccf00 2024-09-17T05:22:21.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.695+0000 7fc29b9f4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc294074780 con 0x7fc2940ad270 2024-09-17T05:22:21.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.695+0000 7fc29b9f4640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fc29406f2e0 con 0x7fc29415f5a0 2024-09-17T05:22:21.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.695+0000 7fc298f8f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc2940ccf00 0x7fc2941f1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:21.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.695+0000 7fc298f8f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc2940ccf00 0x7fc2941f1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36186/0 (socket says 172.21.15.98:36186) 2024-09-17T05:22:21.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.695+0000 7fc298f8f640 1 -- 172.21.15.98:0/1524419577 learned_addr learned my addr 172.21.15.98:0/1524419577 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:21.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.695+0000 7fc299790640 1 --2- 172.21.15.98:0/1524419577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2940ad270 0x7fc294154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:21.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.695+0000 7fc299f91640 1 --2- 172.21.15.98:0/1524419577 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc29415f5a0 0x7fc29415bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:21.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.695+0000 7fc298f8f640 1 -- 172.21.15.98:0/1524419577 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc29415f5a0 msgr2=0x7fc29415bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:21.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.695+0000 7fc298f8f640 1 --2- 172.21.15.98:0/1524419577 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc29415f5a0 0x7fc29415bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:21.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.695+0000 7fc298f8f640 1 -- 172.21.15.98:0/1524419577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2940ad270 msgr2=0x7fc294154280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:21.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.695+0000 7fc298f8f640 1 --2- 172.21.15.98:0/1524419577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2940ad270 0x7fc294154280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:21.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.695+0000 7fc298f8f640 1 -- 172.21.15.98:0/1524419577 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2941569e0 con 0x7fc2940ccf00 2024-09-17T05:22:21.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.695+0000 7fc299790640 1 --2- 172.21.15.98:0/1524419577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2940ad270 0x7fc294154280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:22:21.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.696+0000 7fc298f8f640 1 --2- 172.21.15.98:0/1524419577 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc2940ccf00 0x7fc2941f1da0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc28800d780 tx=0x7fc28800dc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:21.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.696+0000 7fc291ffb640 1 -- 172.21.15.98:0/1524419577 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc288017070 con 0x7fc2940ccf00 2024-09-17T05:22:21.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.696+0000 7fc291ffb640 1 -- 172.21.15.98:0/1524419577 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc28800de90 con 0x7fc2940ccf00 2024-09-17T05:22:21.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.696+0000 7fc29b9f4640 1 -- 172.21.15.98:0/1524419577 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc294156cc0 con 0x7fc2940ccf00 2024-09-17T05:22:21.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.696+0000 7fc291ffb640 1 -- 172.21.15.98:0/1524419577 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc288005020 con 0x7fc2940ccf00 2024-09-17T05:22:21.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.696+0000 7fc29b9f4640 1 -- 172.21.15.98:0/1524419577 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc294157280 con 0x7fc2940ccf00 2024-09-17T05:22:21.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.697+0000 7fc29b9f4640 1 -- 172.21.15.98:0/1524419577 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc29406f870 con 0x7fc2940ccf00 2024-09-17T05:22:21.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.697+0000 7fc291ffb640 1 -- 172.21.15.98:0/1524419577 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc2880051c0 con 0x7fc2940ccf00 2024-09-17T05:22:21.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.698+0000 7fc291ffb640 1 --2- 172.21.15.98:0/1524419577 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fc280078b90 0x7fc28007b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:21.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.698+0000 7fc291ffb640 1 -- 172.21.15.98:0/1524419577 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc28809adf0 con 0x7fc2940ccf00 2024-09-17T05:22:21.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.698+0000 7fc299790640 1 --2- 172.21.15.98:0/1524419577 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fc280078b90 0x7fc28007b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:21.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.699+0000 7fc299790640 1 --2- 172.21.15.98:0/1524419577 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fc280078b90 0x7fc28007b050 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc284005fd0 tx=0x7fc284009480 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:21.703 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.702+0000 7fc291ffb640 1 -- 172.21.15.98:0/1524419577 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fc2880632c0 con 0x7fc2940ccf00 2024-09-17T05:22:21.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.912+0000 7fc29b9f4640 1 -- 172.21.15.98:0/1524419577 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc2940b03f0 con 0x7fc2940ccf00 2024-09-17T05:22:21.914 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.913+0000 7fc291ffb640 1 -- 172.21.15.98:0/1524419577 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5217 (secure 0 0 0) 0x7fc288062bc0 con 0x7fc2940ccf00 2024-09-17T05:22:21.914 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:22:21.914 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":7,"btime":"2024-09-17T05:21:56:643998+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4368,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/237112225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":237112225},{"type":"v1","addr":"172.21.15.98:6833","nonce":237112225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4377,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/4042308128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":4042308128},{"type":"v1","addr":"172.21.15.98:6835","nonce":4042308128}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4378,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/313781530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":313781530},{"type":"v1","addr":"172.21.15.167:6836","nonce":313781530}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:21:53.826247+0000","modified":"2024-09-17T05:21:55.988646+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4386},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4386":{"gid":4386,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6837/4171766128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":4171766128},{"type":"v1","addr":"172.21.15.167:6837","nonce":4171766128}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4386,"qdb_cluster":[4386]},"id":1}]} 2024-09-17T05:22:21.915 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 7 2024-09-17T05:22:21.916 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.915+0000 7fc29b9f4640 1 -- 172.21.15.98:0/1524419577 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fc280078b90 msgr2=0x7fc28007b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:21.916 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.915+0000 7fc29b9f4640 1 --2- 172.21.15.98:0/1524419577 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fc280078b90 0x7fc28007b050 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc284005fd0 tx=0x7fc284009480 comp rx=0 tx=0).stop 2024-09-17T05:22:21.916 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.915+0000 7fc29b9f4640 1 -- 172.21.15.98:0/1524419577 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc2940ccf00 msgr2=0x7fc2941f1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:21.916 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.915+0000 7fc29b9f4640 1 --2- 172.21.15.98:0/1524419577 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc2940ccf00 0x7fc2941f1da0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc28800d780 tx=0x7fc28800dc40 comp rx=0 tx=0).stop 2024-09-17T05:22:21.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.915+0000 7fc29b9f4640 1 -- 172.21.15.98:0/1524419577 shutdown_connections 2024-09-17T05:22:21.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.915+0000 7fc29b9f4640 1 --2- 172.21.15.98:0/1524419577 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fc280078b90 0x7fc28007b050 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:21.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.915+0000 7fc29b9f4640 1 --2- 172.21.15.98:0/1524419577 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc29415f5a0 0x7fc29415bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:21.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.915+0000 7fc29b9f4640 1 --2- 172.21.15.98:0/1524419577 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc2940ccf00 0x7fc2941f1da0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:21.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.915+0000 7fc29b9f4640 1 --2- 172.21.15.98:0/1524419577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2940ad270 0x7fc294154280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:21.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.915+0000 7fc29b9f4640 1 -- 172.21.15.98:0/1524419577 >> 172.21.15.98:0/1524419577 conn(0x7fc2940b1950 msgr2=0x7fc29409cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:21.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.915+0000 7fc29b9f4640 1 -- 172.21.15.98:0/1524419577 shutdown_connections 2024-09-17T05:22:21.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:21.915+0000 7fc29b9f4640 1 -- 172.21.15.98:0/1524419577 wait complete. 2024-09-17T05:22:21.927 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:22:21.931 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:22:21.972 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:22:22.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.028+0000 7f0cfddf8640 1 -- 172.21.15.98:0/276329360 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0cf80d2050 msgr2=0x7f0cf80d10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:22.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.028+0000 7f0cfddf8640 1 --2- 172.21.15.98:0/276329360 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0cf80d2050 0x7f0cf80d10d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0005fd0 tx=0x7f0ce002a5d0 comp rx=0 tx=0).stop 2024-09-17T05:22:22.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.028+0000 7f0cfddf8640 1 -- 172.21.15.98:0/276329360 shutdown_connections 2024-09-17T05:22:22.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.028+0000 7f0cfddf8640 1 --2- 172.21.15.98:0/276329360 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0cf80d2050 0x7f0cf80d10d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:22.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.028+0000 7f0cfddf8640 1 -- 172.21.15.98:0/276329360 >> 172.21.15.98:0/276329360 conn(0x7f0cf80d3fe0 msgr2=0x7f0cf80d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:22.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.028+0000 7f0cfddf8640 1 -- 172.21.15.98:0/276329360 shutdown_connections 2024-09-17T05:22:22.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.028+0000 7f0cfddf8640 1 -- 172.21.15.98:0/276329360 wait complete. 2024-09-17T05:22:22.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.030+0000 7f0cfddf8640 1 Processor -- start 2024-09-17T05:22:22.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.030+0000 7f0cfddf8640 1 -- start start 2024-09-17T05:22:22.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.030+0000 7f0cfddf8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cf80d1610 0x7f0cf80caac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:22.033 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.030+0000 7f0cfddf8640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0cf80d2050 0x7f0cf81f5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:22.033 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.030+0000 7f0cfddf8640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cf815e0d0 0x7f0cf80b8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:22.033 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.030+0000 7f0cfddf8640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf80cf870 con 0x7f0cf80d2050 2024-09-17T05:22:22.033 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.030+0000 7f0cfddf8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf80cf6f0 con 0x7f0cf80d1610 2024-09-17T05:22:22.033 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.030+0000 7f0cfddf8640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f0cf80cf9f0 con 0x7f0cf815e0d0 2024-09-17T05:22:22.033 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.030+0000 7f0ceffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0cf80d2050 0x7f0cf81f5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:22.033 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.030+0000 7f0ceffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0cf80d2050 0x7f0cf81f5370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36198/0 (socket says 172.21.15.98:36198) 2024-09-17T05:22:22.033 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.030+0000 7f0ceffff640 1 -- 172.21.15.98:0/3256171087 learned_addr learned my addr 172.21.15.98:0/3256171087 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:22.033 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.031+0000 7f0cf7fff640 1 --2- 172.21.15.98:0/3256171087 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cf815e0d0 0x7f0cf80b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:22.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.031+0000 7f0cf77fe640 1 --2- 172.21.15.98:0/3256171087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cf80d1610 0x7f0cf80caac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:22.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.031+0000 7f0ceffff640 1 -- 172.21.15.98:0/3256171087 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cf815e0d0 msgr2=0x7f0cf80b8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:22.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.031+0000 7f0ceffff640 1 --2- 172.21.15.98:0/3256171087 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cf815e0d0 0x7f0cf80b8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:22.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.031+0000 7f0ceffff640 1 -- 172.21.15.98:0/3256171087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cf80d1610 msgr2=0x7f0cf80caac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:22.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.031+0000 7f0ceffff640 1 --2- 172.21.15.98:0/3256171087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cf80d1610 0x7f0cf80caac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:22.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.031+0000 7f0ceffff640 1 -- 172.21.15.98:0/3256171087 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cf80b8f60 con 0x7f0cf80d2050 2024-09-17T05:22:22.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.031+0000 7f0ceffff640 1 --2- 172.21.15.98:0/3256171087 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0cf80d2050 0x7f0cf81f5370 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0ce00099f0 tx=0x7f0ce00038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:22.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.031+0000 7f0cf4ff9640 1 -- 172.21.15.98:0/3256171087 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce003f070 con 0x7f0cf80d2050 2024-09-17T05:22:22.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.031+0000 7f0cf4ff9640 1 -- 172.21.15.98:0/3256171087 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0ce00047a0 con 0x7f0cf80d2050 2024-09-17T05:22:22.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.031+0000 7f0cfddf8640 1 -- 172.21.15.98:0/3256171087 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cf80b9240 con 0x7f0cf80d2050 2024-09-17T05:22:22.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.031+0000 7f0cf4ff9640 1 -- 172.21.15.98:0/3256171087 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce0035030 con 0x7f0cf80d2050 2024-09-17T05:22:22.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.031+0000 7f0cfddf8640 1 -- 172.21.15.98:0/3256171087 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cf80ccb50 con 0x7f0cf80d2050 2024-09-17T05:22:22.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.032+0000 7f0cfddf8640 1 -- 172.21.15.98:0/3256171087 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cf80cff10 con 0x7f0cf80d2050 2024-09-17T05:22:22.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.033+0000 7f0cf4ff9640 1 -- 172.21.15.98:0/3256171087 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0ce0042070 con 0x7f0cf80d2050 2024-09-17T05:22:22.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.033+0000 7f0cf4ff9640 1 --2- 172.21.15.98:0/3256171087 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f0cd8078bc0 0x7f0cd807b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:22.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.033+0000 7f0cf4ff9640 1 -- 172.21.15.98:0/3256171087 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0ce00bb840 con 0x7f0cf80d2050 2024-09-17T05:22:22.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.034+0000 7f0cf77fe640 1 --2- 172.21.15.98:0/3256171087 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f0cd8078bc0 0x7f0cd807b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:22.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.034+0000 7f0cf77fe640 1 --2- 172.21.15.98:0/3256171087 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f0cd8078bc0 0x7f0cd807b080 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0ce8006fd0 tx=0x7f0ce8009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:22.038 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.037+0000 7f0cf4ff9640 1 -- 172.21.15.98:0/3256171087 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f0ce0083750 con 0x7f0cf80d2050 2024-09-17T05:22:22.250 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.248+0000 7f0cfddf8640 1 -- 172.21.15.98:0/3256171087 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0cf815e7c0 con 0x7f0cf80d2050 2024-09-17T05:22:22.250 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.249+0000 7f0cf4ff9640 1 -- 172.21.15.98:0/3256171087 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5217 (secure 0 0 0) 0x7f0ce0088180 con 0x7f0cf80d2050 2024-09-17T05:22:22.250 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:22:22.250 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":7,"btime":"2024-09-17T05:21:56:643998+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4368,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/237112225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":237112225},{"type":"v1","addr":"172.21.15.98:6833","nonce":237112225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4377,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/4042308128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":4042308128},{"type":"v1","addr":"172.21.15.98:6835","nonce":4042308128}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4378,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/313781530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":313781530},{"type":"v1","addr":"172.21.15.167:6836","nonce":313781530}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:21:53.826247+0000","modified":"2024-09-17T05:21:55.988646+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4386},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4386":{"gid":4386,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6837/4171766128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":4171766128},{"type":"v1","addr":"172.21.15.167:6837","nonce":4171766128}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4386,"qdb_cluster":[4386]},"id":1}]} 2024-09-17T05:22:22.251 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 7 2024-09-17T05:22:22.252 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.251+0000 7f0cfddf8640 1 -- 172.21.15.98:0/3256171087 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f0cd8078bc0 msgr2=0x7f0cd807b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:22.252 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.251+0000 7f0cfddf8640 1 --2- 172.21.15.98:0/3256171087 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f0cd8078bc0 0x7f0cd807b080 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0ce8006fd0 tx=0x7f0ce8009060 comp rx=0 tx=0).stop 2024-09-17T05:22:22.252 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.251+0000 7f0cfddf8640 1 -- 172.21.15.98:0/3256171087 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0cf80d2050 msgr2=0x7f0cf81f5370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:22.253 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.251+0000 7f0cfddf8640 1 --2- 172.21.15.98:0/3256171087 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0cf80d2050 0x7f0cf81f5370 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0ce00099f0 tx=0x7f0ce00038a0 comp rx=0 tx=0).stop 2024-09-17T05:22:22.253 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.251+0000 7f0cfddf8640 1 -- 172.21.15.98:0/3256171087 shutdown_connections 2024-09-17T05:22:22.253 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.251+0000 7f0cfddf8640 1 --2- 172.21.15.98:0/3256171087 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f0cd8078bc0 0x7f0cd807b080 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:22.253 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.251+0000 7f0cfddf8640 1 --2- 172.21.15.98:0/3256171087 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cf815e0d0 0x7f0cf80b8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:22.253 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.251+0000 7f0cfddf8640 1 --2- 172.21.15.98:0/3256171087 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0cf80d2050 0x7f0cf81f5370 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:22.253 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.251+0000 7f0cfddf8640 1 --2- 172.21.15.98:0/3256171087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cf80d1610 0x7f0cf80caac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:22.253 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.251+0000 7f0cfddf8640 1 -- 172.21.15.98:0/3256171087 >> 172.21.15.98:0/3256171087 conn(0x7f0cf80d3fe0 msgr2=0x7f0cf80b2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:22.253 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.251+0000 7f0cfddf8640 1 -- 172.21.15.98:0/3256171087 shutdown_connections 2024-09-17T05:22:22.253 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.251+0000 7f0cfddf8640 1 -- 172.21.15.98:0/3256171087 wait complete. 2024-09-17T05:22:22.263 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:22:22.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.405+0000 7f99f2f5d640 1 -- 172.21.15.98:0/2118454767 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99d8004d40 msgr2=0x7f99d80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:22.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.405+0000 7f99f2f5d640 1 --2- 172.21.15.98:0/2118454767 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99d8004d40 0x7f99d80051c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f99e400c4a0 tx=0x7f99d8005830 comp rx=0 tx=0).stop 2024-09-17T05:22:22.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.405+0000 7f99f14fa640 1 -- 172.21.15.98:0/2118454767 reap_dead start 2024-09-17T05:22:22.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.405+0000 7f99f2f5d640 1 -- 172.21.15.98:0/2118454767 shutdown_connections 2024-09-17T05:22:22.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.405+0000 7f99f2f5d640 1 -- 172.21.15.98:0/2118454767 >> 172.21.15.98:0/2118454767 conn(0x7f99ec0b1950 msgr2=0x7f99ec0b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:22.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.405+0000 7f99f2f5d640 1 -- 172.21.15.98:0/2118454767 shutdown_connections 2024-09-17T05:22:22.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.405+0000 7f99f2f5d640 1 -- 172.21.15.98:0/2118454767 wait complete. 2024-09-17T05:22:22.408 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.406+0000 7f99f2f5d640 1 Processor -- start 2024-09-17T05:22:22.409 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.406+0000 7f99f2f5d640 1 -- start start 2024-09-17T05:22:22.409 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.407+0000 7f99f2f5d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99d8004d40 0x7f99ec14b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:22.409 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.407+0000 7f99f2f5d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f99ec0c4bc0 0x7f99ec0c7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:22.409 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.407+0000 7f99f2f5d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99ec0c7ad0 0x7f99ec09c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:22.409 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.407+0000 7f99f2f5d640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f99ec06f3b0 con 0x7f99d8004d40 2024-09-17T05:22:22.409 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.407+0000 7f99f2f5d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f99ec15dd20 con 0x7f99ec0c7ad0 2024-09-17T05:22:22.409 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.407+0000 7f99f2f5d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f99ec06f530 con 0x7f99ec0c4bc0 2024-09-17T05:22:22.409 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.407+0000 7f99f0cf9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99d8004d40 0x7f99ec14b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:22.409 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.407+0000 7f99f0cf9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99d8004d40 0x7f99ec14b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36214/0 (socket says 172.21.15.98:36214) 2024-09-17T05:22:22.409 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.407+0000 7f99f0cf9640 1 -- 172.21.15.98:0/2574824165 learned_addr learned my addr 172.21.15.98:0/2574824165 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:22.409 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.407+0000 7f99f0cf9640 1 -- 172.21.15.98:0/2574824165 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f99ec0c4bc0 msgr2=0x7f99ec0c7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:22.410 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.407+0000 7f99f0cf9640 1 --2- 172.21.15.98:0/2574824165 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f99ec0c4bc0 0x7f99ec0c7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:22.410 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.407+0000 7f99f0cf9640 1 -- 172.21.15.98:0/2574824165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99ec0c7ad0 msgr2=0x7f99ec09c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:22.410 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.407+0000 7f99f0cf9640 1 --2- 172.21.15.98:0/2574824165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99ec0c7ad0 0x7f99ec09c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:22.410 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.407+0000 7f99f0cf9640 1 -- 172.21.15.98:0/2574824165 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99ec14b980 con 0x7f99d8004d40 2024-09-17T05:22:22.410 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.407+0000 7f99f0cf9640 1 --2- 172.21.15.98:0/2574824165 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99d8004d40 0x7f99ec14b260 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f99dc011e50 tx=0x7f99dc00e780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:22.410 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.407+0000 7f99e97fa640 1 -- 172.21.15.98:0/2574824165 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99dc003b80 con 0x7f99d8004d40 2024-09-17T05:22:22.410 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.408+0000 7f99e97fa640 1 -- 172.21.15.98:0/2574824165 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f99dc003d20 con 0x7f99d8004d40 2024-09-17T05:22:22.410 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.408+0000 7f99f2f5d640 1 -- 172.21.15.98:0/2574824165 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99ec14bc20 con 0x7f99d8004d40 2024-09-17T05:22:22.410 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.408+0000 7f99e97fa640 1 -- 172.21.15.98:0/2574824165 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99dc004290 con 0x7f99d8004d40 2024-09-17T05:22:22.410 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.408+0000 7f99f2f5d640 1 -- 172.21.15.98:0/2574824165 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99ec14c1e0 con 0x7f99d8004d40 2024-09-17T05:22:22.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.408+0000 7f99f2f5d640 1 -- 172.21.15.98:0/2574824165 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99ec0c7ef0 con 0x7f99d8004d40 2024-09-17T05:22:22.412 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.409+0000 7f99e97fa640 1 -- 172.21.15.98:0/2574824165 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f99dc004430 con 0x7f99d8004d40 2024-09-17T05:22:22.412 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.410+0000 7f99e97fa640 1 --2- 172.21.15.98:0/2574824165 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f99cc078b90 0x7f99cc07b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:22.412 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.410+0000 7f99e97fa640 1 -- 172.21.15.98:0/2574824165 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f99dc09dd60 con 0x7f99d8004d40 2024-09-17T05:22:22.412 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.410+0000 7f99ebfff640 1 --2- 172.21.15.98:0/2574824165 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f99cc078b90 0x7f99cc07b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:22.412 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.410+0000 7f99ebfff640 1 --2- 172.21.15.98:0/2574824165 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f99cc078b90 0x7f99cc07b050 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f99ec15a9f0 tx=0x7f99d400a480 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:22.414 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.414+0000 7f99e97fa640 1 -- 172.21.15.98:0/2574824165 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f99dc0662c0 con 0x7f99d8004d40 2024-09-17T05:22:22.593 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.592+0000 7f99f2f5d640 1 -- 172.21.15.98:0/2574824165 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f99ec0ad1b0 con 0x7f99d8004d40 2024-09-17T05:22:22.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.596+0000 7f99e97fa640 1 -- 172.21.15.98:0/2574824165 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16653 (secure 0 0 0) 0x7f99dc065bc0 con 0x7f99d8004d40 2024-09-17T05:22:22.597 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:22:22.597 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":21,"fsid":"fcbf5a43-b3d8-497c-b15d-3cc022477cf0","created":"2024-09-17T05:21:29.852143+0000","modified":"2024-09-17T05:21:55.491401+0000","last_up_change":"2024-09-17T05:21:42.925756+0000","last_in_change":"2024-09-17T05:21:32.893880+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:21:42.263011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:21:51.665719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T05:21:52.780673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ad711a-df74-438b-b0dc-1499d685c958","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6825","nonce":3644101529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6827","nonce":3644101529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6831","nonce":3644101529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6829","nonce":3644101529}]},"public_addr":"172.21.15.98:6825/3644101529","cluster_addr":"172.21.15.98:6827/3644101529","heartbeat_back_addr":"172.21.15.98:6831/3644101529","heartbeat_front_addr":"172.21.15.98:6829/3644101529","state":["exists","up"]},{"osd":1,"uuid":"f0ccb08d-4d8d-47b8-9320-8c372a6605b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6817","nonce":3902180920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6819","nonce":3902180920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6823","nonce":3902180920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6821","nonce":3902180920}]},"public_addr":"172.21.15.98:6817/3902180920","cluster_addr":"172.21.15.98:6819/3902180920","heartbeat_back_addr":"172.21.15.98:6823/3902180920","heartbeat_front_addr":"172.21.15.98:6821/3902180920","state":["exists","up"]},{"osd":2,"uuid":"a0985398-5e5f-494f-8abf-f785f19e94ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6801","nonce":1518887101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6803","nonce":1518887101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6807","nonce":1518887101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6805","nonce":1518887101}]},"public_addr":"172.21.15.98:6801/1518887101","cluster_addr":"172.21.15.98:6803/1518887101","heartbeat_back_addr":"172.21.15.98:6807/1518887101","heartbeat_front_addr":"172.21.15.98:6805/1518887101","state":["exists","up"]},{"osd":3,"uuid":"e960be2e-0c3a-426e-9507-d3be5895f9e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6809","nonce":4125246091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6811","nonce":4125246091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6815","nonce":4125246091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6813","nonce":4125246091}]},"public_addr":"172.21.15.98:6809/4125246091","cluster_addr":"172.21.15.98:6811/4125246091","heartbeat_back_addr":"172.21.15.98:6815/4125246091","heartbeat_front_addr":"172.21.15.98:6813/4125246091","state":["exists","up"]},{"osd":4,"uuid":"49118c00-3dc1-43ef-8ed4-aca61e56a507","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6811","nonce":765789888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6813","nonce":765789888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6817","nonce":765789888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6815","nonce":765789888}]},"public_addr":"172.21.15.167:6811/765789888","cluster_addr":"172.21.15.167:6813/765789888","heartbeat_back_addr":"172.21.15.167:6817/765789888","heartbeat_front_addr":"172.21.15.167:6815/765789888","state":["exists","up"]},{"osd":5,"uuid":"9f4e0143-2b3d-40e4-bfb5-043d9a9f4ba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6803","nonce":2567019914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6805","nonce":2567019914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6809","nonce":2567019914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6807","nonce":2567019914}]},"public_addr":"172.21.15.167:6803/2567019914","cluster_addr":"172.21.15.167:6805/2567019914","heartbeat_back_addr":"172.21.15.167:6809/2567019914","heartbeat_front_addr":"172.21.15.167:6807/2567019914","state":["exists","up"]},{"osd":6,"uuid":"28720514-e627-4dea-8f4d-bd311ec31361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6819","nonce":96262631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6821","nonce":96262631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6825","nonce":96262631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6823","nonce":96262631}]},"public_addr":"172.21.15.167:6819/96262631","cluster_addr":"172.21.15.167:6821/96262631","heartbeat_back_addr":"172.21.15.167:6825/96262631","heartbeat_front_addr":"172.21.15.167:6823/96262631","state":["exists","up"]},{"osd":7,"uuid":"01edaf9c-3898-406e-85b0-774cfda60adf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6827","nonce":4169560909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6829","nonce":4169560909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6833","nonce":4169560909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6831","nonce":4169560909}]},"public_addr":"172.21.15.167:6827/4169560909","cluster_addr":"172.21.15.167:6829/4169560909","heartbeat_back_addr":"172.21.15.167:6833/4169560909","heartbeat_front_addr":"172.21.15.167:6831/4169560909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:40.054920+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.177110+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.749278+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.400155+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.503576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.196417+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.371063+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.212852+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:22:22.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.598+0000 7f99f2f5d640 1 -- 172.21.15.98:0/2574824165 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f99cc078b90 msgr2=0x7f99cc07b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:22.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.598+0000 7f99f2f5d640 1 --2- 172.21.15.98:0/2574824165 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f99cc078b90 0x7f99cc07b050 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f99ec15a9f0 tx=0x7f99d400a480 comp rx=0 tx=0).stop 2024-09-17T05:22:22.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.598+0000 7f99f2f5d640 1 -- 172.21.15.98:0/2574824165 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99d8004d40 msgr2=0x7f99ec14b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:22.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.598+0000 7f99f2f5d640 1 --2- 172.21.15.98:0/2574824165 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99d8004d40 0x7f99ec14b260 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f99dc011e50 tx=0x7f99dc00e780 comp rx=0 tx=0).stop 2024-09-17T05:22:22.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.598+0000 7f99f2f5d640 1 -- 172.21.15.98:0/2574824165 shutdown_connections 2024-09-17T05:22:22.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.598+0000 7f99f2f5d640 1 --2- 172.21.15.98:0/2574824165 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f99cc078b90 0x7f99cc07b050 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:22.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.598+0000 7f99f2f5d640 1 --2- 172.21.15.98:0/2574824165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99ec0c7ad0 0x7f99ec09c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:22.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.598+0000 7f99f2f5d640 1 --2- 172.21.15.98:0/2574824165 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f99ec0c4bc0 0x7f99ec0c7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:22.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.598+0000 7f99f2f5d640 1 --2- 172.21.15.98:0/2574824165 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99d8004d40 0x7f99ec14b260 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:22.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.598+0000 7f99f2f5d640 1 -- 172.21.15.98:0/2574824165 >> 172.21.15.98:0/2574824165 conn(0x7f99ec0b1950 msgr2=0x7f99ec0cf1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:22.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.599+0000 7f99f2f5d640 1 -- 172.21.15.98:0/2574824165 shutdown_connections 2024-09-17T05:22:22.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.599+0000 7f99f2f5d640 1 -- 172.21.15.98:0/2574824165 wait complete. 2024-09-17T05:22:22.611 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T05:22:22.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.712+0000 7f9a657ad640 1 -- 172.21.15.98:0/1348334918 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a6015e0d0 msgr2=0x7f9a600d09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:22.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.712+0000 7f9a657ad640 1 --2- 172.21.15.98:0/1348334918 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a6015e0d0 0x7f9a600d09c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9a58009830 tx=0x7f9a5802a410 comp rx=0 tx=0).stop 2024-09-17T05:22:22.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.712+0000 7f9a657ad640 1 -- 172.21.15.98:0/1348334918 shutdown_connections 2024-09-17T05:22:22.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.712+0000 7f9a657ad640 1 --2- 172.21.15.98:0/1348334918 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9a600d2050 0x7f9a600d0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:22.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.712+0000 7f9a657ad640 1 --2- 172.21.15.98:0/1348334918 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a6015e0d0 0x7f9a600d09c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:22.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.712+0000 7f9a657ad640 1 -- 172.21.15.98:0/1348334918 >> 172.21.15.98:0/1348334918 conn(0x7f9a600d3fe0 msgr2=0x7f9a600d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:22.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.712+0000 7f9a657ad640 1 -- 172.21.15.98:0/1348334918 shutdown_connections 2024-09-17T05:22:22.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.712+0000 7f9a657ad640 1 -- 172.21.15.98:0/1348334918 wait complete. 2024-09-17T05:22:22.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.714+0000 7f9a657ad640 1 Processor -- start 2024-09-17T05:22:22.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.714+0000 7f9a657ad640 1 -- start start 2024-09-17T05:22:22.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.714+0000 7f9a657ad640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a600d1440 0x7f9a600cd500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:22.718 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.714+0000 7f9a657ad640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9a600d2050 0x7f9a6009f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:22.718 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.714+0000 7f9a657ad640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a6015e0d0 0x7f9a6009f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:22.718 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.714+0000 7f9a657ad640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9a6015ebc0 con 0x7f9a6015e0d0 2024-09-17T05:22:22.718 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.714+0000 7f9a657ad640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9a600cff30 con 0x7f9a600d1440 2024-09-17T05:22:22.718 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.714+0000 7f9a657ad640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f9a6015ed40 con 0x7f9a600d2050 2024-09-17T05:22:22.718 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.714+0000 7f9a5f7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a6015e0d0 0x7f9a6009f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:22.719 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.715+0000 7f9a5f7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a6015e0d0 0x7f9a6009f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36224/0 (socket says 172.21.15.98:36224) 2024-09-17T05:22:22.719 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.715+0000 7f9a5f7fe640 1 -- 172.21.15.98:0/1355047297 learned_addr learned my addr 172.21.15.98:0/1355047297 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:22.719 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.715+0000 7f9a5e7fc640 1 --2- 172.21.15.98:0/1355047297 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9a600d2050 0x7f9a6009f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:22.719 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.715+0000 7f9a5effd640 1 --2- 172.21.15.98:0/1355047297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a600d1440 0x7f9a600cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:22.719 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.715+0000 7f9a5f7fe640 1 -- 172.21.15.98:0/1355047297 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9a600d2050 msgr2=0x7f9a6009f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:22.719 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.715+0000 7f9a5f7fe640 1 --2- 172.21.15.98:0/1355047297 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9a600d2050 0x7f9a6009f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:22.719 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.715+0000 7f9a5f7fe640 1 -- 172.21.15.98:0/1355047297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a600d1440 msgr2=0x7f9a600cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:22.719 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.715+0000 7f9a5f7fe640 1 --2- 172.21.15.98:0/1355047297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a600d1440 0x7f9a600cd500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:22.720 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.715+0000 7f9a5f7fe640 1 -- 172.21.15.98:0/1355047297 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a600c9810 con 0x7f9a6015e0d0 2024-09-17T05:22:22.720 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.715+0000 7f9a5f7fe640 1 --2- 172.21.15.98:0/1355047297 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a6015e0d0 0x7f9a6009f6e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9a5000caa0 tx=0x7f9a5000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:22.720 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.715+0000 7f9a577fe640 1 -- 172.21.15.98:0/1355047297 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a50017070 con 0x7f9a6015e0d0 2024-09-17T05:22:22.720 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.715+0000 7f9a577fe640 1 -- 172.21.15.98:0/1355047297 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9a5000a6d0 con 0x7f9a6015e0d0 2024-09-17T05:22:22.720 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.715+0000 7f9a657ad640 1 -- 172.21.15.98:0/1355047297 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a601f4b90 con 0x7f9a6015e0d0 2024-09-17T05:22:22.720 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.715+0000 7f9a577fe640 1 -- 172.21.15.98:0/1355047297 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a5000ab20 con 0x7f9a6015e0d0 2024-09-17T05:22:22.720 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.715+0000 7f9a657ad640 1 -- 172.21.15.98:0/1355047297 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a601f5150 con 0x7f9a6015e0d0 2024-09-17T05:22:22.720 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.716+0000 7f9a657ad640 1 -- 172.21.15.98:0/1355047297 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a6015f260 con 0x7f9a6015e0d0 2024-09-17T05:22:22.720 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.717+0000 7f9a577fe640 1 -- 172.21.15.98:0/1355047297 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9a5001a070 con 0x7f9a6015e0d0 2024-09-17T05:22:22.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.717+0000 7f9a577fe640 1 --2- 172.21.15.98:0/1355047297 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f9a40078b90 0x7f9a4007b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:22.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.718+0000 7f9a577fe640 1 -- 172.21.15.98:0/1355047297 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9a5009a530 con 0x7f9a6015e0d0 2024-09-17T05:22:22.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.718+0000 7f9a5effd640 1 --2- 172.21.15.98:0/1355047297 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f9a40078b90 0x7f9a4007b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:22.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.718+0000 7f9a5effd640 1 --2- 172.21.15.98:0/1355047297 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f9a40078b90 0x7f9a4007b050 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9a58034000 tx=0x7f9a58004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:22.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.722+0000 7f9a577fe640 1 -- 172.21.15.98:0/1355047297 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f9a50062a00 con 0x7f9a6015e0d0 2024-09-17T05:22:22.936 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.936+0000 7f9a657ad640 1 -- 172.21.15.98:0/1355047297 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f9a600b70d0 con 0x7f9a6015e0d0 2024-09-17T05:22:22.937 INFO:tasks.ceph.mon.a.smithi098.stderr:2024-09-17T05:22:22.936+0000 7fd8a3957640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T05:22:22.938 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.938+0000 7f9a577fe640 1 -- 172.21.15.98:0/1355047297 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) ==== 161+0+0 (secure 0 0 0) 0x7f9a50062300 con 0x7f9a6015e0d0 2024-09-17T05:22:22.938 INFO:teuthology.orchestra.run.smithi098.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T05:22:22.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.941+0000 7f9a657ad640 1 -- 172.21.15.98:0/1355047297 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f9a40078b90 msgr2=0x7f9a4007b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:22.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.941+0000 7f9a657ad640 1 --2- 172.21.15.98:0/1355047297 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f9a40078b90 0x7f9a4007b050 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9a58034000 tx=0x7f9a58004730 comp rx=0 tx=0).stop 2024-09-17T05:22:22.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.941+0000 7f9a657ad640 1 -- 172.21.15.98:0/1355047297 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a6015e0d0 msgr2=0x7f9a6009f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:22.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.941+0000 7f9a657ad640 1 --2- 172.21.15.98:0/1355047297 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a6015e0d0 0x7f9a6009f6e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9a5000caa0 tx=0x7f9a5000cf60 comp rx=0 tx=0).stop 2024-09-17T05:22:22.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.941+0000 7f9a657ad640 1 -- 172.21.15.98:0/1355047297 shutdown_connections 2024-09-17T05:22:22.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.941+0000 7f9a657ad640 1 --2- 172.21.15.98:0/1355047297 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f9a40078b90 0x7f9a4007b050 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:22.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.941+0000 7f9a657ad640 1 --2- 172.21.15.98:0/1355047297 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a6015e0d0 0x7f9a6009f6e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:22.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.941+0000 7f9a657ad640 1 --2- 172.21.15.98:0/1355047297 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9a600d2050 0x7f9a6009f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:22.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.941+0000 7f9a657ad640 1 --2- 172.21.15.98:0/1355047297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a600d1440 0x7f9a600cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:22.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.941+0000 7f9a657ad640 1 -- 172.21.15.98:0/1355047297 >> 172.21.15.98:0/1355047297 conn(0x7f9a600d3fe0 msgr2=0x7f9a60160ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:22.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.941+0000 7f9a657ad640 1 -- 172.21.15.98:0/1355047297 shutdown_connections 2024-09-17T05:22:22.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:22.941+0000 7f9a657ad640 1 -- 172.21.15.98:0/1355047297 wait complete. 2024-09-17T05:22:22.944 INFO:tasks.ceph.mds.b.smithi167.stderr: -8195> 2024-09-17T05:21:48.463+0000 7f02fb54e640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-09-17T05:22:22.946 INFO:tasks.ceph.mds.b.smithi167.stderr: -6776> 2024-09-17T05:21:59.458+0000 7f02f5542640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:22:22.953 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T05:22:22.979 INFO:tasks.ceph.mds.b.smithi167.stdout:starting mds.b at 2024-09-17T05:22:23.057 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:23.055+0000 7f87775bb640 1 -- 172.21.15.98:0/2595035957 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87700739d0 msgr2=0x7f877015e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:23.057 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:23.055+0000 7f87775bb640 1 --2- 172.21.15.98:0/2595035957 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87700739d0 0x7f877015e0f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f877006db10 tx=0x7f876802a8b0 comp rx=0 tx=0).stop 2024-09-17T05:22:23.057 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:23.056+0000 7f87775bb640 1 -- 172.21.15.98:0/2595035957 shutdown_connections 2024-09-17T05:22:23.057 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:23.056+0000 7f87775bb640 1 --2- 172.21.15.98:0/2595035957 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87700739d0 0x7f877015e0f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:23.057 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:23.056+0000 7f87775bb640 1 --2- 172.21.15.98:0/2595035957 >> v2:172.21.15.167:3300/0 conn(0x7f87701517a0 0x7f87700cdad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:23.057 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:23.056+0000 7f87775bb640 1 -- 172.21.15.98:0/2595035957 >> 172.21.15.98:0/2595035957 conn(0x7f87700b1840 msgr2=0x7f87700b1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:23.057 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:23.056+0000 7f87775bb640 1 -- 172.21.15.98:0/2595035957 shutdown_connections 2024-09-17T05:22:23.057 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:23.056+0000 7f87775bb640 1 -- 172.21.15.98:0/2595035957 wait complete. 2024-09-17T05:22:23.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:23.057+0000 7f87775bb640 1 Processor -- start 2024-09-17T05:22:23.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:23.057+0000 7f87775bb640 1 -- start start 2024-09-17T05:22:23.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:23.058+0000 7f87775bb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87700739d0 0x7f87701567b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:23.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:23.058+0000 7f87775bb640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f87700cd490 0x7f877014e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:23.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:23.058+0000 7f87775bb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87701517a0 0x7f87701e5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:23.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:23.058+0000 7f87775bb640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f87700cc7d0 con 0x7f87701517a0 2024-09-17T05:22:23.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:23.058+0000 7f87775bb640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f87700cc650 con 0x7f87700739d0 2024-09-17T05:22:23.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:23.058+0000 7f87775bb640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f87700cc950 con 0x7f87700cd490 2024-09-17T05:22:23.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:23.058+0000 7f8775b58640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87701517a0 0x7f87701e5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:23.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:23.058+0000 7f8775b58640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87701517a0 0x7f87701e5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36236/0 (socket says 172.21.15.98:36236) 2024-09-17T05:22:23.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:23.058+0000 7f8775b58640 1 -- 172.21.15.98:0/2426367529 learned_addr learned my addr 172.21.15.98:0/2426367529 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:23.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:23.058+0000 7f8775357640 1 --2- 172.21.15.98:0/2426367529 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87700739d0 0x7f87701567b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:23.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:23.058+0000 7f8774b56640 1 --2- 172.21.15.98:0/2426367529 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f87700cd490 0x7f877014e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:23.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:23.058+0000 7f8775b58640 1 -- 172.21.15.98:0/2426367529 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f87700cd490 msgr2=0x7f877014e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:23.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:23.058+0000 7f8775b58640 1 --2- 172.21.15.98:0/2426367529 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f87700cd490 0x7f877014e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:23.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:23.058+0000 7f8775b58640 1 -- 172.21.15.98:0/2426367529 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87700739d0 msgr2=0x7f87701567b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:23.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:23.058+0000 7f8775b58640 1 --2- 172.21.15.98:0/2426367529 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87700739d0 0x7f87701567b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:23.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:23.058+0000 7f8775b58640 1 -- 172.21.15.98:0/2426367529 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8770156d90 con 0x7f87701517a0 2024-09-17T05:22:23.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:23.058+0000 7f8775b58640 1 --2- 172.21.15.98:0/2426367529 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87701517a0 0x7f87701e5f00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8768009ca0 tx=0x7f8768031720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:23.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:23.058+0000 7f8765ffb640 1 -- 172.21.15.98:0/2426367529 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8768040070 con 0x7f87701517a0 2024-09-17T05:22:23.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:23.058+0000 7f8765ffb640 1 -- 172.21.15.98:0/2426367529 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8768004040 con 0x7f87701517a0 2024-09-17T05:22:23.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:23.058+0000 7f87775bb640 1 -- 172.21.15.98:0/2426367529 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87701e2ea0 con 0x7f87701517a0 2024-09-17T05:22:23.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:23.058+0000 7f8765ffb640 1 -- 172.21.15.98:0/2426367529 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8768004470 con 0x7f87701517a0 2024-09-17T05:22:23.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:23.059+0000 7f87775bb640 1 -- 172.21.15.98:0/2426367529 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87701e3460 con 0x7f87701517a0 2024-09-17T05:22:23.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:23.060+0000 7f87775bb640 1 -- 172.21.15.98:0/2426367529 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87701e3660 con 0x7f87701517a0 2024-09-17T05:22:23.063 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:23.060+0000 7f8765ffb640 1 -- 172.21.15.98:0/2426367529 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8768039040 con 0x7f87701517a0 2024-09-17T05:22:23.063 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:23.060+0000 7f8765ffb640 1 --2- 172.21.15.98:0/2426367529 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f8754078b90 0x7f875407b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:23.063 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:23.061+0000 7f8765ffb640 1 -- 172.21.15.98:0/2426367529 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5795+0+0 (secure 0 0 0) 0x7f87680bc2b0 con 0x7f87701517a0 2024-09-17T05:22:23.063 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:23.061+0000 7f8775357640 1 --2- 172.21.15.98:0/2426367529 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f8754078b90 0x7f875407b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:23.063 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:23.061+0000 7f8775357640 1 --2- 172.21.15.98:0/2426367529 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f8754078b90 0x7f875407b050 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f876c00bb50 tx=0x7f876c00b2e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:23.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:23.065+0000 7f8765ffb640 1 -- 172.21.15.98:0/2426367529 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f87701e3660 con 0x7f87701517a0 2024-09-17T05:22:23.280 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:23.279+0000 7f87775bb640 1 -- 172.21.15.98:0/2426367529 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f87700cdad0 con 0x7f87701517a0 2024-09-17T05:22:23.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:23.939+0000 7f8765ffb640 1 -- 172.21.15.98:0/2426367529 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) ==== 104+0+0 (secure 0 0 0) 0x7f87680840d0 con 0x7f87701517a0 2024-09-17T05:22:23.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:23.942+0000 7f87775bb640 1 -- 172.21.15.98:0/2426367529 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f8754078b90 msgr2=0x7f875407b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:23.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:23.942+0000 7f87775bb640 1 --2- 172.21.15.98:0/2426367529 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f8754078b90 0x7f875407b050 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f876c00bb50 tx=0x7f876c00b2e0 comp rx=0 tx=0).stop 2024-09-17T05:22:23.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:23.942+0000 7f87775bb640 1 -- 172.21.15.98:0/2426367529 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87701517a0 msgr2=0x7f87701e5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:23.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:23.942+0000 7f87775bb640 1 --2- 172.21.15.98:0/2426367529 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87701517a0 0x7f87701e5f00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8768009ca0 tx=0x7f8768031720 comp rx=0 tx=0).stop 2024-09-17T05:22:23.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:23.942+0000 7f87775bb640 1 -- 172.21.15.98:0/2426367529 shutdown_connections 2024-09-17T05:22:23.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:23.942+0000 7f87775bb640 1 --2- 172.21.15.98:0/2426367529 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f8754078b90 0x7f875407b050 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:23.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:23.942+0000 7f87775bb640 1 --2- 172.21.15.98:0/2426367529 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87701517a0 0x7f87701e5f00 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:23.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:23.942+0000 7f87775bb640 1 --2- 172.21.15.98:0/2426367529 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f87700cd490 0x7f877014e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:23.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:23.942+0000 7f87775bb640 1 --2- 172.21.15.98:0/2426367529 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87700739d0 0x7f87701567b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:23.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:23.942+0000 7f87775bb640 1 -- 172.21.15.98:0/2426367529 >> 172.21.15.98:0/2426367529 conn(0x7f87700b1840 msgr2=0x7f87700afa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:23.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:23.942+0000 7f87775bb640 1 -- 172.21.15.98:0/2426367529 shutdown_connections 2024-09-17T05:22:23.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:23.942+0000 7f87775bb640 1 -- 172.21.15.98:0/2426367529 wait complete. 2024-09-17T05:22:23.955 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T05:22:24.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:24.064+0000 7f42d77da640 1 -- 172.21.15.98:0/1676242119 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42bc004800 msgr2=0x7f42bc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:24.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:24.064+0000 7f42d77da640 1 --2- 172.21.15.98:0/1676242119 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42bc004800 0x7f42bc004c80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f42c00016c0 tx=0x7f42bc005830 comp rx=0 tx=0).stop 2024-09-17T05:22:24.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:24.064+0000 7f42d77da640 1 -- 172.21.15.98:0/1676242119 shutdown_connections 2024-09-17T05:22:24.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:24.064+0000 7f42d77da640 1 --2- 172.21.15.98:0/1676242119 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42bc004800 0x7f42bc004c80 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:24.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:24.064+0000 7f42d77da640 1 -- 172.21.15.98:0/1676242119 >> 172.21.15.98:0/1676242119 conn(0x7f42d006dc80 msgr2=0x7f42d006e090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:24.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:24.065+0000 7f42d77da640 1 -- 172.21.15.98:0/1676242119 shutdown_connections 2024-09-17T05:22:24.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:24.065+0000 7f42d77da640 1 -- 172.21.15.98:0/1676242119 wait complete. 2024-09-17T05:22:24.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:24.066+0000 7f42d77da640 1 Processor -- start 2024-09-17T05:22:24.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:24.066+0000 7f42d77da640 1 -- start start 2024-09-17T05:22:24.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:24.066+0000 7f42d77da640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42bc004800 0x7f42d014a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:24.070 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:24.066+0000 7f42d77da640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42d01582c0 0x7f42d0149eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:24.070 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:24.066+0000 7f42d77da640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f42d01f6b00 0x7f42d00cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:24.070 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:24.066+0000 7f42d77da640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f42d0070520 con 0x7f42d01582c0 2024-09-17T05:22:24.070 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:24.066+0000 7f42d77da640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f42d00703a0 con 0x7f42bc004800 2024-09-17T05:22:24.070 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:24.066+0000 7f42d77da640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f42d00706a0 con 0x7f42d01f6b00 2024-09-17T05:22:24.070 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:24.067+0000 7f42d4d75640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42d01582c0 0x7f42d0149eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:24.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:24.067+0000 7f42d4d75640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42d01582c0 0x7f42d0149eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36250/0 (socket says 172.21.15.98:36250) 2024-09-17T05:22:24.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:24.067+0000 7f42d4d75640 1 -- 172.21.15.98:0/2390387680 learned_addr learned my addr 172.21.15.98:0/2390387680 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:24.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:24.067+0000 7f42d4d75640 1 -- 172.21.15.98:0/2390387680 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f42d01f6b00 msgr2=0x7f42d00cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:24.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:24.067+0000 7f42d5576640 1 --2- 172.21.15.98:0/2390387680 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42bc004800 0x7f42d014a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:24.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:24.067+0000 7f42d4d75640 1 --2- 172.21.15.98:0/2390387680 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f42d01f6b00 0x7f42d00cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:24.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:24.067+0000 7f42d4d75640 1 -- 172.21.15.98:0/2390387680 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42bc004800 msgr2=0x7f42d014a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:24.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:24.067+0000 7f42d4d75640 1 --2- 172.21.15.98:0/2390387680 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42bc004800 0x7f42d014a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:24.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:24.067+0000 7f42d4d75640 1 -- 172.21.15.98:0/2390387680 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42d00b11f0 con 0x7f42d01582c0 2024-09-17T05:22:24.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:24.067+0000 7f42d4d75640 1 --2- 172.21.15.98:0/2390387680 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42d01582c0 0x7f42d0149eb0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f42c00017e0 tx=0x7f42c0006320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:24.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:24.067+0000 7f42c5ffb640 1 -- 172.21.15.98:0/2390387680 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c0042070 con 0x7f42d01582c0 2024-09-17T05:22:24.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:24.067+0000 7f42c5ffb640 1 -- 172.21.15.98:0/2390387680 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f42c0039070 con 0x7f42d01582c0 2024-09-17T05:22:24.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:24.067+0000 7f42d77da640 1 -- 172.21.15.98:0/2390387680 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42d00b14d0 con 0x7f42d01582c0 2024-09-17T05:22:24.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:24.067+0000 7f42c5ffb640 1 -- 172.21.15.98:0/2390387680 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c0003d70 con 0x7f42d01582c0 2024-09-17T05:22:24.074 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:24.067+0000 7f42d77da640 1 -- 172.21.15.98:0/2390387680 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42d01f6300 con 0x7f42d01582c0 2024-09-17T05:22:24.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:24.068+0000 7f42d77da640 1 -- 172.21.15.98:0/2390387680 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42d00d10b0 con 0x7f42d01582c0 2024-09-17T05:22:24.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:24.069+0000 7f42c5ffb640 1 -- 172.21.15.98:0/2390387680 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f42c003b070 con 0x7f42d01582c0 2024-09-17T05:22:24.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:24.069+0000 7f42c5ffb640 1 --2- 172.21.15.98:0/2390387680 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f42b4078b90 0x7f42b407b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:24.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:24.069+0000 7f42c5ffb640 1 -- 172.21.15.98:0/2390387680 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5795+0+0 (secure 0 0 0) 0x7f42c00ba020 con 0x7f42d01582c0 2024-09-17T05:22:24.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:24.070+0000 7f42d5576640 1 --2- 172.21.15.98:0/2390387680 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f42b4078b90 0x7f42b407b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:24.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:24.070+0000 7f42d5576640 1 --2- 172.21.15.98:0/2390387680 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f42b4078b90 0x7f42b407b050 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f42cc000fb0 tx=0x7f42cc001e10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:24.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:24.073+0000 7f42c5ffb640 1 -- 172.21.15.98:0/2390387680 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f42c0082520 con 0x7f42d01582c0 2024-09-17T05:22:24.272 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:24.271+0000 7f42d77da640 1 -- 172.21.15.98:0/2390387680 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f42d00b4b70 con 0x7f42d01582c0 2024-09-17T05:22:24.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:24.940+0000 7f42c5ffb640 1 -- 172.21.15.98:0/2390387680 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v23) ==== 181+0+0 (secure 0 0 0) 0x7f42c0081e20 con 0x7f42d01582c0 2024-09-17T05:22:24.941 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_metadata' removed 2024-09-17T05:22:24.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:24.943+0000 7f42d77da640 1 -- 172.21.15.98:0/2390387680 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f42b4078b90 msgr2=0x7f42b407b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:24.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:24.943+0000 7f42d77da640 1 --2- 172.21.15.98:0/2390387680 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f42b4078b90 0x7f42b407b050 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f42cc000fb0 tx=0x7f42cc001e10 comp rx=0 tx=0).stop 2024-09-17T05:22:24.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:24.944+0000 7f42d77da640 1 -- 172.21.15.98:0/2390387680 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42d01582c0 msgr2=0x7f42d0149eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:24.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:24.944+0000 7f42d77da640 1 --2- 172.21.15.98:0/2390387680 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42d01582c0 0x7f42d0149eb0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f42c00017e0 tx=0x7f42c0006320 comp rx=0 tx=0).stop 2024-09-17T05:22:24.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:24.944+0000 7f42d77da640 1 -- 172.21.15.98:0/2390387680 shutdown_connections 2024-09-17T05:22:24.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:24.944+0000 7f42d77da640 1 --2- 172.21.15.98:0/2390387680 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f42b4078b90 0x7f42b407b050 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:24.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:24.944+0000 7f42d77da640 1 --2- 172.21.15.98:0/2390387680 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f42d01f6b00 0x7f42d00cf8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:24.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:24.944+0000 7f42d77da640 1 --2- 172.21.15.98:0/2390387680 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42d01582c0 0x7f42d0149eb0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:24.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:24.944+0000 7f42d77da640 1 --2- 172.21.15.98:0/2390387680 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42bc004800 0x7f42d014a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:24.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:24.944+0000 7f42d77da640 1 -- 172.21.15.98:0/2390387680 >> 172.21.15.98:0/2390387680 conn(0x7f42d006dc80 msgr2=0x7f42d00b4d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:24.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:24.944+0000 7f42d77da640 1 -- 172.21.15.98:0/2390387680 shutdown_connections 2024-09-17T05:22:24.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:24.944+0000 7f42d77da640 1 -- 172.21.15.98:0/2390387680 wait complete. 2024-09-17T05:22:24.958 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T05:22:25.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:25.065+0000 7fbfd6da3640 1 -- 172.21.15.98:0/4056234365 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbfd00733e0 msgr2=0x7fbfd00cce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:25.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:25.065+0000 7fbfd6da3640 1 --2- 172.21.15.98:0/4056234365 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbfd00733e0 0x7fbfd00cce50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbfd0070820 tx=0x7fbfbc02a5d0 comp rx=0 tx=0).stop 2024-09-17T05:22:25.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:25.065+0000 7fbfd6da3640 1 -- 172.21.15.98:0/4056234365 shutdown_connections 2024-09-17T05:22:25.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:25.065+0000 7fbfd6da3640 1 --2- 172.21.15.98:0/4056234365 >> v2:172.21.15.167:3300/0 conn(0x7fbfd006e6f0 0x7fbfd006eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:25.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:25.065+0000 7fbfd6da3640 1 --2- 172.21.15.98:0/4056234365 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbfd00733e0 0x7fbfd00cce50 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:25.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:25.065+0000 7fbfd6da3640 1 -- 172.21.15.98:0/4056234365 >> 172.21.15.98:0/4056234365 conn(0x7fbfd00b18e0 msgr2=0x7fbfd00b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:25.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:25.065+0000 7fbfd6da3640 1 -- 172.21.15.98:0/4056234365 shutdown_connections 2024-09-17T05:22:25.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:25.065+0000 7fbfd6da3640 1 -- 172.21.15.98:0/4056234365 wait complete. 2024-09-17T05:22:25.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:25.066+0000 7fbfd6da3640 1 Processor -- start 2024-09-17T05:22:25.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:25.067+0000 7fbfd6da3640 1 -- start start 2024-09-17T05:22:25.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:25.067+0000 7fbfd6da3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbfd006e6f0 0x7fbfd00aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:25.070 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:25.067+0000 7fbfd6da3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbfd015f910 0x7fbfd015efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:25.070 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:25.067+0000 7fbfd6da3640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbfd01f85d0 0x7fbfd01f8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:25.070 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:25.067+0000 7fbfd6da3640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd006f0e0 con 0x7fbfd006e6f0 2024-09-17T05:22:25.070 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:25.067+0000 7fbfd6da3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd00cd5a0 con 0x7fbfd015f910 2024-09-17T05:22:25.070 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:25.067+0000 7fbfd6da3640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fbfd006f260 con 0x7fbfd01f85d0 2024-09-17T05:22:25.070 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:25.068+0000 7fbfd4b3f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbfd006e6f0 0x7fbfd00aeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:25.070 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:25.068+0000 7fbfd4b3f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbfd006e6f0 0x7fbfd00aeb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36272/0 (socket says 172.21.15.98:36272) 2024-09-17T05:22:25.070 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:25.068+0000 7fbfd4b3f640 1 -- 172.21.15.98:0/4145311697 learned_addr learned my addr 172.21.15.98:0/4145311697 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:25.070 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:25.068+0000 7fbfd5340640 1 --2- 172.21.15.98:0/4145311697 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbfd01f85d0 0x7fbfd01f8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:25.070 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:25.068+0000 7fbfcffff640 1 --2- 172.21.15.98:0/4145311697 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbfd015f910 0x7fbfd015efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:25.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:25.068+0000 7fbfd4b3f640 1 -- 172.21.15.98:0/4145311697 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbfd01f85d0 msgr2=0x7fbfd01f8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:25.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:25.068+0000 7fbfd4b3f640 1 --2- 172.21.15.98:0/4145311697 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbfd01f85d0 0x7fbfd01f8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:25.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:25.068+0000 7fbfd4b3f640 1 -- 172.21.15.98:0/4145311697 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbfd015f910 msgr2=0x7fbfd015efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:25.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:25.068+0000 7fbfd4b3f640 1 --2- 172.21.15.98:0/4145311697 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbfd015f910 0x7fbfd015efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:25.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:25.068+0000 7fbfd4b3f640 1 -- 172.21.15.98:0/4145311697 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfd00ad7b0 con 0x7fbfd006e6f0 2024-09-17T05:22:25.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:25.068+0000 7fbfd5340640 1 --2- 172.21.15.98:0/4145311697 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbfd01f85d0 0x7fbfd01f8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:22:25.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:25.068+0000 7fbfcffff640 1 --2- 172.21.15.98:0/4145311697 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbfd015f910 0x7fbfd015efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:22:25.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:25.068+0000 7fbfd4b3f640 1 --2- 172.21.15.98:0/4145311697 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbfd006e6f0 0x7fbfd00aeb10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fbfc400c3f0 tx=0x7fbfc400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:25.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:25.068+0000 7fbfcd7fa640 1 -- 172.21.15.98:0/4145311697 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfc4017070 con 0x7fbfd006e6f0 2024-09-17T05:22:25.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:25.068+0000 7fbfcd7fa640 1 -- 172.21.15.98:0/4145311697 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbfc40035f0 con 0x7fbfd006e6f0 2024-09-17T05:22:25.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:25.068+0000 7fbfd6da3640 1 -- 172.21.15.98:0/4145311697 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfd00ada70 con 0x7fbfd006e6f0 2024-09-17T05:22:25.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:25.068+0000 7fbfcd7fa640 1 -- 172.21.15.98:0/4145311697 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfc4003a40 con 0x7fbfd006e6f0 2024-09-17T05:22:25.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:25.068+0000 7fbfd6da3640 1 -- 172.21.15.98:0/4145311697 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfd00ae030 con 0x7fbfd006e6f0 2024-09-17T05:22:25.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:25.069+0000 7fbfd6da3640 1 -- 172.21.15.98:0/4145311697 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfd00ae800 con 0x7fbfd006e6f0 2024-09-17T05:22:25.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:25.070+0000 7fbfcd7fa640 1 -- 172.21.15.98:0/4145311697 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbfc401a070 con 0x7fbfd006e6f0 2024-09-17T05:22:25.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:25.070+0000 7fbfcd7fa640 1 --2- 172.21.15.98:0/4145311697 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fbfb4078b90 0x7fbfb407b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:25.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:25.071+0000 7fbfcd7fa640 1 -- 172.21.15.98:0/4145311697 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5357+0+0 (secure 0 0 0) 0x7fbfc4099e30 con 0x7fbfd006e6f0 2024-09-17T05:22:25.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:25.071+0000 7fbfcffff640 1 --2- 172.21.15.98:0/4145311697 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fbfb4078b90 0x7fbfb407b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:25.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:25.071+0000 7fbfcffff640 1 --2- 172.21.15.98:0/4145311697 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fbfb4078b90 0x7fbfb407b050 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc034000 tx=0x7fbfbc004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:25.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:25.075+0000 7fbfcd7fa640 1 -- 172.21.15.98:0/4145311697 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fbfc40624f0 con 0x7fbfd006e6f0 2024-09-17T05:22:25.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:25.249+0000 7fbfd6da3640 1 -- 172.21.15.98:0/4145311697 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fbfd0069360 con 0x7fbfd006e6f0 2024-09-17T05:22:25.949 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:25.948+0000 7fbfcd7fa640 1 -- 172.21.15.98:0/4145311697 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v24) ==== 169+0+0 (secure 0 0 0) 0x7fbfc4061df0 con 0x7fbfd006e6f0 2024-09-17T05:22:25.949 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_data' removed 2024-09-17T05:22:25.951 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:25.950+0000 7fbfd6da3640 1 -- 172.21.15.98:0/4145311697 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fbfb4078b90 msgr2=0x7fbfb407b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:25.951 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:25.950+0000 7fbfd6da3640 1 --2- 172.21.15.98:0/4145311697 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fbfb4078b90 0x7fbfb407b050 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc034000 tx=0x7fbfbc004730 comp rx=0 tx=0).stop 2024-09-17T05:22:25.951 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:25.950+0000 7fbfd6da3640 1 -- 172.21.15.98:0/4145311697 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbfd006e6f0 msgr2=0x7fbfd00aeb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:25.951 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:25.950+0000 7fbfd6da3640 1 --2- 172.21.15.98:0/4145311697 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbfd006e6f0 0x7fbfd00aeb10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fbfc400c3f0 tx=0x7fbfc400c8b0 comp rx=0 tx=0).stop 2024-09-17T05:22:25.951 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:25.950+0000 7fbfd6da3640 1 -- 172.21.15.98:0/4145311697 shutdown_connections 2024-09-17T05:22:25.951 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:25.950+0000 7fbfd6da3640 1 --2- 172.21.15.98:0/4145311697 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fbfb4078b90 0x7fbfb407b050 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:25.951 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:25.950+0000 7fbfd6da3640 1 --2- 172.21.15.98:0/4145311697 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbfd01f85d0 0x7fbfd01f8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:25.952 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:25.950+0000 7fbfd6da3640 1 --2- 172.21.15.98:0/4145311697 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbfd015f910 0x7fbfd015efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:25.952 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:25.950+0000 7fbfd6da3640 1 --2- 172.21.15.98:0/4145311697 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbfd006e6f0 0x7fbfd00aeb10 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:25.952 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:25.950+0000 7fbfd6da3640 1 -- 172.21.15.98:0/4145311697 >> 172.21.15.98:0/4145311697 conn(0x7fbfd00b18e0 msgr2=0x7fbfd00b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:25.952 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:25.951+0000 7fbfd6da3640 1 -- 172.21.15.98:0/4145311697 shutdown_connections 2024-09-17T05:22:25.952 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:25.951+0000 7fbfd6da3640 1 -- 172.21.15.98:0/4145311697 wait complete. 2024-09-17T05:22:25.966 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T05:22:25.966 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T05:22:25.966 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T05:22:25.966 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:22:25.967 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T05:22:25.967 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T05:22:25.967 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T05:22:25.967 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:22:25.967 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T05:22:25.967 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T05:22:25.967 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T05:22:25.968 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:22:25.968 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T05:22:25.968 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T05:22:25.968 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T05:22:25.968 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:22:25.977 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T05:22:25.977 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T05:22:25.978 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T05:22:25.978 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T05:22:25.979 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T05:22:25.980 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T05:22:25.980 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T05:22:25.981 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T05:22:26.020 INFO:tasks.ceph.mds.c:Started 2024-09-17T05:22:26.020 DEBUG:teuthology.parallel:result is None 2024-09-17T05:22:26.021 INFO:tasks.ceph.mds.a:Started 2024-09-17T05:22:26.021 DEBUG:teuthology.parallel:result is None 2024-09-17T05:22:26.023 INFO:tasks.ceph.mds.b:Started 2024-09-17T05:22:26.023 DEBUG:teuthology.parallel:result is None 2024-09-17T05:22:26.024 INFO:tasks.ceph.mds.d:Started 2024-09-17T05:22:26.024 DEBUG:teuthology.parallel:result is None 2024-09-17T05:22:26.024 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T05:22:26.097 INFO:tasks.ceph.mds.c.smithi098.stdout:starting mds.c at 2024-09-17T05:22:26.097 INFO:tasks.ceph.mds.a.smithi098.stdout:starting mds.a at 2024-09-17T05:22:26.104 INFO:tasks.ceph.mds.d.smithi167.stdout:starting mds.d at 2024-09-17T05:22:26.104 INFO:tasks.ceph.mds.b.smithi167.stdout:starting mds.b at 2024-09-17T05:22:26.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:26.132+0000 7ff7bad00640 1 -- 172.21.15.98:0/3725610755 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7a0003a00 msgr2=0x7ff7a0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:26.134 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:26.132+0000 7ff7bad00640 1 --2- 172.21.15.98:0/3725610755 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7a0003a00 0x7ff7a0003de0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac001740 tx=0x7ff7a0005830 comp rx=0 tx=0).stop 2024-09-17T05:22:26.134 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:26.132+0000 7ff7bad00640 1 -- 172.21.15.98:0/3725610755 shutdown_connections 2024-09-17T05:22:26.134 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:26.132+0000 7ff7bad00640 1 --2- 172.21.15.98:0/3725610755 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7a0003a00 0x7ff7a0003de0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:26.134 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:26.132+0000 7ff7bad00640 1 -- 172.21.15.98:0/3725610755 >> 172.21.15.98:0/3725610755 conn(0x7ff7b40d1da0 msgr2=0x7ff7b40d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:26.134 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:26.132+0000 7ff7bad00640 1 -- 172.21.15.98:0/3725610755 shutdown_connections 2024-09-17T05:22:26.134 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:26.132+0000 7ff7bad00640 1 -- 172.21.15.98:0/3725610755 wait complete. 2024-09-17T05:22:26.134 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:26.134+0000 7ff7bad00640 1 Processor -- start 2024-09-17T05:22:26.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:26.134+0000 7ff7bad00640 1 -- start start 2024-09-17T05:22:26.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:26.134+0000 7ff7bad00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7a0003a00 0x7ff7b4159440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:26.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:26.134+0000 7ff7bad00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7b40b7600 0x7ff7b40c78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:26.137 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:26.134+0000 7ff7bad00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7b40c7e20 0x7ff7b415c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:26.137 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:26.134+0000 7ff7bad00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b40ce620 con 0x7ff7a0003a00 2024-09-17T05:22:26.137 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:26.134+0000 7ff7bad00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b40ce4a0 con 0x7ff7b40c7e20 2024-09-17T05:22:26.137 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:26.134+0000 7ff7bad00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7ff7b40ce7a0 con 0x7ff7b40b7600 2024-09-17T05:22:26.137 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:26.135+0000 7ff7b8a9c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7a0003a00 0x7ff7b4159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:26.137 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:26.135+0000 7ff7b8a9c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7a0003a00 0x7ff7b4159440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36316/0 (socket says 172.21.15.98:36316) 2024-09-17T05:22:26.137 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:26.135+0000 7ff7b8a9c640 1 -- 172.21.15.98:0/1847294257 learned_addr learned my addr 172.21.15.98:0/1847294257 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:26.137 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:26.135+0000 7ff7b929d640 1 --2- 172.21.15.98:0/1847294257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7b40c7e20 0x7ff7b415c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:26.137 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:26.135+0000 7ff7b3fff640 1 --2- 172.21.15.98:0/1847294257 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7b40b7600 0x7ff7b40c78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:26.137 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:26.135+0000 7ff7b8a9c640 1 -- 172.21.15.98:0/1847294257 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7b40b7600 msgr2=0x7ff7b40c78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:26.137 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:26.135+0000 7ff7b8a9c640 1 --2- 172.21.15.98:0/1847294257 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7b40b7600 0x7ff7b40c78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:26.137 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:26.135+0000 7ff7b8a9c640 1 -- 172.21.15.98:0/1847294257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7b40c7e20 msgr2=0x7ff7b415c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:26.137 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:26.135+0000 7ff7b8a9c640 1 --2- 172.21.15.98:0/1847294257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7b40c7e20 0x7ff7b415c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:26.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:26.135+0000 7ff7b8a9c640 1 -- 172.21.15.98:0/1847294257 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7b40b69d0 con 0x7ff7a0003a00 2024-09-17T05:22:26.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:26.135+0000 7ff7b8a9c640 1 --2- 172.21.15.98:0/1847294257 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7a0003a00 0x7ff7b4159440 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac000c00 tx=0x7ff7ac0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:26.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:26.135+0000 7ff7b17fa640 1 -- 172.21.15.98:0/1847294257 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac0068c0 con 0x7ff7a0003a00 2024-09-17T05:22:26.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:26.135+0000 7ff7b17fa640 1 -- 172.21.15.98:0/1847294257 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff7ac039070 con 0x7ff7a0003a00 2024-09-17T05:22:26.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:26.135+0000 7ff7bad00640 1 -- 172.21.15.98:0/1847294257 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7b41f5c70 con 0x7ff7a0003a00 2024-09-17T05:22:26.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:26.135+0000 7ff7b17fa640 1 -- 172.21.15.98:0/1847294257 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac033690 con 0x7ff7a0003a00 2024-09-17T05:22:26.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:26.135+0000 7ff7bad00640 1 -- 172.21.15.98:0/1847294257 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7b41f5f50 con 0x7ff7a0003a00 2024-09-17T05:22:26.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:26.136+0000 7ff7bad00640 1 -- 172.21.15.98:0/1847294257 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7b40ceca0 con 0x7ff7a0003a00 2024-09-17T05:22:26.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:26.137+0000 7ff7b17fa640 1 -- 172.21.15.98:0/1847294257 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff7ac044060 con 0x7ff7a0003a00 2024-09-17T05:22:26.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:26.137+0000 7ff7b17fa640 1 --2- 172.21.15.98:0/1847294257 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7ff794078bc0 0x7ff79407b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:26.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:26.138+0000 7ff7b17fa640 1 -- 172.21.15.98:0/1847294257 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 4943+0+0 (secure 0 0 0) 0x7ff7ac0ba4f0 con 0x7ff7a0003a00 2024-09-17T05:22:26.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:26.138+0000 7ff7b3fff640 1 --2- 172.21.15.98:0/1847294257 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7ff794078bc0 0x7ff79407b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:26.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:26.138+0000 7ff7b3fff640 1 --2- 172.21.15.98:0/1847294257 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7ff794078bc0 0x7ff79407b080 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4001c20 tx=0x7ff7a4006040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:26.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:26.142+0000 7ff7b17fa640 1 -- 172.21.15.98:0/1847294257 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7ff7ac082d80 con 0x7ff7a0003a00 2024-09-17T05:22:26.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:26.328+0000 7ff7bad00640 1 -- 172.21.15.98:0/1847294257 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7ff7b40d2220 con 0x7ff7a0003a00 2024-09-17T05:22:26.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:26.961+0000 7ff7b17fa640 1 -- 172.21.15.98:0/1847294257 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v26) ==== 97+0+0 (secure 0 0 0) 0x7ff7ac082680 con 0x7ff7a0003a00 2024-09-17T05:22:26.962 INFO:teuthology.orchestra.run.smithi098.stderr: removed all blocklist entries 2024-09-17T05:22:26.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:26.963+0000 7ff7bad00640 1 -- 172.21.15.98:0/1847294257 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7ff794078bc0 msgr2=0x7ff79407b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:26.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:26.963+0000 7ff7bad00640 1 --2- 172.21.15.98:0/1847294257 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7ff794078bc0 0x7ff79407b080 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4001c20 tx=0x7ff7a4006040 comp rx=0 tx=0).stop 2024-09-17T05:22:26.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:26.964+0000 7ff7bad00640 1 -- 172.21.15.98:0/1847294257 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7a0003a00 msgr2=0x7ff7b4159440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:26.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:26.964+0000 7ff7bad00640 1 --2- 172.21.15.98:0/1847294257 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7a0003a00 0x7ff7b4159440 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac000c00 tx=0x7ff7ac0048f0 comp rx=0 tx=0).stop 2024-09-17T05:22:26.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:26.964+0000 7ff7bad00640 1 -- 172.21.15.98:0/1847294257 shutdown_connections 2024-09-17T05:22:26.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:26.964+0000 7ff7bad00640 1 --2- 172.21.15.98:0/1847294257 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7ff794078bc0 0x7ff79407b080 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:26.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:26.964+0000 7ff7bad00640 1 --2- 172.21.15.98:0/1847294257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7b40c7e20 0x7ff7b415c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:26.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:26.964+0000 7ff7bad00640 1 --2- 172.21.15.98:0/1847294257 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7b40b7600 0x7ff7b40c78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:26.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:26.964+0000 7ff7bad00640 1 --2- 172.21.15.98:0/1847294257 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7a0003a00 0x7ff7b4159440 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:26.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:26.964+0000 7ff7bad00640 1 -- 172.21.15.98:0/1847294257 >> 172.21.15.98:0/1847294257 conn(0x7ff7b40d1da0 msgr2=0x7ff7b40ae9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:26.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:26.964+0000 7ff7bad00640 1 -- 172.21.15.98:0/1847294257 shutdown_connections 2024-09-17T05:22:26.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:26.964+0000 7ff7bad00640 1 -- 172.21.15.98:0/1847294257 wait complete. 2024-09-17T05:22:26.976 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T05:22:27.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.074+0000 7f25473c6640 1 -- 172.21.15.98:0/2074657148 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f25400d2050 msgr2=0x7f25400d0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:27.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.074+0000 7f25473c6640 1 --2- 172.21.15.98:0/2074657148 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f25400d2050 0x7f25400d0f00 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f25400ba010 tx=0x7f253002a560 comp rx=0 tx=0).stop 2024-09-17T05:22:27.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.075+0000 7f25473c6640 1 -- 172.21.15.98:0/2074657148 shutdown_connections 2024-09-17T05:22:27.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.075+0000 7f25473c6640 1 --2- 172.21.15.98:0/2074657148 >> v2:172.21.15.167:3300/0 conn(0x7f25400d1440 0x7f254015e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:27.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.075+0000 7f25473c6640 1 --2- 172.21.15.98:0/2074657148 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f25400d2050 0x7f25400d0f00 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:27.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.075+0000 7f25473c6640 1 --2- 172.21.15.98:0/2074657148 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f254015e0d0 0x7f25400d09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:27.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.075+0000 7f25473c6640 1 -- 172.21.15.98:0/2074657148 >> 172.21.15.98:0/2074657148 conn(0x7f25400d3fe0 msgr2=0x7f25400d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:27.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.075+0000 7f25473c6640 1 -- 172.21.15.98:0/2074657148 shutdown_connections 2024-09-17T05:22:27.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.075+0000 7f25473c6640 1 -- 172.21.15.98:0/2074657148 wait complete. 2024-09-17T05:22:27.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.076+0000 7f25473c6640 1 Processor -- start 2024-09-17T05:22:27.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.076+0000 7f25473c6640 1 -- start start 2024-09-17T05:22:27.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.077+0000 7f25473c6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f25400d1440 0x7f2540159e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:27.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.077+0000 7f25473c6640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f25400d2050 0x7f25400c9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:27.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.077+0000 7f25473c6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f254015e0d0 0x7f254009e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:27.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.077+0000 7f25473c6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f254015ed80 con 0x7f254015e0d0 2024-09-17T05:22:27.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.077+0000 7f25473c6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f254015ec00 con 0x7f25400d1440 2024-09-17T05:22:27.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.077+0000 7f25473c6640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f254015ef00 con 0x7f25400d2050 2024-09-17T05:22:27.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.077+0000 7f2545963640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f254015e0d0 0x7f254009e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:27.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.077+0000 7f2545963640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f254015e0d0 0x7f254009e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56428/0 (socket says 172.21.15.98:56428) 2024-09-17T05:22:27.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.077+0000 7f2545963640 1 -- 172.21.15.98:0/3549086714 learned_addr learned my addr 172.21.15.98:0/3549086714 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:27.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.077+0000 7f2544961640 1 --2- 172.21.15.98:0/3549086714 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f25400d2050 0x7f25400c9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:27.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.077+0000 7f2545162640 1 --2- 172.21.15.98:0/3549086714 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f25400d1440 0x7f2540159e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:27.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.077+0000 7f2545963640 1 -- 172.21.15.98:0/3549086714 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f25400d2050 msgr2=0x7f25400c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:27.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.077+0000 7f2545963640 1 --2- 172.21.15.98:0/3549086714 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f25400d2050 0x7f25400c9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:27.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.077+0000 7f2545963640 1 -- 172.21.15.98:0/3549086714 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f25400d1440 msgr2=0x7f2540159e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:27.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.077+0000 7f2545963640 1 --2- 172.21.15.98:0/3549086714 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f25400d1440 0x7f2540159e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:27.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.077+0000 7f2545963640 1 -- 172.21.15.98:0/3549086714 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f254015a3a0 con 0x7f254015e0d0 2024-09-17T05:22:27.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.077+0000 7f2545963640 1 --2- 172.21.15.98:0/3549086714 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f254015e0d0 0x7f254009e900 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f253800ca40 tx=0x7f253800cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:27.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.077+0000 7f2535ffb640 1 -- 172.21.15.98:0/3549086714 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253800adc0 con 0x7f254015e0d0 2024-09-17T05:22:27.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.077+0000 7f2535ffb640 1 -- 172.21.15.98:0/3549086714 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2538004c50 con 0x7f254015e0d0 2024-09-17T05:22:27.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.077+0000 7f2535ffb640 1 -- 172.21.15.98:0/3549086714 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2538005280 con 0x7f254015e0d0 2024-09-17T05:22:27.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.077+0000 7f25473c6640 1 -- 172.21.15.98:0/3549086714 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25400ca6f0 con 0x7f254015e0d0 2024-09-17T05:22:27.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.078+0000 7f25473c6640 1 -- 172.21.15.98:0/3549086714 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25401f8290 con 0x7f254015e0d0 2024-09-17T05:22:27.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.079+0000 7f25473c6640 1 -- 172.21.15.98:0/3549086714 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f254015f3d0 con 0x7f254015e0d0 2024-09-17T05:22:27.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.079+0000 7f2535ffb640 1 -- 172.21.15.98:0/3549086714 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2538005420 con 0x7f254015e0d0 2024-09-17T05:22:27.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.080+0000 7f2535ffb640 1 --2- 172.21.15.98:0/3549086714 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f2524078bc0 0x7f252407b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:27.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.080+0000 7f2535ffb640 1 -- 172.21.15.98:0/3549086714 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f253809afe0 con 0x7f254015e0d0 2024-09-17T05:22:27.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.080+0000 7f2545162640 1 --2- 172.21.15.98:0/3549086714 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f2524078bc0 0x7f252407b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:27.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.081+0000 7f2545162640 1 --2- 172.21.15.98:0/3549086714 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f2524078bc0 0x7f252407b080 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f253c0058c0 tx=0x7f253c005f60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:27.084 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.084+0000 7f2535ffb640 1 -- 172.21.15.98:0/3549086714 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f2538014030 con 0x7f254015e0d0 2024-09-17T05:22:27.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.331+0000 7f25473c6640 1 -- 172.21.15.98:0/3549086714 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f254015e5e0 con 0x7f254015e0d0 2024-09-17T05:22:27.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.331+0000 7f2535ffb640 1 -- 172.21.15.98:0/3549086714 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) ==== 80+0+6645 (secure 0 0 0) 0x7f2538063240 con 0x7f254015e0d0 2024-09-17T05:22:27.333 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:22:27.333 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T05:22:27.333 INFO:teuthology.orchestra.run.smithi098.stdout: "auth_dump": [ 2024-09-17T05:22:27.333 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:22:27.333 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mds.a", 2024-09-17T05:22:27.333 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC2EelmWdIiERAA4HMb0F3k0oYcwhkoYS/FJA==", 2024-09-17T05:22:27.333 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2024-09-17T05:22:27.333 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2024-09-17T05:22:27.333 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow *", 2024-09-17T05:22:27.333 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow *", 2024-09-17T05:22:27.333 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2024-09-17T05:22:27.333 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:22:27.334 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:22:27.334 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:22:27.334 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mds.b", 2024-09-17T05:22:27.334 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC2EelmV0UQHRAAALkvMpdBz71cUZjjiEiP/w==", 2024-09-17T05:22:27.334 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2024-09-17T05:22:27.334 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2024-09-17T05:22:27.334 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow *", 2024-09-17T05:22:27.334 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow *", 2024-09-17T05:22:27.334 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2024-09-17T05:22:27.334 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:22:27.334 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:22:27.334 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:22:27.334 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mds.c", 2024-09-17T05:22:27.335 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC2EelmRzMvGBAAd7hCIMHumQYyJ1qYKn9Y5A==", 2024-09-17T05:22:27.335 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2024-09-17T05:22:27.335 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2024-09-17T05:22:27.335 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow *", 2024-09-17T05:22:27.335 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow *", 2024-09-17T05:22:27.335 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2024-09-17T05:22:27.335 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:22:27.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:22:27.335 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:22:27.335 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mds.d", 2024-09-17T05:22:27.335 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC2EelmtuA1JBAAAbIqdaVsptCdWaptWM2NRw==", 2024-09-17T05:22:27.335 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2024-09-17T05:22:27.335 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2024-09-17T05:22:27.336 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow *", 2024-09-17T05:22:27.336 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow *", 2024-09-17T05:22:27.336 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2024-09-17T05:22:27.336 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:22:27.336 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:22:27.336 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:22:27.336 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.0", 2024-09-17T05:22:27.336 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC6EelmzxdsBxAAiZ//FCaukUdkU4O0w8L7MA==", 2024-09-17T05:22:27.336 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2024-09-17T05:22:27.336 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2024-09-17T05:22:27.336 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2024-09-17T05:22:27.336 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2024-09-17T05:22:27.336 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:22:27.337 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:22:27.337 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:22:27.337 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.1", 2024-09-17T05:22:27.337 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC9EelmhSIdKBAAHroQTeKOhU/EmpEBQ6jmSw==", 2024-09-17T05:22:27.337 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2024-09-17T05:22:27.337 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2024-09-17T05:22:27.337 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2024-09-17T05:22:27.337 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2024-09-17T05:22:27.337 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:22:27.337 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:22:27.337 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:22:27.337 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.2", 2024-09-17T05:22:27.337 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDBEelm3wI/DBAAEqVMzgg03GXB9jKN9MwG8w==", 2024-09-17T05:22:27.338 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2024-09-17T05:22:27.338 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2024-09-17T05:22:27.338 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2024-09-17T05:22:27.338 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2024-09-17T05:22:27.338 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:22:27.338 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:22:27.338 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:22:27.338 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.3", 2024-09-17T05:22:27.338 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDEEelmyhZvDRAAxm9qIXHA27E68zXS3BslkA==", 2024-09-17T05:22:27.338 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2024-09-17T05:22:27.338 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2024-09-17T05:22:27.338 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2024-09-17T05:22:27.338 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2024-09-17T05:22:27.339 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:22:27.339 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:22:27.339 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:22:27.339 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.4", 2024-09-17T05:22:27.339 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDKEelmuPw2FRAAdqhDXn+wCy73oM/oFT56Ug==", 2024-09-17T05:22:27.339 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2024-09-17T05:22:27.339 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2024-09-17T05:22:27.339 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2024-09-17T05:22:27.339 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2024-09-17T05:22:27.340 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:22:27.340 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:22:27.340 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:22:27.340 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.5", 2024-09-17T05:22:27.340 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDNEelmFi60FxAAZWWAfc8CsmEKlGRO9I+MzA==", 2024-09-17T05:22:27.340 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2024-09-17T05:22:27.340 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2024-09-17T05:22:27.340 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2024-09-17T05:22:27.340 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2024-09-17T05:22:27.340 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:22:27.340 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:22:27.340 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:22:27.340 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.6", 2024-09-17T05:22:27.341 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDQEelmSMpgNxAAJBbanlZzzQwzB/yn1jqcNA==", 2024-09-17T05:22:27.341 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2024-09-17T05:22:27.341 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2024-09-17T05:22:27.341 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2024-09-17T05:22:27.341 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2024-09-17T05:22:27.341 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:22:27.341 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:22:27.341 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:22:27.341 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.7", 2024-09-17T05:22:27.341 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDTEelmd6rXOBAAUd9wfuxRVZ2lkZDDDlSL+A==", 2024-09-17T05:22:27.341 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2024-09-17T05:22:27.341 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2024-09-17T05:22:27.341 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2024-09-17T05:22:27.342 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2024-09-17T05:22:27.342 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:22:27.342 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:22:27.342 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:22:27.342 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.0", 2024-09-17T05:22:27.342 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC2EelmTC1KKBAAXutxPyhWEuBL6NvHRzTrpg==", 2024-09-17T05:22:27.342 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2024-09-17T05:22:27.342 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2024-09-17T05:22:27.342 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow r", 2024-09-17T05:22:27.342 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow rw", 2024-09-17T05:22:27.342 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow rwx" 2024-09-17T05:22:27.342 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:22:27.342 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:22:27.343 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:22:27.343 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.1", 2024-09-17T05:22:27.343 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC2EelmO/wRMRAAF/Xcv4IC0ZfNQxiGQwYKBg==", 2024-09-17T05:22:27.343 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2024-09-17T05:22:27.343 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2024-09-17T05:22:27.343 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow r", 2024-09-17T05:22:27.343 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow rw", 2024-09-17T05:22:27.343 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow rwx" 2024-09-17T05:22:27.343 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:22:27.343 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:22:27.343 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:22:27.343 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.2", 2024-09-17T05:22:27.343 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC2EelmjDbfLRAA7oy8N8um+i6CFwXMZ7cqEw==", 2024-09-17T05:22:27.343 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2024-09-17T05:22:27.344 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2024-09-17T05:22:27.344 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow r", 2024-09-17T05:22:27.344 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow rw", 2024-09-17T05:22:27.344 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow rwx" 2024-09-17T05:22:27.344 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:22:27.344 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:22:27.344 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:22:27.344 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.3", 2024-09-17T05:22:27.344 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC2EelmiUbBNhAAEltib5g5KVsJfYrwxQkNqg==", 2024-09-17T05:22:27.344 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2024-09-17T05:22:27.344 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2024-09-17T05:22:27.345 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow r", 2024-09-17T05:22:27.345 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow rw", 2024-09-17T05:22:27.345 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow rwx" 2024-09-17T05:22:27.345 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:22:27.345 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:22:27.345 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:22:27.345 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.admin", 2024-09-17T05:22:27.345 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC1EelmOA6AMBAAhSZ/Bu9HSohK087IqybfCg==", 2024-09-17T05:22:27.345 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2024-09-17T05:22:27.345 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow *", 2024-09-17T05:22:27.345 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow *", 2024-09-17T05:22:27.345 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow *", 2024-09-17T05:22:27.345 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2024-09-17T05:22:27.346 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:22:27.346 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:22:27.346 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:22:27.346 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.bootstrap-mds", 2024-09-17T05:22:27.346 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDZEelmSCnSMhAAQ2OLbFfsX604eLooaxNpvw==", 2024-09-17T05:22:27.346 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2024-09-17T05:22:27.346 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile bootstrap-mds" 2024-09-17T05:22:27.346 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:22:27.346 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:22:27.346 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:22:27.346 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.bootstrap-mgr", 2024-09-17T05:22:27.346 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDZEelm0jLSMhAAS5qCGhP3TluHnS3+k1452g==", 2024-09-17T05:22:27.347 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2024-09-17T05:22:27.347 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-17T05:22:27.347 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:22:27.347 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:22:27.347 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:22:27.347 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.bootstrap-osd", 2024-09-17T05:22:27.347 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDZEelmIDrSMhAA70VkV5lb+OwT+GJaOe0TQg==", 2024-09-17T05:22:27.347 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2024-09-17T05:22:27.347 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile bootstrap-osd" 2024-09-17T05:22:27.347 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:22:27.347 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:22:27.347 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:22:27.347 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.bootstrap-rbd", 2024-09-17T05:22:27.348 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDZEelmGkHSMhAATaXww+fLN4HqnYnDtb11nw==", 2024-09-17T05:22:27.348 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2024-09-17T05:22:27.348 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-17T05:22:27.348 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:22:27.348 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:22:27.348 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:22:27.348 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-17T05:22:27.348 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDZEelmOUrSMhAAtiWw2TicvMHGETbTov24Vg==", 2024-09-17T05:22:27.348 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2024-09-17T05:22:27.348 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-17T05:22:27.348 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:22:27.348 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:22:27.349 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:22:27.349 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.bootstrap-rgw", 2024-09-17T05:22:27.349 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQDZEelmZVHSMhAAVJyoirCgv2sfBDQI9xVKpw==", 2024-09-17T05:22:27.349 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2024-09-17T05:22:27.349 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-17T05:22:27.349 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:22:27.349 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:22:27.349 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:22:27.349 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mgr.x", 2024-09-17T05:22:27.349 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC2Eelme+LlDRAAkuzoXi+8KWoc1aIq1k6tDQ==", 2024-09-17T05:22:27.349 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2024-09-17T05:22:27.349 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow *", 2024-09-17T05:22:27.349 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile mgr", 2024-09-17T05:22:27.349 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2024-09-17T05:22:27.350 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:22:27.350 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:22:27.350 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:22:27.350 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mgr.y", 2024-09-17T05:22:27.350 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQC2EelmCEkxChAAMnvoSm0EN6RXpSr1DG1ioA==", 2024-09-17T05:22:27.350 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2024-09-17T05:22:27.350 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow *", 2024-09-17T05:22:27.350 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile mgr", 2024-09-17T05:22:27.350 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2024-09-17T05:22:27.350 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:22:27.350 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:22:27.350 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T05:22:27.350 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T05:22:27.352 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.334+0000 7f25473c6640 1 -- 172.21.15.98:0/3549086714 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f2524078bc0 msgr2=0x7f252407b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:27.352 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.334+0000 7f25473c6640 1 --2- 172.21.15.98:0/3549086714 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f2524078bc0 0x7f252407b080 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f253c0058c0 tx=0x7f253c005f60 comp rx=0 tx=0).stop 2024-09-17T05:22:27.352 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.334+0000 7f25473c6640 1 -- 172.21.15.98:0/3549086714 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f254015e0d0 msgr2=0x7f254009e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:27.352 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.334+0000 7f25473c6640 1 --2- 172.21.15.98:0/3549086714 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f254015e0d0 0x7f254009e900 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f253800ca40 tx=0x7f253800cf00 comp rx=0 tx=0).stop 2024-09-17T05:22:27.352 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.334+0000 7f25473c6640 1 -- 172.21.15.98:0/3549086714 shutdown_connections 2024-09-17T05:22:27.352 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.334+0000 7f25473c6640 1 --2- 172.21.15.98:0/3549086714 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f2524078bc0 0x7f252407b080 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:27.352 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.334+0000 7f25473c6640 1 --2- 172.21.15.98:0/3549086714 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f254015e0d0 0x7f254009e900 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:27.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.334+0000 7f25473c6640 1 --2- 172.21.15.98:0/3549086714 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f25400d2050 0x7f25400c9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:27.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.334+0000 7f25473c6640 1 --2- 172.21.15.98:0/3549086714 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f25400d1440 0x7f2540159e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:27.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.334+0000 7f25473c6640 1 -- 172.21.15.98:0/3549086714 >> 172.21.15.98:0/3549086714 conn(0x7f25400d3fe0 msgr2=0x7f2540160ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:27.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.334+0000 7f25473c6640 1 -- 172.21.15.98:0/3549086714 shutdown_connections 2024-09-17T05:22:27.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.334+0000 7f25473c6640 1 -- 172.21.15.98:0/3549086714 wait complete. 2024-09-17T05:22:27.353 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-17T05:22:27.456 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.454+0000 7f04d0871640 1 -- 172.21.15.98:0/2251188634 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f04b40064d0 msgr2=0x7f04b400cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:27.456 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.454+0000 7f04d0871640 1 --2- 172.21.15.98:0/2251188634 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f04b40064d0 0x7f04b400cad0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f04c400c3f0 tx=0x7f04b4006940 comp rx=0 tx=0).stop 2024-09-17T05:22:27.456 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.455+0000 7f04d0871640 1 -- 172.21.15.98:0/2251188634 shutdown_connections 2024-09-17T05:22:27.456 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.455+0000 7f04d0871640 1 --2- 172.21.15.98:0/2251188634 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f04b40064d0 0x7f04b400cad0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:27.456 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.455+0000 7f04d0871640 1 -- 172.21.15.98:0/2251188634 >> 172.21.15.98:0/2251188634 conn(0x7f04cc0b1950 msgr2=0x7f04cc0b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:27.456 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.455+0000 7f04d0871640 1 -- 172.21.15.98:0/2251188634 shutdown_connections 2024-09-17T05:22:27.456 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.455+0000 7f04d0871640 1 -- 172.21.15.98:0/2251188634 wait complete. 2024-09-17T05:22:27.457 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.456+0000 7f04d0871640 1 Processor -- start 2024-09-17T05:22:27.457 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.456+0000 7f04d0871640 1 -- start start 2024-09-17T05:22:27.459 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.457+0000 7f04d0871640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f04b40064d0 0x7f04cc1e43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:27.459 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.457+0000 7f04d0871640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f04cc1498b0 0x7f04cc09aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:27.459 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.457+0000 7f04d0871640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04cc09afd0 0x7f04cc0b0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:27.459 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.457+0000 7f04d0871640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f04cc15dd20 con 0x7f04cc1498b0 2024-09-17T05:22:27.459 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.457+0000 7f04d0871640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f04cc0746a0 con 0x7f04cc09afd0 2024-09-17T05:22:27.459 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.457+0000 7f04d0871640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f04cc074820 con 0x7f04b40064d0 2024-09-17T05:22:27.460 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.457+0000 7f04c9d9b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f04cc1498b0 0x7f04cc09aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:27.460 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.457+0000 7f04c9d9b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f04cc1498b0 0x7f04cc09aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56444/0 (socket says 172.21.15.98:56444) 2024-09-17T05:22:27.460 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.457+0000 7f04c9d9b640 1 -- 172.21.15.98:0/3300450915 learned_addr learned my addr 172.21.15.98:0/3300450915 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:27.460 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.457+0000 7f04cad9d640 1 --2- 172.21.15.98:0/3300450915 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04cc09afd0 0x7f04cc0b0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:27.460 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.457+0000 7f04ca59c640 1 --2- 172.21.15.98:0/3300450915 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f04b40064d0 0x7f04cc1e43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:27.460 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.457+0000 7f04c9d9b640 1 -- 172.21.15.98:0/3300450915 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f04b40064d0 msgr2=0x7f04cc1e43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:27.460 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.457+0000 7f04c9d9b640 1 --2- 172.21.15.98:0/3300450915 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f04b40064d0 0x7f04cc1e43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:27.460 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.457+0000 7f04c9d9b640 1 -- 172.21.15.98:0/3300450915 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04cc09afd0 msgr2=0x7f04cc0b0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:27.460 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.457+0000 7f04c9d9b640 1 --2- 172.21.15.98:0/3300450915 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04cc09afd0 0x7f04cc0b0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:27.460 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.457+0000 7f04c9d9b640 1 -- 172.21.15.98:0/3300450915 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04cc1f3f80 con 0x7f04cc1498b0 2024-09-17T05:22:27.460 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.457+0000 7f04c9d9b640 1 --2- 172.21.15.98:0/3300450915 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f04cc1498b0 0x7f04cc09aa90 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f04c0004ed0 tx=0x7f04c0001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:27.460 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.457+0000 7f04baffd640 1 -- 172.21.15.98:0/3300450915 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04c0015020 con 0x7f04cc1498b0 2024-09-17T05:22:27.460 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.457+0000 7f04baffd640 1 -- 172.21.15.98:0/3300450915 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f04c0011960 con 0x7f04cc1498b0 2024-09-17T05:22:27.461 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.457+0000 7f04d0871640 1 -- 172.21.15.98:0/3300450915 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04cc1f4260 con 0x7f04cc1498b0 2024-09-17T05:22:27.461 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.457+0000 7f04baffd640 1 -- 172.21.15.98:0/3300450915 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04c0011d90 con 0x7f04cc1498b0 2024-09-17T05:22:27.461 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.458+0000 7f04d0871640 1 -- 172.21.15.98:0/3300450915 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04cc1f4820 con 0x7f04cc1498b0 2024-09-17T05:22:27.461 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.458+0000 7f04d0871640 1 -- 172.21.15.98:0/3300450915 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04cc0b48b0 con 0x7f04cc1498b0 2024-09-17T05:22:27.462 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.459+0000 7f04baffd640 1 -- 172.21.15.98:0/3300450915 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f04c0018020 con 0x7f04cc1498b0 2024-09-17T05:22:27.462 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.459+0000 7f04baffd640 1 --2- 172.21.15.98:0/3300450915 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f04ac078b90 0x7f04ac07b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:27.462 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.460+0000 7f04baffd640 1 -- 172.21.15.98:0/3300450915 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f04c009b3e0 con 0x7f04cc1498b0 2024-09-17T05:22:27.462 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.460+0000 7f04ca59c640 1 --2- 172.21.15.98:0/3300450915 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f04ac078b90 0x7f04ac07b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:27.462 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.460+0000 7f04ca59c640 1 --2- 172.21.15.98:0/3300450915 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f04ac078b90 0x7f04ac07b050 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f04cc1ee4f0 tx=0x7f04bc009500 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:27.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.464+0000 7f04baffd640 1 -- 172.21.15.98:0/3300450915 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f04c001f020 con 0x7f04cc1498b0 2024-09-17T05:22:27.708 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.707+0000 7f04d0871640 1 -- 172.21.15.98:0/3300450915 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f04cc0cc940 con 0x7f04cc1498b0 2024-09-17T05:22:27.710 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.709+0000 7f04baffd640 1 -- 172.21.15.98:0/3300450915 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) ==== 90+0+0 (secure 0 0 0) 0x7f04c0063c00 con 0x7f04cc1498b0 2024-09-17T05:22:27.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.711+0000 7f04d0871640 1 -- 172.21.15.98:0/3300450915 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f04ac078b90 msgr2=0x7f04ac07b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:27.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.711+0000 7f04d0871640 1 --2- 172.21.15.98:0/3300450915 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f04ac078b90 0x7f04ac07b050 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f04cc1ee4f0 tx=0x7f04bc009500 comp rx=0 tx=0).stop 2024-09-17T05:22:27.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.711+0000 7f04d0871640 1 -- 172.21.15.98:0/3300450915 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f04cc1498b0 msgr2=0x7f04cc09aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:27.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.711+0000 7f04d0871640 1 --2- 172.21.15.98:0/3300450915 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f04cc1498b0 0x7f04cc09aa90 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f04c0004ed0 tx=0x7f04c0001630 comp rx=0 tx=0).stop 2024-09-17T05:22:27.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.711+0000 7f04d0871640 1 -- 172.21.15.98:0/3300450915 shutdown_connections 2024-09-17T05:22:27.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.711+0000 7f04d0871640 1 --2- 172.21.15.98:0/3300450915 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f04ac078b90 0x7f04ac07b050 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:27.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.711+0000 7f04d0871640 1 --2- 172.21.15.98:0/3300450915 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04cc09afd0 0x7f04cc0b0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:27.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.711+0000 7f04d0871640 1 --2- 172.21.15.98:0/3300450915 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f04cc1498b0 0x7f04cc09aa90 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:27.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.711+0000 7f04d0871640 1 --2- 172.21.15.98:0/3300450915 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f04b40064d0 0x7f04cc1e43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:27.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.711+0000 7f04d0871640 1 -- 172.21.15.98:0/3300450915 >> 172.21.15.98:0/3300450915 conn(0x7f04cc0b1950 msgr2=0x7f04cc0cd140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:27.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.711+0000 7f04d0871640 1 -- 172.21.15.98:0/3300450915 shutdown_connections 2024-09-17T05:22:27.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.711+0000 7f04d0871640 1 -- 172.21.15.98:0/3300450915 wait complete. 2024-09-17T05:22:27.723 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-17T05:22:27.825 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.824+0000 7f6ba0753640 1 -- 172.21.15.98:0/3190521486 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b9815e0d0 msgr2=0x7f6b980d09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:27.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.824+0000 7f6ba0753640 1 --2- 172.21.15.98:0/3190521486 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b9815e0d0 0x7f6b980d09c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6b980d1df0 tx=0x7f6b9402a5f0 comp rx=0 tx=0).stop 2024-09-17T05:22:27.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.824+0000 7f6ba0753640 1 -- 172.21.15.98:0/3190521486 shutdown_connections 2024-09-17T05:22:27.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.824+0000 7f6ba0753640 1 --2- 172.21.15.98:0/3190521486 >> v2:172.21.15.167:3300/0 conn(0x7f6b980d1610 0x7f6b980cecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:27.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.824+0000 7f6ba0753640 1 --2- 172.21.15.98:0/3190521486 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b9815e0d0 0x7f6b980d09c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:27.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.824+0000 7f6ba0753640 1 -- 172.21.15.98:0/3190521486 >> 172.21.15.98:0/3190521486 conn(0x7f6b980d3fe0 msgr2=0x7f6b980d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:27.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.824+0000 7f6ba0753640 1 -- 172.21.15.98:0/3190521486 shutdown_connections 2024-09-17T05:22:27.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.824+0000 7f6ba0753640 1 -- 172.21.15.98:0/3190521486 wait complete. 2024-09-17T05:22:27.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.825+0000 7f6ba0753640 1 Processor -- start 2024-09-17T05:22:27.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.826+0000 7f6ba0753640 1 -- start start 2024-09-17T05:22:27.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.826+0000 7f6ba0753640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b980d1610 0x7f6b980b7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:27.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.826+0000 7f6ba0753640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b980d2050 0x7f6b981f4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:27.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.826+0000 7f6ba0753640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b9815e0d0 0x7f6b980c9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:27.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.826+0000 7f6ba0753640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6b980cf610 con 0x7f6b980d2050 2024-09-17T05:22:27.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.826+0000 7f6ba0753640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6b980cf490 con 0x7f6b980d1610 2024-09-17T05:22:27.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.826+0000 7f6ba0753640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f6b980cf790 con 0x7f6b9815e0d0 2024-09-17T05:22:27.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.826+0000 7f6b9dcee640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b980d2050 0x7f6b981f4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:27.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.826+0000 7f6b9dcee640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b980d2050 0x7f6b981f4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56466/0 (socket says 172.21.15.98:56466) 2024-09-17T05:22:27.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.826+0000 7f6b9dcee640 1 -- 172.21.15.98:0/284305861 learned_addr learned my addr 172.21.15.98:0/284305861 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:27.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.827+0000 7f6b9e4ef640 1 --2- 172.21.15.98:0/284305861 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b980d1610 0x7f6b980b7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:27.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.827+0000 7f6b9ecf0640 1 --2- 172.21.15.98:0/284305861 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b9815e0d0 0x7f6b980c9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:27.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.827+0000 7f6b9dcee640 1 -- 172.21.15.98:0/284305861 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b9815e0d0 msgr2=0x7f6b980c9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:27.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.827+0000 7f6b9dcee640 1 --2- 172.21.15.98:0/284305861 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b9815e0d0 0x7f6b980c9b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:27.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.827+0000 7f6b9dcee640 1 -- 172.21.15.98:0/284305861 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b980d1610 msgr2=0x7f6b980b7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:27.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.827+0000 7f6b9dcee640 1 --2- 172.21.15.98:0/284305861 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b980d1610 0x7f6b980b7840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:27.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.827+0000 7f6b9dcee640 1 -- 172.21.15.98:0/284305861 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b980cb9a0 con 0x7f6b980d2050 2024-09-17T05:22:27.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.827+0000 7f6b9e4ef640 1 --2- 172.21.15.98:0/284305861 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b980d1610 0x7f6b980b7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:22:27.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.827+0000 7f6b9dcee640 1 --2- 172.21.15.98:0/284305861 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b980d2050 0x7f6b981f4160 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6b8800c500 tx=0x7f6b8800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:27.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.827+0000 7f6b8effd640 1 -- 172.21.15.98:0/284305861 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b88018070 con 0x7f6b980d2050 2024-09-17T05:22:27.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.827+0000 7f6b8effd640 1 -- 172.21.15.98:0/284305861 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6b880035f0 con 0x7f6b980d2050 2024-09-17T05:22:27.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.827+0000 7f6ba0753640 1 -- 172.21.15.98:0/284305861 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b980cbc80 con 0x7f6b980d2050 2024-09-17T05:22:27.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.827+0000 7f6b8effd640 1 -- 172.21.15.98:0/284305861 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b88003ac0 con 0x7f6b980d2050 2024-09-17T05:22:27.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.827+0000 7f6ba0753640 1 -- 172.21.15.98:0/284305861 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b980cc240 con 0x7f6b980d2050 2024-09-17T05:22:27.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.828+0000 7f6ba0753640 1 -- 172.21.15.98:0/284305861 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b980cfcb0 con 0x7f6b980d2050 2024-09-17T05:22:27.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.829+0000 7f6b8effd640 1 -- 172.21.15.98:0/284305861 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6b8801b070 con 0x7f6b980d2050 2024-09-17T05:22:27.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.829+0000 7f6b8effd640 1 --2- 172.21.15.98:0/284305861 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f6b7c078b90 0x7f6b7c07b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:27.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.829+0000 7f6b8effd640 1 -- 172.21.15.98:0/284305861 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f6b88099d80 con 0x7f6b980d2050 2024-09-17T05:22:27.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.829+0000 7f6b9e4ef640 1 --2- 172.21.15.98:0/284305861 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f6b7c078b90 0x7f6b7c07b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:27.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.830+0000 7f6b9e4ef640 1 --2- 172.21.15.98:0/284305861 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f6b7c078b90 0x7f6b7c07b050 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6b94033000 tx=0x7f6b94004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:27.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:27.833+0000 7f6b8effd640 1 -- 172.21.15.98:0/284305861 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f6b88062510 con 0x7f6b980d2050 2024-09-17T05:22:28.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.080+0000 7f6ba0753640 1 -- 172.21.15.98:0/284305861 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f6b9806d670 con 0x7f6b980d2050 2024-09-17T05:22:28.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.082+0000 7f6b8effd640 1 -- 172.21.15.98:0/284305861 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f6b88061e10 con 0x7f6b980d2050 2024-09-17T05:22:28.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.084+0000 7f6ba0753640 1 -- 172.21.15.98:0/284305861 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f6b7c078b90 msgr2=0x7f6b7c07b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:28.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.084+0000 7f6ba0753640 1 --2- 172.21.15.98:0/284305861 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f6b7c078b90 0x7f6b7c07b050 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6b94033000 tx=0x7f6b94004730 comp rx=0 tx=0).stop 2024-09-17T05:22:28.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.084+0000 7f6ba0753640 1 -- 172.21.15.98:0/284305861 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b980d2050 msgr2=0x7f6b981f4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:28.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.084+0000 7f6ba0753640 1 --2- 172.21.15.98:0/284305861 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b980d2050 0x7f6b981f4160 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6b8800c500 tx=0x7f6b8800c9c0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.084+0000 7f6ba0753640 1 -- 172.21.15.98:0/284305861 shutdown_connections 2024-09-17T05:22:28.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.084+0000 7f6ba0753640 1 --2- 172.21.15.98:0/284305861 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f6b7c078b90 0x7f6b7c07b050 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.084+0000 7f6ba0753640 1 --2- 172.21.15.98:0/284305861 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b9815e0d0 0x7f6b980c9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.084+0000 7f6ba0753640 1 --2- 172.21.15.98:0/284305861 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b980d2050 0x7f6b981f4160 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.084+0000 7f6ba0753640 1 --2- 172.21.15.98:0/284305861 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b980d1610 0x7f6b980b7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.084+0000 7f6ba0753640 1 -- 172.21.15.98:0/284305861 >> 172.21.15.98:0/284305861 conn(0x7f6b980d3fe0 msgr2=0x7f6b980d09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:28.087 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.084+0000 7f6ba0753640 1 -- 172.21.15.98:0/284305861 shutdown_connections 2024-09-17T05:22:28.087 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.084+0000 7f6ba0753640 1 -- 172.21.15.98:0/284305861 wait complete. 2024-09-17T05:22:28.097 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-17T05:22:28.199 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.197+0000 7fdc846bd640 1 -- 172.21.15.98:0/1205712953 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc7c15d020 msgr2=0x7fdc7c074410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:28.199 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.197+0000 7fdc846bd640 1 --2- 172.21.15.98:0/1205712953 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc7c15d020 0x7fdc7c074410 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c009830 tx=0x7fdc6c02a510 comp rx=0 tx=0).stop 2024-09-17T05:22:28.199 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.198+0000 7fdc846bd640 1 -- 172.21.15.98:0/1205712953 shutdown_connections 2024-09-17T05:22:28.199 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.198+0000 7fdc846bd640 1 --2- 172.21.15.98:0/1205712953 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc7c15d020 0x7fdc7c074410 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.199 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.198+0000 7fdc846bd640 1 --2- 172.21.15.98:0/1205712953 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc7c15c700 0x7fdc7c15cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.199 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.198+0000 7fdc846bd640 1 -- 172.21.15.98:0/1205712953 >> 172.21.15.98:0/1205712953 conn(0x7fdc7c0cffe0 msgr2=0x7fdc7c0d03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:28.199 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.198+0000 7fdc846bd640 1 -- 172.21.15.98:0/1205712953 shutdown_connections 2024-09-17T05:22:28.199 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.198+0000 7fdc846bd640 1 -- 172.21.15.98:0/1205712953 wait complete. 2024-09-17T05:22:28.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.199+0000 7fdc846bd640 1 Processor -- start 2024-09-17T05:22:28.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.199+0000 7fdc846bd640 1 -- start start 2024-09-17T05:22:28.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.199+0000 7fdc846bd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc7c0d0b00 0x7fdc7c1f3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:28.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.199+0000 7fdc846bd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc7c15c700 0x7fdc7c0c8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:28.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.199+0000 7fdc846bd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc7c15d020 0x7fdc7c0b4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:28.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.199+0000 7fdc846bd640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7c156300 con 0x7fdc7c0d0b00 2024-09-17T05:22:28.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.199+0000 7fdc846bd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7c074d00 con 0x7fdc7c15c700 2024-09-17T05:22:28.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.199+0000 7fdc846bd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fdc7c156480 con 0x7fdc7c15d020 2024-09-17T05:22:28.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.200+0000 7fdc82459640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc7c0d0b00 0x7fdc7c1f3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:28.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.200+0000 7fdc82459640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc7c0d0b00 0x7fdc7c1f3200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56492/0 (socket says 172.21.15.98:56492) 2024-09-17T05:22:28.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.200+0000 7fdc82459640 1 -- 172.21.15.98:0/1750369492 learned_addr learned my addr 172.21.15.98:0/1750369492 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:28.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.200+0000 7fdc82459640 1 -- 172.21.15.98:0/1750369492 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc7c15d020 msgr2=0x7fdc7c0b4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:28.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.200+0000 7fdc82c5a640 1 --2- 172.21.15.98:0/1750369492 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc7c15d020 0x7fdc7c0b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:28.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.200+0000 7fdc81c58640 1 --2- 172.21.15.98:0/1750369492 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc7c15c700 0x7fdc7c0c8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:28.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.200+0000 7fdc82459640 1 --2- 172.21.15.98:0/1750369492 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc7c15d020 0x7fdc7c0b4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.200+0000 7fdc82459640 1 -- 172.21.15.98:0/1750369492 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc7c15c700 msgr2=0x7fdc7c0c8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:28.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.200+0000 7fdc82459640 1 --2- 172.21.15.98:0/1750369492 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc7c15c700 0x7fdc7c0c8500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.200+0000 7fdc82459640 1 -- 172.21.15.98:0/1750369492 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc7c1f3740 con 0x7fdc7c0d0b00 2024-09-17T05:22:28.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.200+0000 7fdc82459640 1 --2- 172.21.15.98:0/1750369492 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc7c0d0b00 0x7fdc7c1f3200 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fdc7800b4a0 tx=0x7fdc7800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:28.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.200+0000 7fdc72ffd640 1 -- 172.21.15.98:0/1750369492 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc78014070 con 0x7fdc7c0d0b00 2024-09-17T05:22:28.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.200+0000 7fdc72ffd640 1 -- 172.21.15.98:0/1750369492 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdc78010700 con 0x7fdc7c0d0b00 2024-09-17T05:22:28.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.200+0000 7fdc846bd640 1 -- 172.21.15.98:0/1750369492 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc7c0c73e0 con 0x7fdc7c0d0b00 2024-09-17T05:22:28.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.200+0000 7fdc72ffd640 1 -- 172.21.15.98:0/1750369492 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc78010b50 con 0x7fdc7c0d0b00 2024-09-17T05:22:28.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.200+0000 7fdc846bd640 1 -- 172.21.15.98:0/1750369492 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc7c0c79a0 con 0x7fdc7c0d0b00 2024-09-17T05:22:28.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.201+0000 7fdc846bd640 1 -- 172.21.15.98:0/1750369492 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc7c15cae0 con 0x7fdc7c0d0b00 2024-09-17T05:22:28.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.202+0000 7fdc72ffd640 1 -- 172.21.15.98:0/1750369492 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdc78017070 con 0x7fdc7c0d0b00 2024-09-17T05:22:28.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.202+0000 7fdc72ffd640 1 --2- 172.21.15.98:0/1750369492 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fdc60078bc0 0x7fdc6007b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:28.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.202+0000 7fdc72ffd640 1 -- 172.21.15.98:0/1750369492 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7fdc7809a3d0 con 0x7fdc7c0d0b00 2024-09-17T05:22:28.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.202+0000 7fdc81c58640 1 --2- 172.21.15.98:0/1750369492 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fdc60078bc0 0x7fdc6007b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:28.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.203+0000 7fdc81c58640 1 --2- 172.21.15.98:0/1750369492 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fdc60078bc0 0x7fdc6007b080 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c034000 tx=0x7fdc6c004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:28.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.207+0000 7fdc72ffd640 1 -- 172.21.15.98:0/1750369492 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fdc7c1f3740 con 0x7fdc7c0d0b00 2024-09-17T05:22:28.454 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.453+0000 7fdc846bd640 1 -- 172.21.15.98:0/1750369492 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7fdc7c0cb9e0 con 0x7fdc7c0d0b00 2024-09-17T05:22:28.455 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.455+0000 7fdc72ffd640 1 -- 172.21.15.98:0/1750369492 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) ==== 90+0+0 (secure 0 0 0) 0x7fdc78062bf0 con 0x7fdc7c0d0b00 2024-09-17T05:22:28.458 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.457+0000 7fdc846bd640 1 -- 172.21.15.98:0/1750369492 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fdc60078bc0 msgr2=0x7fdc6007b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:28.459 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.457+0000 7fdc846bd640 1 --2- 172.21.15.98:0/1750369492 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fdc60078bc0 0x7fdc6007b080 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c034000 tx=0x7fdc6c004730 comp rx=0 tx=0).stop 2024-09-17T05:22:28.459 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.457+0000 7fdc846bd640 1 -- 172.21.15.98:0/1750369492 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc7c0d0b00 msgr2=0x7fdc7c1f3200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:28.459 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.457+0000 7fdc846bd640 1 --2- 172.21.15.98:0/1750369492 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc7c0d0b00 0x7fdc7c1f3200 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fdc7800b4a0 tx=0x7fdc7800b960 comp rx=0 tx=0).stop 2024-09-17T05:22:28.459 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.457+0000 7fdc846bd640 1 -- 172.21.15.98:0/1750369492 shutdown_connections 2024-09-17T05:22:28.459 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.457+0000 7fdc846bd640 1 --2- 172.21.15.98:0/1750369492 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fdc60078bc0 0x7fdc6007b080 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.459 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.457+0000 7fdc846bd640 1 --2- 172.21.15.98:0/1750369492 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc7c15d020 0x7fdc7c0b4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.459 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.457+0000 7fdc846bd640 1 --2- 172.21.15.98:0/1750369492 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc7c15c700 0x7fdc7c0c8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.459 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.457+0000 7fdc846bd640 1 --2- 172.21.15.98:0/1750369492 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc7c0d0b00 0x7fdc7c1f3200 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.459 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.457+0000 7fdc846bd640 1 -- 172.21.15.98:0/1750369492 >> 172.21.15.98:0/1750369492 conn(0x7fdc7c0cffe0 msgr2=0x7fdc7c0b05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:28.459 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.458+0000 7fdc846bd640 1 -- 172.21.15.98:0/1750369492 shutdown_connections 2024-09-17T05:22:28.459 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.458+0000 7fdc846bd640 1 -- 172.21.15.98:0/1750369492 wait complete. 2024-09-17T05:22:28.469 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-17T05:22:28.571 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.569+0000 7f1bc0cdd640 1 -- 172.21.15.98:0/2488197985 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1bbc0b4ca0 msgr2=0x7f1bbc15e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:28.571 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.569+0000 7f1bc0cdd640 1 --2- 172.21.15.98:0/2488197985 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1bbc0b4ca0 0x7f1bbc15e970 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc075130 tx=0x7f1bac02a5f0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.571 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.570+0000 7f1bc0cdd640 1 -- 172.21.15.98:0/2488197985 shutdown_connections 2024-09-17T05:22:28.571 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.570+0000 7f1bc0cdd640 1 --2- 172.21.15.98:0/2488197985 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1bbc0b4ca0 0x7f1bbc15e970 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.571 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.570+0000 7f1bc0cdd640 1 --2- 172.21.15.98:0/2488197985 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1bbc0ccfd0 0x7f1bbc0cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.571 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.570+0000 7f1bc0cdd640 1 --2- 172.21.15.98:0/2488197985 >> v2:172.21.15.167:3300/0 conn(0x7f1bbc1445d0 0x7f1bbc0cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.571 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.570+0000 7f1bc0cdd640 1 -- 172.21.15.98:0/2488197985 >> 172.21.15.98:0/2488197985 conn(0x7f1bbc0b1950 msgr2=0x7f1bbc0b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:28.571 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.570+0000 7f1bc0cdd640 1 -- 172.21.15.98:0/2488197985 shutdown_connections 2024-09-17T05:22:28.571 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.570+0000 7f1bc0cdd640 1 -- 172.21.15.98:0/2488197985 wait complete. 2024-09-17T05:22:28.573 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.571+0000 7f1bc0cdd640 1 Processor -- start 2024-09-17T05:22:28.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.571+0000 7f1bc0cdd640 1 -- start start 2024-09-17T05:22:28.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.572+0000 7f1bc0cdd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1bbc0b4ca0 0x7f1bbc1f2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:28.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.572+0000 7f1bc0cdd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1bbc0ccfd0 0x7f1bbc1f6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:28.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.572+0000 7f1bc0cdd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1bbc1445d0 0x7f1bbc15b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:28.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.572+0000 7f1bc0cdd640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1bbc15f240 con 0x7f1bbc1445d0 2024-09-17T05:22:28.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.572+0000 7f1bc0cdd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1bbc15f0c0 con 0x7f1bbc0ccfd0 2024-09-17T05:22:28.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.572+0000 7f1bc0cdd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f1bbc15f3c0 con 0x7f1bbc0b4ca0 2024-09-17T05:22:28.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.572+0000 7f1bbad9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1bbc1445d0 0x7f1bbc15b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:28.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.572+0000 7f1bbad9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1bbc1445d0 0x7f1bbc15b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56516/0 (socket says 172.21.15.98:56516) 2024-09-17T05:22:28.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.572+0000 7f1bbad9d640 1 -- 172.21.15.98:0/4024688197 learned_addr learned my addr 172.21.15.98:0/4024688197 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:28.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.572+0000 7f1bba59c640 1 --2- 172.21.15.98:0/4024688197 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1bbc0b4ca0 0x7f1bbc1f2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:28.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.572+0000 7f1bb9d9b640 1 --2- 172.21.15.98:0/4024688197 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1bbc0ccfd0 0x7f1bbc1f6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:28.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.572+0000 7f1bbad9d640 1 -- 172.21.15.98:0/4024688197 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1bbc0b4ca0 msgr2=0x7f1bbc1f2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:28.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.572+0000 7f1bbad9d640 1 --2- 172.21.15.98:0/4024688197 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1bbc0b4ca0 0x7f1bbc1f2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.572+0000 7f1bbad9d640 1 -- 172.21.15.98:0/4024688197 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1bbc0ccfd0 msgr2=0x7f1bbc1f6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:28.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.572+0000 7f1bbad9d640 1 --2- 172.21.15.98:0/4024688197 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1bbc0ccfd0 0x7f1bbc1f6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.572+0000 7f1bbad9d640 1 -- 172.21.15.98:0/4024688197 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bbc1f73a0 con 0x7f1bbc1445d0 2024-09-17T05:22:28.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.572+0000 7f1bbad9d640 1 --2- 172.21.15.98:0/4024688197 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1bbc1445d0 0x7f1bbc15b3f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1bac009230 tx=0x7f1bac003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:28.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.572+0000 7f1bb2ffd640 1 -- 172.21.15.98:0/4024688197 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bac03f070 con 0x7f1bbc1445d0 2024-09-17T05:22:28.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.572+0000 7f1bb2ffd640 1 -- 172.21.15.98:0/4024688197 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1bac004890 con 0x7f1bbc1445d0 2024-09-17T05:22:28.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.572+0000 7f1bc0cdd640 1 -- 172.21.15.98:0/4024688197 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bbc15b930 con 0x7f1bbc1445d0 2024-09-17T05:22:28.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.572+0000 7f1bb2ffd640 1 -- 172.21.15.98:0/4024688197 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bac035030 con 0x7f1bbc1445d0 2024-09-17T05:22:28.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.572+0000 7f1bc0cdd640 1 -- 172.21.15.98:0/4024688197 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bbc1f3a70 con 0x7f1bbc1445d0 2024-09-17T05:22:28.576 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.573+0000 7f1bc0cdd640 1 -- 172.21.15.98:0/4024688197 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bbc15e970 con 0x7f1bbc1445d0 2024-09-17T05:22:28.576 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.574+0000 7f1bb2ffd640 1 -- 172.21.15.98:0/4024688197 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1bac042070 con 0x7f1bbc1445d0 2024-09-17T05:22:28.576 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.575+0000 7f1bb2ffd640 1 --2- 172.21.15.98:0/4024688197 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f1b9c078b90 0x7f1b9c07b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:28.576 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.575+0000 7f1bb2ffd640 1 -- 172.21.15.98:0/4024688197 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f1bac0bb950 con 0x7f1bbc1445d0 2024-09-17T05:22:28.576 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.575+0000 7f1bba59c640 1 --2- 172.21.15.98:0/4024688197 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f1b9c078b90 0x7f1b9c07b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:28.577 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.575+0000 7f1bba59c640 1 --2- 172.21.15.98:0/4024688197 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f1b9c078b90 0x7f1b9c07b050 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1bb4005c40 tx=0x7f1bb400a550 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:28.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.579+0000 7f1bb2ffd640 1 -- 172.21.15.98:0/4024688197 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f1bbc1f73a0 con 0x7f1bbc1445d0 2024-09-17T05:22:28.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.820+0000 7f1bc0cdd640 1 -- 172.21.15.98:0/4024688197 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f1bbc070a20 con 0x7f1bbc1445d0 2024-09-17T05:22:28.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.822+0000 7f1bb2ffd640 1 -- 172.21.15.98:0/4024688197 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) ==== 90+0+0 (secure 0 0 0) 0x7f1bac083b40 con 0x7f1bbc1445d0 2024-09-17T05:22:28.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.825+0000 7f1bc0cdd640 1 -- 172.21.15.98:0/4024688197 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f1b9c078b90 msgr2=0x7f1b9c07b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:28.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.825+0000 7f1bc0cdd640 1 --2- 172.21.15.98:0/4024688197 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f1b9c078b90 0x7f1b9c07b050 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1bb4005c40 tx=0x7f1bb400a550 comp rx=0 tx=0).stop 2024-09-17T05:22:28.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.825+0000 7f1bc0cdd640 1 -- 172.21.15.98:0/4024688197 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1bbc1445d0 msgr2=0x7f1bbc15b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:28.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.825+0000 7f1bc0cdd640 1 --2- 172.21.15.98:0/4024688197 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1bbc1445d0 0x7f1bbc15b3f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1bac009230 tx=0x7f1bac003960 comp rx=0 tx=0).stop 2024-09-17T05:22:28.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.825+0000 7f1bc0cdd640 1 -- 172.21.15.98:0/4024688197 shutdown_connections 2024-09-17T05:22:28.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.825+0000 7f1bc0cdd640 1 --2- 172.21.15.98:0/4024688197 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f1b9c078b90 0x7f1b9c07b050 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.825+0000 7f1bc0cdd640 1 --2- 172.21.15.98:0/4024688197 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1bbc1445d0 0x7f1bbc15b3f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.825+0000 7f1bc0cdd640 1 --2- 172.21.15.98:0/4024688197 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1bbc0ccfd0 0x7f1bbc1f6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.825+0000 7f1bc0cdd640 1 --2- 172.21.15.98:0/4024688197 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1bbc0b4ca0 0x7f1bbc1f2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.825+0000 7f1bc0cdd640 1 -- 172.21.15.98:0/4024688197 >> 172.21.15.98:0/4024688197 conn(0x7f1bbc0b1950 msgr2=0x7f1bbc0aed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:28.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.825+0000 7f1bc0cdd640 1 -- 172.21.15.98:0/4024688197 shutdown_connections 2024-09-17T05:22:28.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.825+0000 7f1bc0cdd640 1 -- 172.21.15.98:0/4024688197 wait complete. 2024-09-17T05:22:28.837 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-17T05:22:28.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.939+0000 7f730c671640 1 -- 172.21.15.98:0/4185984292 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f72f00052e0 msgr2=0x7f72f000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:28.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.939+0000 7f730c671640 1 --2- 172.21.15.98:0/4185984292 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f72f00052e0 0x7f72f000b9c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f72fc005fd0 tx=0x7f72f0005830 comp rx=0 tx=0).stop 2024-09-17T05:22:28.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.939+0000 7f730c671640 1 -- 172.21.15.98:0/4185984292 shutdown_connections 2024-09-17T05:22:28.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.939+0000 7f730c671640 1 --2- 172.21.15.98:0/4185984292 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f72f00052e0 0x7f72f000b9c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.939+0000 7f730c671640 1 -- 172.21.15.98:0/4185984292 >> 172.21.15.98:0/4185984292 conn(0x7f73040b1950 msgr2=0x7f73040b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:28.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.939+0000 7f730c671640 1 -- 172.21.15.98:0/4185984292 shutdown_connections 2024-09-17T05:22:28.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.939+0000 7f730c671640 1 -- 172.21.15.98:0/4185984292 wait complete. 2024-09-17T05:22:28.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.940+0000 7f730c671640 1 Processor -- start 2024-09-17T05:22:28.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.940+0000 7f730c671640 1 -- start start 2024-09-17T05:22:28.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.941+0000 7f730c671640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f72f00052e0 0x7f730414c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:28.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.941+0000 7f730c671640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73040ccaf0 0x7f73041509d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:28.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.941+0000 7f730c671640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f730414fad0 0x7f7304150f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:28.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.941+0000 7f730c671640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f73040ad0c0 con 0x7f730414fad0 2024-09-17T05:22:28.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.941+0000 7f730c671640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f73040acf40 con 0x7f73040ccaf0 2024-09-17T05:22:28.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.941+0000 7f730c671640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f73040ad240 con 0x7f72f00052e0 2024-09-17T05:22:28.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.941+0000 7f730ac0e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f730414fad0 0x7f7304150f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:28.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.941+0000 7f730ac0e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f730414fad0 0x7f7304150f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56542/0 (socket says 172.21.15.98:56542) 2024-09-17T05:22:28.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.941+0000 7f730ac0e640 1 -- 172.21.15.98:0/2507606173 learned_addr learned my addr 172.21.15.98:0/2507606173 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:28.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.941+0000 7f7309c0c640 1 --2- 172.21.15.98:0/2507606173 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73040ccaf0 0x7f73041509d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:28.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.941+0000 7f730a40d640 1 --2- 172.21.15.98:0/2507606173 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f72f00052e0 0x7f730414c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:28.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.941+0000 7f730ac0e640 1 -- 172.21.15.98:0/2507606173 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f72f00052e0 msgr2=0x7f730414c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:28.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.941+0000 7f730ac0e640 1 --2- 172.21.15.98:0/2507606173 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f72f00052e0 0x7f730414c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.941+0000 7f730ac0e640 1 -- 172.21.15.98:0/2507606173 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73040ccaf0 msgr2=0x7f73041509d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:28.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.941+0000 7f730ac0e640 1 --2- 172.21.15.98:0/2507606173 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73040ccaf0 0x7f73041509d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.941+0000 7f730ac0e640 1 -- 172.21.15.98:0/2507606173 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f730414cc70 con 0x7f730414fad0 2024-09-17T05:22:28.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.941+0000 7f730ac0e640 1 --2- 172.21.15.98:0/2507606173 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f730414fad0 0x7f7304150f10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f72fc009e20 tx=0x7f72fc0042d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:28.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.941+0000 7f72faffd640 1 -- 172.21.15.98:0/2507606173 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72fc009200 con 0x7f730414fad0 2024-09-17T05:22:28.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.941+0000 7f72faffd640 1 -- 172.21.15.98:0/2507606173 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f72fc043070 con 0x7f730414fad0 2024-09-17T05:22:28.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.941+0000 7f730c671640 1 -- 172.21.15.98:0/2507606173 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73041f2780 con 0x7f730414fad0 2024-09-17T05:22:28.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.941+0000 7f72faffd640 1 -- 172.21.15.98:0/2507606173 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72fc009ad0 con 0x7f730414fad0 2024-09-17T05:22:28.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.941+0000 7f730c671640 1 -- 172.21.15.98:0/2507606173 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73041f6a90 con 0x7f730414fad0 2024-09-17T05:22:28.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.942+0000 7f730c671640 1 -- 172.21.15.98:0/2507606173 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73041f6c60 con 0x7f730414fad0 2024-09-17T05:22:28.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.943+0000 7f72faffd640 1 -- 172.21.15.98:0/2507606173 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f72fc048460 con 0x7f730414fad0 2024-09-17T05:22:28.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.943+0000 7f72faffd640 1 --2- 172.21.15.98:0/2507606173 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f72e8078b90 0x7f72e807b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:28.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.944+0000 7f72faffd640 1 -- 172.21.15.98:0/2507606173 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f72fc0bbad0 con 0x7f730414fad0 2024-09-17T05:22:28.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.944+0000 7f730a40d640 1 --2- 172.21.15.98:0/2507606173 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f72e8078b90 0x7f72e807b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:28.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.944+0000 7f730a40d640 1 --2- 172.21.15.98:0/2507606173 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f72e8078b90 0x7f72e807b050 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7300001240 tx=0x7f7300001190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:28.948 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:28.948+0000 7f72faffd640 1 -- 172.21.15.98:0/2507606173 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f730414cc70 con 0x7f730414fad0 2024-09-17T05:22:29.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.193+0000 7f730c671640 1 -- 172.21.15.98:0/2507606173 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f73040af9c0 con 0x7f730414fad0 2024-09-17T05:22:29.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.195+0000 7f72faffd640 1 -- 172.21.15.98:0/2507606173 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) ==== 97+0+0 (secure 0 0 0) 0x7f72fc0842f0 con 0x7f730414fad0 2024-09-17T05:22:29.198 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.197+0000 7f730c671640 1 -- 172.21.15.98:0/2507606173 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f72e8078b90 msgr2=0x7f72e807b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:29.198 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.197+0000 7f730c671640 1 --2- 172.21.15.98:0/2507606173 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f72e8078b90 0x7f72e807b050 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7300001240 tx=0x7f7300001190 comp rx=0 tx=0).stop 2024-09-17T05:22:29.198 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.197+0000 7f730c671640 1 -- 172.21.15.98:0/2507606173 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f730414fad0 msgr2=0x7f7304150f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:29.198 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.197+0000 7f730c671640 1 --2- 172.21.15.98:0/2507606173 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f730414fad0 0x7f7304150f10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f72fc009e20 tx=0x7f72fc0042d0 comp rx=0 tx=0).stop 2024-09-17T05:22:29.198 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.197+0000 7f730c671640 1 -- 172.21.15.98:0/2507606173 shutdown_connections 2024-09-17T05:22:29.199 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.197+0000 7f730c671640 1 --2- 172.21.15.98:0/2507606173 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f72e8078b90 0x7f72e807b050 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:29.199 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.197+0000 7f730c671640 1 --2- 172.21.15.98:0/2507606173 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f730414fad0 0x7f7304150f10 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:29.199 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.197+0000 7f730c671640 1 --2- 172.21.15.98:0/2507606173 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73040ccaf0 0x7f73041509d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:29.199 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.197+0000 7f730c671640 1 --2- 172.21.15.98:0/2507606173 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f72f00052e0 0x7f730414c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:29.199 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.197+0000 7f730c671640 1 -- 172.21.15.98:0/2507606173 >> 172.21.15.98:0/2507606173 conn(0x7f73040b1950 msgr2=0x7f73040741c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:29.199 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.197+0000 7f730c671640 1 -- 172.21.15.98:0/2507606173 shutdown_connections 2024-09-17T05:22:29.199 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.197+0000 7f730c671640 1 -- 172.21.15.98:0/2507606173 wait complete. 2024-09-17T05:22:29.208 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-17T05:22:29.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.310+0000 7eff381da640 1 -- 172.21.15.98:0/3601944099 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff1c005190 msgr2=0x7eff1c005910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:29.312 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.310+0000 7eff381da640 1 --2- 172.21.15.98:0/3601944099 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff1c005190 0x7eff1c005910 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7eff2000baf0 tx=0x7eff1c006940 comp rx=0 tx=0).stop 2024-09-17T05:22:29.312 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.310+0000 7eff36777640 1 -- 172.21.15.98:0/3601944099 reap_dead start 2024-09-17T05:22:29.312 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.310+0000 7eff381da640 1 -- 172.21.15.98:0/3601944099 shutdown_connections 2024-09-17T05:22:29.312 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.310+0000 7eff381da640 1 -- 172.21.15.98:0/3601944099 >> 172.21.15.98:0/3601944099 conn(0x7eff300b1950 msgr2=0x7eff300b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:29.312 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.310+0000 7eff381da640 1 -- 172.21.15.98:0/3601944099 shutdown_connections 2024-09-17T05:22:29.312 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.310+0000 7eff381da640 1 -- 172.21.15.98:0/3601944099 wait complete. 2024-09-17T05:22:29.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.311+0000 7eff381da640 1 Processor -- start 2024-09-17T05:22:29.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.311+0000 7eff381da640 1 -- start start 2024-09-17T05:22:29.315 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.312+0000 7eff381da640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff1c005190 0x7eff3015aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:29.315 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.312+0000 7eff381da640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff30140080 0x7eff3009cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:29.315 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.312+0000 7eff381da640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff30140500 0x7eff3009d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:29.315 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.312+0000 7eff381da640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7eff300cca00 con 0x7eff30140080 2024-09-17T05:22:29.315 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.312+0000 7eff381da640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7eff300cc880 con 0x7eff1c005190 2024-09-17T05:22:29.315 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.312+0000 7eff381da640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7eff300ccb80 con 0x7eff30140500 2024-09-17T05:22:29.315 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.312+0000 7eff35775640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff30140080 0x7eff3009cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:29.315 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.312+0000 7eff35775640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff30140080 0x7eff3009cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56568/0 (socket says 172.21.15.98:56568) 2024-09-17T05:22:29.315 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.312+0000 7eff35775640 1 -- 172.21.15.98:0/3024840431 learned_addr learned my addr 172.21.15.98:0/3024840431 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:29.315 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.312+0000 7eff36777640 1 --2- 172.21.15.98:0/3024840431 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff30140500 0x7eff3009d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:29.315 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.312+0000 7eff35f76640 1 --2- 172.21.15.98:0/3024840431 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff1c005190 0x7eff3015aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:29.315 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.313+0000 7eff35775640 1 -- 172.21.15.98:0/3024840431 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff30140500 msgr2=0x7eff3009d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:29.316 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.313+0000 7eff35775640 1 --2- 172.21.15.98:0/3024840431 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff30140500 0x7eff3009d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:29.316 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.313+0000 7eff35775640 1 -- 172.21.15.98:0/3024840431 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff1c005190 msgr2=0x7eff3015aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:29.316 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.313+0000 7eff35775640 1 --2- 172.21.15.98:0/3024840431 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff1c005190 0x7eff3015aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:29.316 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.313+0000 7eff35775640 1 -- 172.21.15.98:0/3024840431 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff3009aa00 con 0x7eff30140080 2024-09-17T05:22:29.316 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.313+0000 7eff36777640 1 --2- 172.21.15.98:0/3024840431 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff30140500 0x7eff3009d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:22:29.316 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.313+0000 7eff35775640 1 --2- 172.21.15.98:0/3024840431 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff30140080 0x7eff3009cec0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7eff2002af10 tx=0x7eff2000b770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:29.316 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.313+0000 7eff267fc640 1 -- 172.21.15.98:0/3024840431 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff20004230 con 0x7eff30140080 2024-09-17T05:22:29.316 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.313+0000 7eff267fc640 1 -- 172.21.15.98:0/3024840431 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7eff200043f0 con 0x7eff30140080 2024-09-17T05:22:29.316 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.313+0000 7eff381da640 1 -- 172.21.15.98:0/3024840431 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff30140a60 con 0x7eff30140080 2024-09-17T05:22:29.316 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.313+0000 7eff267fc640 1 -- 172.21.15.98:0/3024840431 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff2003e8c0 con 0x7eff30140080 2024-09-17T05:22:29.316 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.313+0000 7eff381da640 1 -- 172.21.15.98:0/3024840431 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff30141020 con 0x7eff30140080 2024-09-17T05:22:29.316 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.314+0000 7eff381da640 1 -- 172.21.15.98:0/3024840431 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff3006f850 con 0x7eff30140080 2024-09-17T05:22:29.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.314+0000 7eff267fc640 1 -- 172.21.15.98:0/3024840431 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7eff2003ea60 con 0x7eff30140080 2024-09-17T05:22:29.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.315+0000 7eff267fc640 1 --2- 172.21.15.98:0/3024840431 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7eff14078bc0 0x7eff1407b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:29.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.315+0000 7eff267fc640 1 -- 172.21.15.98:0/3024840431 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7eff200bbbc0 con 0x7eff30140080 2024-09-17T05:22:29.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.315+0000 7eff35f76640 1 --2- 172.21.15.98:0/3024840431 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7eff14078bc0 0x7eff1407b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:29.318 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.316+0000 7eff35f76640 1 --2- 172.21.15.98:0/3024840431 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7eff14078bc0 0x7eff1407b080 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7eff2c001010 tx=0x7eff2c001d60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:29.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.319+0000 7eff267fc640 1 -- 172.21.15.98:0/3024840431 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7eff20042020 con 0x7eff30140080 2024-09-17T05:22:29.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.562+0000 7eff381da640 1 -- 172.21.15.98:0/3024840431 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7eff300cf4f0 con 0x7eff30140080 2024-09-17T05:22:29.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.564+0000 7eff267fc640 1 -- 172.21.15.98:0/3024840431 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) ==== 90+0+0 (secure 0 0 0) 0x7eff20083d00 con 0x7eff30140080 2024-09-17T05:22:29.568 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.567+0000 7eff381da640 1 -- 172.21.15.98:0/3024840431 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7eff14078bc0 msgr2=0x7eff1407b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:29.568 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.567+0000 7eff381da640 1 --2- 172.21.15.98:0/3024840431 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7eff14078bc0 0x7eff1407b080 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7eff2c001010 tx=0x7eff2c001d60 comp rx=0 tx=0).stop 2024-09-17T05:22:29.568 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.567+0000 7eff381da640 1 -- 172.21.15.98:0/3024840431 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff30140080 msgr2=0x7eff3009cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:29.568 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.567+0000 7eff381da640 1 --2- 172.21.15.98:0/3024840431 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff30140080 0x7eff3009cec0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7eff2002af10 tx=0x7eff2000b770 comp rx=0 tx=0).stop 2024-09-17T05:22:29.568 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.567+0000 7eff381da640 1 -- 172.21.15.98:0/3024840431 shutdown_connections 2024-09-17T05:22:29.568 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.567+0000 7eff381da640 1 --2- 172.21.15.98:0/3024840431 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7eff14078bc0 0x7eff1407b080 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:29.568 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.567+0000 7eff381da640 1 --2- 172.21.15.98:0/3024840431 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff30140500 0x7eff3009d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:29.568 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.567+0000 7eff381da640 1 --2- 172.21.15.98:0/3024840431 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff30140080 0x7eff3009cec0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:29.568 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.567+0000 7eff381da640 1 --2- 172.21.15.98:0/3024840431 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff1c005190 0x7eff3015aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:29.568 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.567+0000 7eff381da640 1 -- 172.21.15.98:0/3024840431 >> 172.21.15.98:0/3024840431 conn(0x7eff300b1950 msgr2=0x7eff300b4310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:29.568 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.567+0000 7eff381da640 1 -- 172.21.15.98:0/3024840431 shutdown_connections 2024-09-17T05:22:29.569 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.567+0000 7eff381da640 1 -- 172.21.15.98:0/3024840431 wait complete. 2024-09-17T05:22:29.579 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T05:22:29.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.680+0000 7f39907ad640 1 -- 172.21.15.98:0/155438285 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3970004d90 msgr2=0x7f3970005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:29.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.680+0000 7f39907ad640 1 --2- 172.21.15.98:0/155438285 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3970004d90 0x7f3970005210 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f3980001830 tx=0x7f3970005830 comp rx=0 tx=0).stop 2024-09-17T05:22:29.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.680+0000 7f398ed4a640 1 -- 172.21.15.98:0/155438285 reap_dead start 2024-09-17T05:22:29.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.680+0000 7f39907ad640 1 -- 172.21.15.98:0/155438285 shutdown_connections 2024-09-17T05:22:29.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.680+0000 7f39907ad640 1 -- 172.21.15.98:0/155438285 >> 172.21.15.98:0/155438285 conn(0x7f39880b1950 msgr2=0x7f39880b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:29.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.680+0000 7f39907ad640 1 -- 172.21.15.98:0/155438285 shutdown_connections 2024-09-17T05:22:29.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.680+0000 7f39907ad640 1 -- 172.21.15.98:0/155438285 wait complete. 2024-09-17T05:22:29.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.681+0000 7f39907ad640 1 Processor -- start 2024-09-17T05:22:29.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.681+0000 7f39907ad640 1 -- start start 2024-09-17T05:22:29.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.682+0000 7f39907ad640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3970004d90 0x7f39881f1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:29.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.682+0000 7f39907ad640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39881583e0 0x7f398815df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:29.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.682+0000 7f39907ad640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f398815e440 0x7f398815e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:29.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.682+0000 7f39907ad640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f39880729a0 con 0x7f39881583e0 2024-09-17T05:22:29.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.682+0000 7f39907ad640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f39880b4eb0 con 0x7f3970004d90 2024-09-17T05:22:29.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.682+0000 7f39907ad640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f3988072b20 con 0x7f398815e440 2024-09-17T05:22:29.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.682+0000 7f398dd48640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39881583e0 0x7f398815df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:29.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.682+0000 7f398dd48640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39881583e0 0x7f398815df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56586/0 (socket says 172.21.15.98:56586) 2024-09-17T05:22:29.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.682+0000 7f398dd48640 1 -- 172.21.15.98:0/278380778 learned_addr learned my addr 172.21.15.98:0/278380778 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:29.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.682+0000 7f398e549640 1 --2- 172.21.15.98:0/278380778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3970004d90 0x7f39881f1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:29.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.682+0000 7f398ed4a640 1 --2- 172.21.15.98:0/278380778 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f398815e440 0x7f398815e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:29.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.682+0000 7f398dd48640 1 -- 172.21.15.98:0/278380778 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f398815e440 msgr2=0x7f398815e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:29.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.682+0000 7f398dd48640 1 --2- 172.21.15.98:0/278380778 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f398815e440 0x7f398815e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:29.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.683+0000 7f398dd48640 1 -- 172.21.15.98:0/278380778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3970004d90 msgr2=0x7f39881f1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:29.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.683+0000 7f398dd48640 1 --2- 172.21.15.98:0/278380778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3970004d90 0x7f39881f1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:29.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.683+0000 7f398dd48640 1 -- 172.21.15.98:0/278380778 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3988158880 con 0x7f39881583e0 2024-09-17T05:22:29.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.683+0000 7f398dd48640 1 --2- 172.21.15.98:0/278380778 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39881583e0 0x7f398815df00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f397c011ae0 tx=0x7f397c009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:29.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.683+0000 7f3986ffd640 1 -- 172.21.15.98:0/278380778 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f397c01e070 con 0x7f39881583e0 2024-09-17T05:22:29.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.683+0000 7f3986ffd640 1 -- 172.21.15.98:0/278380778 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f397c00fe70 con 0x7f39881583e0 2024-09-17T05:22:29.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.683+0000 7f39907ad640 1 -- 172.21.15.98:0/278380778 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f398815a9a0 con 0x7f39881583e0 2024-09-17T05:22:29.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.683+0000 7f3986ffd640 1 -- 172.21.15.98:0/278380778 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f397c004290 con 0x7f39881583e0 2024-09-17T05:22:29.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.683+0000 7f39907ad640 1 -- 172.21.15.98:0/278380778 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f398815af60 con 0x7f39881583e0 2024-09-17T05:22:29.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.684+0000 7f39907ad640 1 -- 172.21.15.98:0/278380778 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39880cebf0 con 0x7f39881583e0 2024-09-17T05:22:29.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.685+0000 7f3986ffd640 1 -- 172.21.15.98:0/278380778 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f397c021070 con 0x7f39881583e0 2024-09-17T05:22:29.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.685+0000 7f3986ffd640 1 --2- 172.21.15.98:0/278380778 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f3974078b90 0x7f397407b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:29.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.685+0000 7f3986ffd640 1 -- 172.21.15.98:0/278380778 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f397c09b360 con 0x7f39881583e0 2024-09-17T05:22:29.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.685+0000 7f398e549640 1 --2- 172.21.15.98:0/278380778 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f3974078b90 0x7f397407b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:29.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.686+0000 7f398e549640 1 --2- 172.21.15.98:0/278380778 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f3974078b90 0x7f397407b050 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3978002230 tx=0x7f3978006f50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:29.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.689+0000 7f3986ffd640 1 -- 172.21.15.98:0/278380778 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f397c063680 con 0x7f39881583e0 2024-09-17T05:22:29.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.868+0000 7f39907ad640 1 -- 172.21.15.98:0/278380778 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f3988070a20 con 0x7f39881583e0 2024-09-17T05:22:29.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.868+0000 7f3986ffd640 1 -- 172.21.15.98:0/278380778 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v28) ==== 84+0+65 (secure 0 0 0) 0x7f397c0680b0 con 0x7f39881583e0 2024-09-17T05:22:29.869 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:22:29.870 INFO:teuthology.orchestra.run.smithi098.stdout:[ 2024-09-17T05:22:29.870 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:22:29.870 INFO:teuthology.orchestra.run.smithi098.stdout: "poolnum": 1, 2024-09-17T05:22:29.870 INFO:teuthology.orchestra.run.smithi098.stdout: "poolname": ".mgr" 2024-09-17T05:22:29.870 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:22:29.870 INFO:teuthology.orchestra.run.smithi098.stdout:] 2024-09-17T05:22:29.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.870+0000 7f39907ad640 1 -- 172.21.15.98:0/278380778 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f3974078b90 msgr2=0x7f397407b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:29.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.870+0000 7f39907ad640 1 --2- 172.21.15.98:0/278380778 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f3974078b90 0x7f397407b050 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3978002230 tx=0x7f3978006f50 comp rx=0 tx=0).stop 2024-09-17T05:22:29.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.870+0000 7f39907ad640 1 -- 172.21.15.98:0/278380778 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39881583e0 msgr2=0x7f398815df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:29.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.870+0000 7f39907ad640 1 --2- 172.21.15.98:0/278380778 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39881583e0 0x7f398815df00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f397c011ae0 tx=0x7f397c009e90 comp rx=0 tx=0).stop 2024-09-17T05:22:29.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.870+0000 7f39907ad640 1 -- 172.21.15.98:0/278380778 shutdown_connections 2024-09-17T05:22:29.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.870+0000 7f39907ad640 1 --2- 172.21.15.98:0/278380778 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f3974078b90 0x7f397407b050 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:29.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.870+0000 7f39907ad640 1 --2- 172.21.15.98:0/278380778 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f398815e440 0x7f398815e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:29.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.870+0000 7f39907ad640 1 --2- 172.21.15.98:0/278380778 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39881583e0 0x7f398815df00 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:29.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.870+0000 7f39907ad640 1 --2- 172.21.15.98:0/278380778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3970004d90 0x7f39881f1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:29.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.870+0000 7f39907ad640 1 -- 172.21.15.98:0/278380778 >> 172.21.15.98:0/278380778 conn(0x7f39880b1950 msgr2=0x7f3988073710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:29.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.871+0000 7f39907ad640 1 -- 172.21.15.98:0/278380778 shutdown_connections 2024-09-17T05:22:29.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.871+0000 7f39907ad640 1 -- 172.21.15.98:0/278380778 wait complete. 2024-09-17T05:22:29.882 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T05:22:29.882 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T05:22:29.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.986+0000 7fb63ee33640 1 -- 172.21.15.98:0/3300892841 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb63815e340 msgr2=0x7fb6380d0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:29.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.986+0000 7fb63ee33640 1 --2- 172.21.15.98:0/3300892841 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb63815e340 0x7fb6380d0800 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb62c005fd0 tx=0x7fb62c02a670 comp rx=0 tx=0).stop 2024-09-17T05:22:29.988 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.986+0000 7fb63ee33640 1 -- 172.21.15.98:0/3300892841 shutdown_connections 2024-09-17T05:22:29.988 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.986+0000 7fb63ee33640 1 --2- 172.21.15.98:0/3300892841 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb6380cf670 0x7fb6380d0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:29.988 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.986+0000 7fb63ee33640 1 --2- 172.21.15.98:0/3300892841 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb63815e340 0x7fb6380d0800 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:29.988 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.986+0000 7fb63ee33640 1 -- 172.21.15.98:0/3300892841 >> 172.21.15.98:0/3300892841 conn(0x7fb6380d4050 msgr2=0x7fb6380d4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:29.988 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.986+0000 7fb63ee33640 1 -- 172.21.15.98:0/3300892841 shutdown_connections 2024-09-17T05:22:29.988 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.986+0000 7fb63ee33640 1 -- 172.21.15.98:0/3300892841 wait complete. 2024-09-17T05:22:29.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.987+0000 7fb63ee33640 1 Processor -- start 2024-09-17T05:22:29.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.987+0000 7fb63ee33640 1 -- start start 2024-09-17T05:22:29.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.988+0000 7fb63ee33640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6380d4b70 0x7fb638152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:29.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.988+0000 7fb63ee33640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb63815e340 0x7fb6380cce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:29.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.988+0000 7fb63ee33640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb6381f80d0 0x7fb6380cd810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:29.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.988+0000 7fb63ee33640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb6380d2590 con 0x7fb6381f80d0 2024-09-17T05:22:29.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.988+0000 7fb63ee33640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb6380d2410 con 0x7fb6380d4b70 2024-09-17T05:22:29.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.988+0000 7fb63ee33640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fb6380d2710 con 0x7fb63815e340 2024-09-17T05:22:29.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.988+0000 7fb63d3d0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb6381f80d0 0x7fb6380cd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:29.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.988+0000 7fb63d3d0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb6381f80d0 0x7fb6380cd810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56616/0 (socket says 172.21.15.98:56616) 2024-09-17T05:22:29.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.988+0000 7fb63d3d0640 1 -- 172.21.15.98:0/1214183885 learned_addr learned my addr 172.21.15.98:0/1214183885 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:29.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.989+0000 7fb63cbcf640 1 --2- 172.21.15.98:0/1214183885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6380d4b70 0x7fb638152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:29.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.989+0000 7fb637fff640 1 --2- 172.21.15.98:0/1214183885 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb63815e340 0x7fb6380cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:29.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.989+0000 7fb63d3d0640 1 -- 172.21.15.98:0/1214183885 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb63815e340 msgr2=0x7fb6380cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:29.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.989+0000 7fb63d3d0640 1 --2- 172.21.15.98:0/1214183885 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb63815e340 0x7fb6380cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:29.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.989+0000 7fb63d3d0640 1 -- 172.21.15.98:0/1214183885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6380d4b70 msgr2=0x7fb638152f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:29.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.989+0000 7fb63d3d0640 1 --2- 172.21.15.98:0/1214183885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6380d4b70 0x7fb638152f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:29.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.989+0000 7fb63d3d0640 1 -- 172.21.15.98:0/1214183885 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb638152d20 con 0x7fb6381f80d0 2024-09-17T05:22:29.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.989+0000 7fb63d3d0640 1 --2- 172.21.15.98:0/1214183885 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb6381f80d0 0x7fb6380cd810 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb63000c7a0 tx=0x7fb63000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:29.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.989+0000 7fb6357fa640 1 -- 172.21.15.98:0/1214183885 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb630003b70 con 0x7fb6381f80d0 2024-09-17T05:22:29.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.989+0000 7fb6357fa640 1 -- 172.21.15.98:0/1214183885 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb630003d30 con 0x7fb6381f80d0 2024-09-17T05:22:29.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.989+0000 7fb6357fa640 1 -- 172.21.15.98:0/1214183885 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb63000aab0 con 0x7fb6381f80d0 2024-09-17T05:22:29.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.989+0000 7fb63ee33640 1 -- 172.21.15.98:0/1214183885 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6380cd3b0 con 0x7fb6381f80d0 2024-09-17T05:22:29.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.989+0000 7fb63ee33640 1 -- 172.21.15.98:0/1214183885 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6381f8900 con 0x7fb6381f80d0 2024-09-17T05:22:29.993 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.990+0000 7fb63ee33640 1 -- 172.21.15.98:0/1214183885 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6380d1330 con 0x7fb6381f80d0 2024-09-17T05:22:29.993 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.991+0000 7fb6357fa640 1 -- 172.21.15.98:0/1214183885 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb63000ac50 con 0x7fb6381f80d0 2024-09-17T05:22:29.993 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.991+0000 7fb6357fa640 1 --2- 172.21.15.98:0/1214183885 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fb61c078b90 0x7fb61c07b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:29.993 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.991+0000 7fb6357fa640 1 -- 172.21.15.98:0/1214183885 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7fb63009a880 con 0x7fb6381f80d0 2024-09-17T05:22:29.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.991+0000 7fb63cbcf640 1 --2- 172.21.15.98:0/1214183885 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fb61c078b90 0x7fb61c07b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:29.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.992+0000 7fb63cbcf640 1 --2- 172.21.15.98:0/1214183885 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fb61c078b90 0x7fb61c07b050 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb62c033000 tx=0x7fb62c004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:29.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:29.995+0000 7fb6357fa640 1 -- 172.21.15.98:0/1214183885 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fb6380d1330 con 0x7fb6381f80d0 2024-09-17T05:22:30.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:30.170+0000 7fb63ee33640 1 -- 172.21.15.98:0/1214183885 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fb6380d2ca0 con 0x7fb6381f80d0 2024-09-17T05:22:31.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:31.089+0000 7fb6357fa640 1 -- 172.21.15.98:0/1214183885 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v29) ==== 138+0+0 (secure 0 0 0) 0x7fb6300630a0 con 0x7fb6381f80d0 2024-09-17T05:22:31.091 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_metadata' created 2024-09-17T05:22:31.093 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:31.092+0000 7fb63ee33640 1 -- 172.21.15.98:0/1214183885 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fb61c078b90 msgr2=0x7fb61c07b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:31.093 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:31.092+0000 7fb63ee33640 1 --2- 172.21.15.98:0/1214183885 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fb61c078b90 0x7fb61c07b050 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb62c033000 tx=0x7fb62c004730 comp rx=0 tx=0).stop 2024-09-17T05:22:31.093 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:31.092+0000 7fb63ee33640 1 -- 172.21.15.98:0/1214183885 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb6381f80d0 msgr2=0x7fb6380cd810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:31.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:31.092+0000 7fb63ee33640 1 --2- 172.21.15.98:0/1214183885 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb6381f80d0 0x7fb6380cd810 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb63000c7a0 tx=0x7fb63000cc60 comp rx=0 tx=0).stop 2024-09-17T05:22:31.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:31.092+0000 7fb63ee33640 1 -- 172.21.15.98:0/1214183885 shutdown_connections 2024-09-17T05:22:31.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:31.092+0000 7fb63ee33640 1 --2- 172.21.15.98:0/1214183885 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fb61c078b90 0x7fb61c07b050 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:31.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:31.092+0000 7fb63ee33640 1 --2- 172.21.15.98:0/1214183885 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb6381f80d0 0x7fb6380cd810 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:31.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:31.092+0000 7fb63ee33640 1 --2- 172.21.15.98:0/1214183885 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb63815e340 0x7fb6380cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:31.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:31.092+0000 7fb63ee33640 1 --2- 172.21.15.98:0/1214183885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6380d4b70 0x7fb638152f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:31.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:31.092+0000 7fb63ee33640 1 -- 172.21.15.98:0/1214183885 >> 172.21.15.98:0/1214183885 conn(0x7fb6380d4050 msgr2=0x7fb63806ead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:31.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:31.092+0000 7fb63ee33640 1 -- 172.21.15.98:0/1214183885 shutdown_connections 2024-09-17T05:22:31.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:31.092+0000 7fb63ee33640 1 -- 172.21.15.98:0/1214183885 wait complete. 2024-09-17T05:22:31.109 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T05:22:31.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:31.220+0000 7fda1cdf3640 1 -- 172.21.15.98:0/696754235 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda18145750 msgr2=0x7fda18073440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:31.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:31.220+0000 7fda1cdf3640 1 --2- 172.21.15.98:0/696754235 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda18145750 0x7fda18073440 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fda180af750 tx=0x7fda0802aa30 comp rx=0 tx=0).stop 2024-09-17T05:22:31.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:31.220+0000 7fda1cdf3640 1 -- 172.21.15.98:0/696754235 shutdown_connections 2024-09-17T05:22:31.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:31.220+0000 7fda1cdf3640 1 --2- 172.21.15.98:0/696754235 >> v2:172.21.15.167:3300/0 conn(0x7fda1806efa0 0x7fda180cc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:31.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:31.220+0000 7fda1cdf3640 1 --2- 172.21.15.98:0/696754235 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda18145750 0x7fda18073440 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:31.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:31.220+0000 7fda1cdf3640 1 -- 172.21.15.98:0/696754235 >> 172.21.15.98:0/696754235 conn(0x7fda180b1840 msgr2=0x7fda180b1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:31.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:31.220+0000 7fda1cdf3640 1 -- 172.21.15.98:0/696754235 shutdown_connections 2024-09-17T05:22:31.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:31.220+0000 7fda1cdf3640 1 -- 172.21.15.98:0/696754235 wait complete. 2024-09-17T05:22:31.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:31.221+0000 7fda1cdf3640 1 Processor -- start 2024-09-17T05:22:31.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:31.221+0000 7fda1cdf3640 1 -- start start 2024-09-17T05:22:31.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:31.222+0000 7fda1cdf3640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda1806efa0 0x7fda181e7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:31.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:31.222+0000 7fda1cdf3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda180ccb00 0x7fda181f2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:31.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:31.222+0000 7fda1cdf3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda18145750 0x7fda181e6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:31.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:31.222+0000 7fda1cdf3640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fda180ced40 con 0x7fda180ccb00 2024-09-17T05:22:31.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:31.222+0000 7fda1cdf3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fda180cebc0 con 0x7fda18145750 2024-09-17T05:22:31.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:31.222+0000 7fda1cdf3640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fda180ceec0 con 0x7fda1806efa0 2024-09-17T05:22:31.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:31.222+0000 7fda15d9b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda180ccb00 0x7fda181f2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:31.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:31.222+0000 7fda15d9b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda180ccb00 0x7fda181f2980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56646/0 (socket says 172.21.15.98:56646) 2024-09-17T05:22:31.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:31.222+0000 7fda15d9b640 1 -- 172.21.15.98:0/4163308609 learned_addr learned my addr 172.21.15.98:0/4163308609 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:31.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:31.222+0000 7fda1659c640 1 --2- 172.21.15.98:0/4163308609 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda1806efa0 0x7fda181e7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:31.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:31.222+0000 7fda16d9d640 1 --2- 172.21.15.98:0/4163308609 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda18145750 0x7fda181e6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:31.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:31.222+0000 7fda15d9b640 1 -- 172.21.15.98:0/4163308609 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda1806efa0 msgr2=0x7fda181e7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:31.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:31.222+0000 7fda15d9b640 1 --2- 172.21.15.98:0/4163308609 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda1806efa0 0x7fda181e7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:31.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:31.222+0000 7fda15d9b640 1 -- 172.21.15.98:0/4163308609 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda18145750 msgr2=0x7fda181e6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:31.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:31.222+0000 7fda15d9b640 1 --2- 172.21.15.98:0/4163308609 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda18145750 0x7fda181e6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:31.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:31.222+0000 7fda15d9b640 1 -- 172.21.15.98:0/4163308609 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda181e52d0 con 0x7fda180ccb00 2024-09-17T05:22:31.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:31.222+0000 7fda1659c640 1 --2- 172.21.15.98:0/4163308609 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda1806efa0 0x7fda181e7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:22:31.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:31.222+0000 7fda16d9d640 1 --2- 172.21.15.98:0/4163308609 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda18145750 0x7fda181e6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:22:31.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:31.223+0000 7fda15d9b640 1 --2- 172.21.15.98:0/4163308609 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda180ccb00 0x7fda181f2980 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fda0000b4a0 tx=0x7fda0000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:31.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:31.223+0000 7fda0effd640 1 -- 172.21.15.98:0/4163308609 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda00014070 con 0x7fda180ccb00 2024-09-17T05:22:31.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:31.223+0000 7fda0effd640 1 -- 172.21.15.98:0/4163308609 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fda00010700 con 0x7fda180ccb00 2024-09-17T05:22:31.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:31.223+0000 7fda0effd640 1 -- 172.21.15.98:0/4163308609 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda00010b50 con 0x7fda180ccb00 2024-09-17T05:22:31.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:31.223+0000 7fda1cdf3640 1 -- 172.21.15.98:0/4163308609 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda181e55b0 con 0x7fda180ccb00 2024-09-17T05:22:31.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:31.223+0000 7fda1cdf3640 1 -- 172.21.15.98:0/4163308609 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda181e5b70 con 0x7fda180ccb00 2024-09-17T05:22:31.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:31.224+0000 7fda1cdf3640 1 -- 172.21.15.98:0/4163308609 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda180cc5c0 con 0x7fda180ccb00 2024-09-17T05:22:31.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:31.224+0000 7fda0effd640 1 -- 172.21.15.98:0/4163308609 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fda00017070 con 0x7fda180ccb00 2024-09-17T05:22:31.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:31.225+0000 7fda0effd640 1 --2- 172.21.15.98:0/4163308609 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fd9f8078b90 0x7fd9f807b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:31.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:31.225+0000 7fda0effd640 1 -- 172.21.15.98:0/4163308609 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5227+0+0 (secure 0 0 0) 0x7fda0009a590 con 0x7fda180ccb00 2024-09-17T05:22:31.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:31.225+0000 7fda1659c640 1 --2- 172.21.15.98:0/4163308609 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fd9f8078b90 0x7fd9f807b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:31.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:31.226+0000 7fda1659c640 1 --2- 172.21.15.98:0/4163308609 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fd9f8078b90 0x7fd9f807b050 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fda08035000 tx=0x7fda08004ab0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:31.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:31.229+0000 7fda0effd640 1 -- 172.21.15.98:0/4163308609 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fda00062c40 con 0x7fda180ccb00 2024-09-17T05:22:31.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:31.406+0000 7fda1cdf3640 1 -- 172.21.15.98:0/4163308609 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fda180b0660 con 0x7fda180ccb00 2024-09-17T05:22:32.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:32.094+0000 7fda0effd640 1 -- 172.21.15.98:0/4163308609 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v30) ==== 170+0+0 (secure 0 0 0) 0x7fda00062540 con 0x7fda180ccb00 2024-09-17T05:22:32.095 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_data' created 2024-09-17T05:22:32.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:32.097+0000 7fda1cdf3640 1 -- 172.21.15.98:0/4163308609 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fd9f8078b90 msgr2=0x7fd9f807b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:32.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:32.097+0000 7fda1cdf3640 1 --2- 172.21.15.98:0/4163308609 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fd9f8078b90 0x7fd9f807b050 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fda08035000 tx=0x7fda08004ab0 comp rx=0 tx=0).stop 2024-09-17T05:22:32.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:32.097+0000 7fda1cdf3640 1 -- 172.21.15.98:0/4163308609 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda180ccb00 msgr2=0x7fda181f2980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:32.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:32.097+0000 7fda1cdf3640 1 --2- 172.21.15.98:0/4163308609 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda180ccb00 0x7fda181f2980 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fda0000b4a0 tx=0x7fda0000b960 comp rx=0 tx=0).stop 2024-09-17T05:22:32.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:32.097+0000 7fda1cdf3640 1 -- 172.21.15.98:0/4163308609 shutdown_connections 2024-09-17T05:22:32.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:32.097+0000 7fda1cdf3640 1 --2- 172.21.15.98:0/4163308609 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fd9f8078b90 0x7fd9f807b050 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:32.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:32.097+0000 7fda1cdf3640 1 --2- 172.21.15.98:0/4163308609 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda18145750 0x7fda181e6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:32.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:32.097+0000 7fda1cdf3640 1 --2- 172.21.15.98:0/4163308609 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda180ccb00 0x7fda181f2980 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:32.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:32.098+0000 7fda1cdf3640 1 --2- 172.21.15.98:0/4163308609 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda1806efa0 0x7fda181e7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:32.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:32.098+0000 7fda1cdf3640 1 -- 172.21.15.98:0/4163308609 >> 172.21.15.98:0/4163308609 conn(0x7fda180b1840 msgr2=0x7fda1806f410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:32.100 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:32.099+0000 7fda1cdf3640 1 -- 172.21.15.98:0/4163308609 shutdown_connections 2024-09-17T05:22:32.100 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:32.100+0000 7fda1cdf3640 1 -- 172.21.15.98:0/4163308609 wait complete. 2024-09-17T05:22:32.122 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T05:22:32.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:32.225+0000 7f004f416640 1 -- 172.21.15.98:0/3874838664 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0048151cb0 msgr2=0x7f00480b37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:32.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:32.225+0000 7f004f416640 1 --2- 172.21.15.98:0/3874838664 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0048151cb0 0x7f00480b37d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0040009830 tx=0x7f004002a510 comp rx=0 tx=0).stop 2024-09-17T05:22:32.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:32.225+0000 7f004f416640 1 -- 172.21.15.98:0/3874838664 shutdown_connections 2024-09-17T05:22:32.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:32.225+0000 7f004f416640 1 --2- 172.21.15.98:0/3874838664 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0048151cb0 0x7f00480b37d0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:32.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:32.226+0000 7f004f416640 1 -- 172.21.15.98:0/3874838664 >> 172.21.15.98:0/3874838664 conn(0x7f00480b2130 msgr2=0x7f00480b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:32.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:32.226+0000 7f004f416640 1 -- 172.21.15.98:0/3874838664 shutdown_connections 2024-09-17T05:22:32.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:32.226+0000 7f004f416640 1 -- 172.21.15.98:0/3874838664 wait complete. 2024-09-17T05:22:32.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:32.227+0000 7f004f416640 1 Processor -- start 2024-09-17T05:22:32.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:32.227+0000 7f004f416640 1 -- start start 2024-09-17T05:22:32.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:32.227+0000 7f004f416640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0048073740 0x7f004806cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:32.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:32.227+0000 7f004f416640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00480b3d10 0x7f004806d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:32.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:32.227+0000 7f004f416640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0048151cb0 0x7f0048153330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:32.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:32.227+0000 7f004f416640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f004806fe00 con 0x7f0048151cb0 2024-09-17T05:22:32.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:32.227+0000 7f004f416640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f004806fc80 con 0x7f0048073740 2024-09-17T05:22:32.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:32.227+0000 7f004f416640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f004806ff80 con 0x7f00480b3d10 2024-09-17T05:22:32.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:32.228+0000 7f004d9b3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0048151cb0 0x7f0048153330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:32.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:32.228+0000 7f004d9b3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0048151cb0 0x7f0048153330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56664/0 (socket says 172.21.15.98:56664) 2024-09-17T05:22:32.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:32.228+0000 7f004d9b3640 1 -- 172.21.15.98:0/1833593607 learned_addr learned my addr 172.21.15.98:0/1833593607 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:32.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:32.228+0000 7f004d1b2640 1 --2- 172.21.15.98:0/1833593607 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0048073740 0x7f004806cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:32.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:32.228+0000 7f004c9b1640 1 --2- 172.21.15.98:0/1833593607 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00480b3d10 0x7f004806d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:32.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:32.228+0000 7f004d9b3640 1 -- 172.21.15.98:0/1833593607 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00480b3d10 msgr2=0x7f004806d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:32.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:32.228+0000 7f004d9b3640 1 --2- 172.21.15.98:0/1833593607 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00480b3d10 0x7f004806d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:32.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:32.228+0000 7f004d9b3640 1 -- 172.21.15.98:0/1833593607 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0048073740 msgr2=0x7f004806cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:32.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:32.228+0000 7f004d9b3640 1 --2- 172.21.15.98:0/1833593607 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0048073740 0x7f004806cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:32.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:32.228+0000 7f004d9b3640 1 -- 172.21.15.98:0/1833593607 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00481e63d0 con 0x7f0048151cb0 2024-09-17T05:22:32.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:32.228+0000 7f004c9b1640 1 --2- 172.21.15.98:0/1833593607 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00480b3d10 0x7f004806d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:22:32.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:32.228+0000 7f004d1b2640 1 --2- 172.21.15.98:0/1833593607 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0048073740 0x7f004806cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:22:32.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:32.228+0000 7f004d9b3640 1 --2- 172.21.15.98:0/1833593607 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0048151cb0 0x7f0048153330 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f003800c780 tx=0x7f003800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:32.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:32.228+0000 7f0045ffb640 1 -- 172.21.15.98:0/1833593607 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0038004b60 con 0x7f0048151cb0 2024-09-17T05:22:32.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:32.228+0000 7f0045ffb640 1 -- 172.21.15.98:0/1833593607 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0038004df0 con 0x7f0048151cb0 2024-09-17T05:22:32.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:32.228+0000 7f0045ffb640 1 -- 172.21.15.98:0/1833593607 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f003800aa70 con 0x7f0048151cb0 2024-09-17T05:22:32.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:32.228+0000 7f004f416640 1 -- 172.21.15.98:0/1833593607 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0048154f50 con 0x7f0048151cb0 2024-09-17T05:22:32.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:32.228+0000 7f004f416640 1 -- 172.21.15.98:0/1833593607 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00481e6920 con 0x7f0048151cb0 2024-09-17T05:22:32.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:32.229+0000 7f004f416640 1 -- 172.21.15.98:0/1833593607 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0048070450 con 0x7f0048151cb0 2024-09-17T05:22:32.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:32.230+0000 7f0045ffb640 1 -- 172.21.15.98:0/1833593607 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f003800ac10 con 0x7f0048151cb0 2024-09-17T05:22:32.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:32.231+0000 7f0045ffb640 1 --2- 172.21.15.98:0/1833593607 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f0034078bc0 0x7f003407b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:32.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:32.231+0000 7f0045ffb640 1 -- 172.21.15.98:0/1833593607 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5609+0+0 (secure 0 0 0) 0x7f003809af20 con 0x7f0048151cb0 2024-09-17T05:22:32.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:32.231+0000 7f004d1b2640 1 --2- 172.21.15.98:0/1833593607 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f0034078bc0 0x7f003407b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:32.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:32.231+0000 7f004d1b2640 1 --2- 172.21.15.98:0/1833593607 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f0034078bc0 0x7f003407b080 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0040034000 tx=0x7f0040004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:32.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:32.235+0000 7f0045ffb640 1 -- 172.21.15.98:0/1833593607 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f0038020070 con 0x7f0048151cb0 2024-09-17T05:22:32.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:32.447+0000 7f004f416640 1 -- 172.21.15.98:0/1833593607 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f00481e5700 con 0x7f0048151cb0 2024-09-17T05:22:33.109 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.107+0000 7f0045ffb640 1 -- 172.21.15.98:0/1833593607 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) ==== 172+0+0 (secure 0 0 0) 0x7f0038063450 con 0x7f0048151cb0 2024-09-17T05:22:33.109 INFO:teuthology.orchestra.run.smithi098.stderr:new fs with metadata pool 4 and data pool 5 2024-09-17T05:22:33.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.114+0000 7f004f416640 1 -- 172.21.15.98:0/1833593607 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f0034078bc0 msgr2=0x7f003407b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:33.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.114+0000 7f004f416640 1 --2- 172.21.15.98:0/1833593607 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f0034078bc0 0x7f003407b080 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0040034000 tx=0x7f0040004730 comp rx=0 tx=0).stop 2024-09-17T05:22:33.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.114+0000 7f004f416640 1 -- 172.21.15.98:0/1833593607 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0048151cb0 msgr2=0x7f0048153330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:33.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.114+0000 7f004f416640 1 --2- 172.21.15.98:0/1833593607 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0048151cb0 0x7f0048153330 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f003800c780 tx=0x7f003800cc40 comp rx=0 tx=0).stop 2024-09-17T05:22:33.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.114+0000 7f004f416640 1 -- 172.21.15.98:0/1833593607 shutdown_connections 2024-09-17T05:22:33.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.114+0000 7f004f416640 1 --2- 172.21.15.98:0/1833593607 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f0034078bc0 0x7f003407b080 secure :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0040034000 tx=0x7f0040004730 comp rx=0 tx=0).stop 2024-09-17T05:22:33.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.114+0000 7f004f416640 1 --2- 172.21.15.98:0/1833593607 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0048151cb0 0x7f0048153330 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:33.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.115+0000 7f004f416640 1 --2- 172.21.15.98:0/1833593607 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00480b3d10 0x7f004806d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:33.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.115+0000 7f004f416640 1 --2- 172.21.15.98:0/1833593607 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0048073740 0x7f004806cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:33.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.115+0000 7f004f416640 1 -- 172.21.15.98:0/1833593607 >> 172.21.15.98:0/1833593607 conn(0x7f00480b2130 msgr2=0x7f00480b2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:33.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.115+0000 7f004f416640 1 -- 172.21.15.98:0/1833593607 shutdown_connections 2024-09-17T05:22:33.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.116+0000 7f004f416640 1 -- 172.21.15.98:0/1833593607 wait complete. 2024-09-17T05:22:33.137 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:22:33.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.238+0000 7fce4c09b640 1 -- 172.21.15.98:0/366147847 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce440d29d0 msgr2=0x7fce440cf270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:33.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.238+0000 7fce4c09b640 1 --2- 172.21.15.98:0/366147847 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce440d29d0 0x7fce440cf270 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fce34005fd0 tx=0x7fce3402a4a0 comp rx=0 tx=0).stop 2024-09-17T05:22:33.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.238+0000 7fce4c09b640 1 -- 172.21.15.98:0/366147847 shutdown_connections 2024-09-17T05:22:33.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.238+0000 7fce4c09b640 1 --2- 172.21.15.98:0/366147847 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fce440b1e60 0x7fce440b22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:33.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.238+0000 7fce4c09b640 1 --2- 172.21.15.98:0/366147847 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce440d29d0 0x7fce440cf270 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:33.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.238+0000 7fce4c09b640 1 -- 172.21.15.98:0/366147847 >> 172.21.15.98:0/366147847 conn(0x7fce440d1eb0 msgr2=0x7fce440d22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:33.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.238+0000 7fce4c09b640 1 -- 172.21.15.98:0/366147847 shutdown_connections 2024-09-17T05:22:33.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.238+0000 7fce4c09b640 1 -- 172.21.15.98:0/366147847 wait complete. 2024-09-17T05:22:33.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.239+0000 7fce4c09b640 1 Processor -- start 2024-09-17T05:22:33.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.239+0000 7fce4c09b640 1 -- start start 2024-09-17T05:22:33.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.240+0000 7fce4c09b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fce440b1e60 0x7fce44151210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:33.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.240+0000 7fce4c09b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce440ce780 0x7fce4415dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:33.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.240+0000 7fce4c09b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce440d29d0 0x7fce4415ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:33.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.240+0000 7fce4c09b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fce440b2830 con 0x7fce440d29d0 2024-09-17T05:22:33.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.240+0000 7fce4c09b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fce4415c4d0 con 0x7fce440ce780 2024-09-17T05:22:33.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.240+0000 7fce4c09b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fce440b29b0 con 0x7fce440b1e60 2024-09-17T05:22:33.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.240+0000 7fce4a638640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce440d29d0 0x7fce4415ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:33.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.240+0000 7fce4a638640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce440d29d0 0x7fce4415ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56686/0 (socket says 172.21.15.98:56686) 2024-09-17T05:22:33.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.240+0000 7fce4a638640 1 -- 172.21.15.98:0/2368684843 learned_addr learned my addr 172.21.15.98:0/2368684843 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:33.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.240+0000 7fce49e37640 1 --2- 172.21.15.98:0/2368684843 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fce440b1e60 0x7fce44151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:33.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.240+0000 7fce49636640 1 --2- 172.21.15.98:0/2368684843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce440ce780 0x7fce4415dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:33.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.240+0000 7fce4a638640 1 -- 172.21.15.98:0/2368684843 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fce440b1e60 msgr2=0x7fce44151210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:33.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.240+0000 7fce4a638640 1 --2- 172.21.15.98:0/2368684843 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fce440b1e60 0x7fce44151210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:33.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.240+0000 7fce4a638640 1 -- 172.21.15.98:0/2368684843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce440ce780 msgr2=0x7fce4415dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:33.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.240+0000 7fce4a638640 1 --2- 172.21.15.98:0/2368684843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce440ce780 0x7fce4415dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:33.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.240+0000 7fce4a638640 1 -- 172.21.15.98:0/2368684843 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce44151750 con 0x7fce440d29d0 2024-09-17T05:22:33.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.240+0000 7fce4a638640 1 --2- 172.21.15.98:0/2368684843 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce440d29d0 0x7fce4415ebc0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fce3c00cb00 tx=0x7fce3c00a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:33.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.240+0000 7fce3a7fc640 1 -- 172.21.15.98:0/2368684843 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce3c004b20 con 0x7fce440d29d0 2024-09-17T05:22:33.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.240+0000 7fce3a7fc640 1 -- 172.21.15.98:0/2368684843 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce3c004db0 con 0x7fce440d29d0 2024-09-17T05:22:33.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.240+0000 7fce4c09b640 1 -- 172.21.15.98:0/2368684843 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce4415ca20 con 0x7fce440d29d0 2024-09-17T05:22:33.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.240+0000 7fce3a7fc640 1 -- 172.21.15.98:0/2368684843 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce3c005280 con 0x7fce440d29d0 2024-09-17T05:22:33.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.240+0000 7fce4c09b640 1 -- 172.21.15.98:0/2368684843 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce4415cfe0 con 0x7fce440d29d0 2024-09-17T05:22:33.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.241+0000 7fce4c09b640 1 -- 172.21.15.98:0/2368684843 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce440b2f60 con 0x7fce440d29d0 2024-09-17T05:22:33.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.242+0000 7fce3a7fc640 1 -- 172.21.15.98:0/2368684843 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fce3c005420 con 0x7fce440d29d0 2024-09-17T05:22:33.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.242+0000 7fce3a7fc640 1 --2- 172.21.15.98:0/2368684843 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fce28078bc0 0x7fce2807b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:33.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.243+0000 7fce3a7fc640 1 -- 172.21.15.98:0/2368684843 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fce3c09b350 con 0x7fce440d29d0 2024-09-17T05:22:33.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.243+0000 7fce49e37640 1 --2- 172.21.15.98:0/2368684843 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fce28078bc0 0x7fce2807b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:33.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.243+0000 7fce49e37640 1 --2- 172.21.15.98:0/2368684843 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fce28078bc0 0x7fce2807b080 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fce40004f60 tx=0x7fce40007e30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:33.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.247+0000 7fce3a7fc640 1 -- 172.21.15.98:0/2368684843 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fce3c014030 con 0x7fce440d29d0 2024-09-17T05:22:33.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.423+0000 7fce4c09b640 1 -- 172.21.15.98:0/2368684843 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fce44159ed0 con 0x7fce440d29d0 2024-09-17T05:22:33.425 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.424+0000 7fce3a7fc640 1 -- 172.21.15.98:0/2368684843 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16730 (secure 0 0 0) 0x7fce3c068e20 con 0x7fce440d29d0 2024-09-17T05:22:33.425 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:22:33.425 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":31,"fsid":"fcbf5a43-b3d8-497c-b15d-3cc022477cf0","created":"2024-09-17T05:21:29.852143+0000","modified":"2024-09-17T05:22:32.448888+0000","last_up_change":"2024-09-17T05:21:42.925756+0000","last_in_change":"2024-09-17T05:21:32.893880+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:21:42.263011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:22:30.174068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-17T05:22:31.410605+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ad711a-df74-438b-b0dc-1499d685c958","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6825","nonce":3644101529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6827","nonce":3644101529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6831","nonce":3644101529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6829","nonce":3644101529}]},"public_addr":"172.21.15.98:6825/3644101529","cluster_addr":"172.21.15.98:6827/3644101529","heartbeat_back_addr":"172.21.15.98:6831/3644101529","heartbeat_front_addr":"172.21.15.98:6829/3644101529","state":["exists","up"]},{"osd":1,"uuid":"f0ccb08d-4d8d-47b8-9320-8c372a6605b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6817","nonce":3902180920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6819","nonce":3902180920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6823","nonce":3902180920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6821","nonce":3902180920}]},"public_addr":"172.21.15.98:6817/3902180920","cluster_addr":"172.21.15.98:6819/3902180920","heartbeat_back_addr":"172.21.15.98:6823/3902180920","heartbeat_front_addr":"172.21.15.98:6821/3902180920","state":["exists","up"]},{"osd":2,"uuid":"a0985398-5e5f-494f-8abf-f785f19e94ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6801","nonce":1518887101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6803","nonce":1518887101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6807","nonce":1518887101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6805","nonce":1518887101}]},"public_addr":"172.21.15.98:6801/1518887101","cluster_addr":"172.21.15.98:6803/1518887101","heartbeat_back_addr":"172.21.15.98:6807/1518887101","heartbeat_front_addr":"172.21.15.98:6805/1518887101","state":["exists","up"]},{"osd":3,"uuid":"e960be2e-0c3a-426e-9507-d3be5895f9e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6809","nonce":4125246091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6811","nonce":4125246091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6815","nonce":4125246091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6813","nonce":4125246091}]},"public_addr":"172.21.15.98:6809/4125246091","cluster_addr":"172.21.15.98:6811/4125246091","heartbeat_back_addr":"172.21.15.98:6815/4125246091","heartbeat_front_addr":"172.21.15.98:6813/4125246091","state":["exists","up"]},{"osd":4,"uuid":"49118c00-3dc1-43ef-8ed4-aca61e56a507","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6811","nonce":765789888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6813","nonce":765789888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6817","nonce":765789888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6815","nonce":765789888}]},"public_addr":"172.21.15.167:6811/765789888","cluster_addr":"172.21.15.167:6813/765789888","heartbeat_back_addr":"172.21.15.167:6817/765789888","heartbeat_front_addr":"172.21.15.167:6815/765789888","state":["exists","up"]},{"osd":5,"uuid":"9f4e0143-2b3d-40e4-bfb5-043d9a9f4ba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6803","nonce":2567019914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6805","nonce":2567019914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6809","nonce":2567019914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6807","nonce":2567019914}]},"public_addr":"172.21.15.167:6803/2567019914","cluster_addr":"172.21.15.167:6805/2567019914","heartbeat_back_addr":"172.21.15.167:6809/2567019914","heartbeat_front_addr":"172.21.15.167:6807/2567019914","state":["exists","up"]},{"osd":6,"uuid":"28720514-e627-4dea-8f4d-bd311ec31361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6819","nonce":96262631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6821","nonce":96262631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6825","nonce":96262631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6823","nonce":96262631}]},"public_addr":"172.21.15.167:6819/96262631","cluster_addr":"172.21.15.167:6821/96262631","heartbeat_back_addr":"172.21.15.167:6825/96262631","heartbeat_front_addr":"172.21.15.167:6823/96262631","state":["exists","up"]},{"osd":7,"uuid":"01edaf9c-3898-406e-85b0-774cfda60adf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6827","nonce":4169560909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6829","nonce":4169560909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6833","nonce":4169560909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6831","nonce":4169560909}]},"public_addr":"172.21.15.167:6827/4169560909","cluster_addr":"172.21.15.167:6829/4169560909","heartbeat_back_addr":"172.21.15.167:6833/4169560909","heartbeat_front_addr":"172.21.15.167:6831/4169560909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:40.054920+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.177110+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.749278+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.400155+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.503576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.196417+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.371063+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.212852+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:22:33.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.426+0000 7fce4c09b640 1 -- 172.21.15.98:0/2368684843 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fce28078bc0 msgr2=0x7fce2807b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:33.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.426+0000 7fce4c09b640 1 --2- 172.21.15.98:0/2368684843 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fce28078bc0 0x7fce2807b080 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fce40004f60 tx=0x7fce40007e30 comp rx=0 tx=0).stop 2024-09-17T05:22:33.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.427+0000 7fce4c09b640 1 -- 172.21.15.98:0/2368684843 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce440d29d0 msgr2=0x7fce4415ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:33.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.427+0000 7fce4c09b640 1 --2- 172.21.15.98:0/2368684843 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce440d29d0 0x7fce4415ebc0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fce3c00cb00 tx=0x7fce3c00a250 comp rx=0 tx=0).stop 2024-09-17T05:22:33.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.427+0000 7fce4c09b640 1 -- 172.21.15.98:0/2368684843 shutdown_connections 2024-09-17T05:22:33.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.427+0000 7fce4c09b640 1 --2- 172.21.15.98:0/2368684843 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fce28078bc0 0x7fce2807b080 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:33.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.427+0000 7fce4c09b640 1 --2- 172.21.15.98:0/2368684843 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce440d29d0 0x7fce4415ebc0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:33.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.427+0000 7fce4c09b640 1 --2- 172.21.15.98:0/2368684843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce440ce780 0x7fce4415dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:33.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.427+0000 7fce4c09b640 1 --2- 172.21.15.98:0/2368684843 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fce440b1e60 0x7fce44151210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:33.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.427+0000 7fce4c09b640 1 -- 172.21.15.98:0/2368684843 >> 172.21.15.98:0/2368684843 conn(0x7fce440d1eb0 msgr2=0x7fce440aeb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:33.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.427+0000 7fce4c09b640 1 -- 172.21.15.98:0/2368684843 shutdown_connections 2024-09-17T05:22:33.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.427+0000 7fce4c09b640 1 -- 172.21.15.98:0/2368684843 wait complete. 2024-09-17T05:22:33.439 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:22:33.541 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.540+0000 7fde87f2b640 1 -- 172.21.15.98:0/2864435460 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde801445d0 msgr2=0x7fde800cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:33.541 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.540+0000 7fde87f2b640 1 --2- 172.21.15.98:0/2864435460 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde801445d0 0x7fde800cebf0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fde7c009830 tx=0x7fde7c02a5a0 comp rx=0 tx=0).stop 2024-09-17T05:22:33.541 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.540+0000 7fde87f2b640 1 -- 172.21.15.98:0/2864435460 shutdown_connections 2024-09-17T05:22:33.541 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.540+0000 7fde87f2b640 1 --2- 172.21.15.98:0/2864435460 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde800b4ca0 0x7fde800cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:33.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.540+0000 7fde87f2b640 1 --2- 172.21.15.98:0/2864435460 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde801445d0 0x7fde800cebf0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:33.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.540+0000 7fde87f2b640 1 -- 172.21.15.98:0/2864435460 >> 172.21.15.98:0/2864435460 conn(0x7fde800b1950 msgr2=0x7fde800b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:33.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.540+0000 7fde87f2b640 1 -- 172.21.15.98:0/2864435460 shutdown_connections 2024-09-17T05:22:33.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.540+0000 7fde87f2b640 1 -- 172.21.15.98:0/2864435460 wait complete. 2024-09-17T05:22:33.544 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.541+0000 7fde87f2b640 1 Processor -- start 2024-09-17T05:22:33.544 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.541+0000 7fde87f2b640 1 -- start start 2024-09-17T05:22:33.544 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.542+0000 7fde87f2b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde800b4ca0 0x7fde8006fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:33.544 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.542+0000 7fde87f2b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde800ccfd0 0x7fde801e8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:33.544 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.542+0000 7fde87f2b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde801445d0 0x7fde801e9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:33.544 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.542+0000 7fde87f2b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fde8015f080 con 0x7fde800b4ca0 2024-09-17T05:22:33.544 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.542+0000 7fde87f2b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fde80073bc0 con 0x7fde800ccfd0 2024-09-17T05:22:33.545 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.542+0000 7fde87f2b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fde8015f200 con 0x7fde801445d0 2024-09-17T05:22:33.545 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.542+0000 7fde85cc7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde800b4ca0 0x7fde8006fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:33.545 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.542+0000 7fde85cc7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde800b4ca0 0x7fde8006fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56702/0 (socket says 172.21.15.98:56702) 2024-09-17T05:22:33.545 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.542+0000 7fde85cc7640 1 -- 172.21.15.98:0/3372608171 learned_addr learned my addr 172.21.15.98:0/3372608171 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:33.545 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.542+0000 7fde85cc7640 1 -- 172.21.15.98:0/3372608171 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde801445d0 msgr2=0x7fde801e9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:33.545 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.542+0000 7fde85cc7640 1 --2- 172.21.15.98:0/3372608171 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde801445d0 0x7fde801e9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:33.545 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.542+0000 7fde85cc7640 1 -- 172.21.15.98:0/3372608171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde800ccfd0 msgr2=0x7fde801e8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:33.546 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.542+0000 7fde85cc7640 1 --2- 172.21.15.98:0/3372608171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde800ccfd0 0x7fde801e8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:33.546 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.542+0000 7fde85cc7640 1 -- 172.21.15.98:0/3372608171 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde800703d0 con 0x7fde800b4ca0 2024-09-17T05:22:33.546 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.542+0000 7fde85cc7640 1 --2- 172.21.15.98:0/3372608171 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde800b4ca0 0x7fde8006fba0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fde7c009950 tx=0x7fde7c033ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:33.546 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.542+0000 7fde767fc640 1 -- 172.21.15.98:0/3372608171 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde7c031d60 con 0x7fde800b4ca0 2024-09-17T05:22:33.546 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.543+0000 7fde767fc640 1 -- 172.21.15.98:0/3372608171 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fde7c005020 con 0x7fde800b4ca0 2024-09-17T05:22:33.546 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.543+0000 7fde87f2b640 1 -- 172.21.15.98:0/3372608171 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde8015d1a0 con 0x7fde800b4ca0 2024-09-17T05:22:33.546 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.543+0000 7fde767fc640 1 -- 172.21.15.98:0/3372608171 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde7c005450 con 0x7fde800b4ca0 2024-09-17T05:22:33.546 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.543+0000 7fde87f2b640 1 -- 172.21.15.98:0/3372608171 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde800700e0 con 0x7fde800b4ca0 2024-09-17T05:22:33.547 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.544+0000 7fde87f2b640 1 -- 172.21.15.98:0/3372608171 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde80074610 con 0x7fde800b4ca0 2024-09-17T05:22:33.547 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.544+0000 7fde767fc640 1 -- 172.21.15.98:0/3372608171 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fde7c0047a0 con 0x7fde800b4ca0 2024-09-17T05:22:33.547 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.545+0000 7fde767fc640 1 --2- 172.21.15.98:0/3372608171 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fde64078bc0 0x7fde6407b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:33.547 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.545+0000 7fde767fc640 1 -- 172.21.15.98:0/3372608171 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fde7c0bbe00 con 0x7fde800b4ca0 2024-09-17T05:22:33.547 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.545+0000 7fde854c6640 1 --2- 172.21.15.98:0/3372608171 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fde64078bc0 0x7fde6407b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:33.548 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.545+0000 7fde854c6640 1 --2- 172.21.15.98:0/3372608171 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fde64078bc0 0x7fde6407b080 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fde800cbd00 tx=0x7fde700079f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:33.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.549+0000 7fde767fc640 1 -- 172.21.15.98:0/3372608171 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fde80074610 con 0x7fde800b4ca0 2024-09-17T05:22:33.725 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.724+0000 7fde87f2b640 1 -- 172.21.15.98:0/3372608171 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fde8015f6b0 con 0x7fde800b4ca0 2024-09-17T05:22:33.726 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.725+0000 7fde767fc640 1 -- 172.21.15.98:0/3372608171 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16730 (secure 0 0 0) 0x7fde7c03f030 con 0x7fde800b4ca0 2024-09-17T05:22:33.727 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:22:33.727 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":31,"fsid":"fcbf5a43-b3d8-497c-b15d-3cc022477cf0","created":"2024-09-17T05:21:29.852143+0000","modified":"2024-09-17T05:22:32.448888+0000","last_up_change":"2024-09-17T05:21:42.925756+0000","last_in_change":"2024-09-17T05:21:32.893880+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:21:42.263011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:22:30.174068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-17T05:22:31.410605+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ad711a-df74-438b-b0dc-1499d685c958","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6825","nonce":3644101529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6827","nonce":3644101529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6831","nonce":3644101529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6829","nonce":3644101529}]},"public_addr":"172.21.15.98:6825/3644101529","cluster_addr":"172.21.15.98:6827/3644101529","heartbeat_back_addr":"172.21.15.98:6831/3644101529","heartbeat_front_addr":"172.21.15.98:6829/3644101529","state":["exists","up"]},{"osd":1,"uuid":"f0ccb08d-4d8d-47b8-9320-8c372a6605b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6817","nonce":3902180920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6819","nonce":3902180920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6823","nonce":3902180920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6821","nonce":3902180920}]},"public_addr":"172.21.15.98:6817/3902180920","cluster_addr":"172.21.15.98:6819/3902180920","heartbeat_back_addr":"172.21.15.98:6823/3902180920","heartbeat_front_addr":"172.21.15.98:6821/3902180920","state":["exists","up"]},{"osd":2,"uuid":"a0985398-5e5f-494f-8abf-f785f19e94ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6801","nonce":1518887101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6803","nonce":1518887101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6807","nonce":1518887101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6805","nonce":1518887101}]},"public_addr":"172.21.15.98:6801/1518887101","cluster_addr":"172.21.15.98:6803/1518887101","heartbeat_back_addr":"172.21.15.98:6807/1518887101","heartbeat_front_addr":"172.21.15.98:6805/1518887101","state":["exists","up"]},{"osd":3,"uuid":"e960be2e-0c3a-426e-9507-d3be5895f9e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6809","nonce":4125246091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6811","nonce":4125246091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6815","nonce":4125246091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6813","nonce":4125246091}]},"public_addr":"172.21.15.98:6809/4125246091","cluster_addr":"172.21.15.98:6811/4125246091","heartbeat_back_addr":"172.21.15.98:6815/4125246091","heartbeat_front_addr":"172.21.15.98:6813/4125246091","state":["exists","up"]},{"osd":4,"uuid":"49118c00-3dc1-43ef-8ed4-aca61e56a507","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6811","nonce":765789888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6813","nonce":765789888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6817","nonce":765789888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6815","nonce":765789888}]},"public_addr":"172.21.15.167:6811/765789888","cluster_addr":"172.21.15.167:6813/765789888","heartbeat_back_addr":"172.21.15.167:6817/765789888","heartbeat_front_addr":"172.21.15.167:6815/765789888","state":["exists","up"]},{"osd":5,"uuid":"9f4e0143-2b3d-40e4-bfb5-043d9a9f4ba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6803","nonce":2567019914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6805","nonce":2567019914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6809","nonce":2567019914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6807","nonce":2567019914}]},"public_addr":"172.21.15.167:6803/2567019914","cluster_addr":"172.21.15.167:6805/2567019914","heartbeat_back_addr":"172.21.15.167:6809/2567019914","heartbeat_front_addr":"172.21.15.167:6807/2567019914","state":["exists","up"]},{"osd":6,"uuid":"28720514-e627-4dea-8f4d-bd311ec31361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6819","nonce":96262631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6821","nonce":96262631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6825","nonce":96262631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6823","nonce":96262631}]},"public_addr":"172.21.15.167:6819/96262631","cluster_addr":"172.21.15.167:6821/96262631","heartbeat_back_addr":"172.21.15.167:6825/96262631","heartbeat_front_addr":"172.21.15.167:6823/96262631","state":["exists","up"]},{"osd":7,"uuid":"01edaf9c-3898-406e-85b0-774cfda60adf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6827","nonce":4169560909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6829","nonce":4169560909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6833","nonce":4169560909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6831","nonce":4169560909}]},"public_addr":"172.21.15.167:6827/4169560909","cluster_addr":"172.21.15.167:6829/4169560909","heartbeat_back_addr":"172.21.15.167:6833/4169560909","heartbeat_front_addr":"172.21.15.167:6831/4169560909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:40.054920+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.177110+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.749278+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.400155+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.503576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.196417+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.371063+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.212852+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:22:33.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.727+0000 7fde87f2b640 1 -- 172.21.15.98:0/3372608171 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fde64078bc0 msgr2=0x7fde6407b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:33.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.727+0000 7fde87f2b640 1 --2- 172.21.15.98:0/3372608171 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fde64078bc0 0x7fde6407b080 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fde800cbd00 tx=0x7fde700079f0 comp rx=0 tx=0).stop 2024-09-17T05:22:33.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.728+0000 7fde87f2b640 1 -- 172.21.15.98:0/3372608171 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde800b4ca0 msgr2=0x7fde8006fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:33.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.728+0000 7fde87f2b640 1 --2- 172.21.15.98:0/3372608171 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde800b4ca0 0x7fde8006fba0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fde7c009950 tx=0x7fde7c033ce0 comp rx=0 tx=0).stop 2024-09-17T05:22:33.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.728+0000 7fde87f2b640 1 -- 172.21.15.98:0/3372608171 shutdown_connections 2024-09-17T05:22:33.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.728+0000 7fde87f2b640 1 --2- 172.21.15.98:0/3372608171 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fde64078bc0 0x7fde6407b080 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:33.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.728+0000 7fde87f2b640 1 --2- 172.21.15.98:0/3372608171 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde801445d0 0x7fde801e9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:33.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.728+0000 7fde87f2b640 1 --2- 172.21.15.98:0/3372608171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde800ccfd0 0x7fde801e8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:33.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.728+0000 7fde87f2b640 1 --2- 172.21.15.98:0/3372608171 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde800b4ca0 0x7fde8006fba0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:33.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.728+0000 7fde87f2b640 1 -- 172.21.15.98:0/3372608171 >> 172.21.15.98:0/3372608171 conn(0x7fde800b1950 msgr2=0x7fde800cdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:33.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.728+0000 7fde87f2b640 1 -- 172.21.15.98:0/3372608171 shutdown_connections 2024-09-17T05:22:33.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.728+0000 7fde87f2b640 1 -- 172.21.15.98:0/3372608171 wait complete. 2024-09-17T05:22:33.739 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T05:22:33.843 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.842+0000 7f6786fa3640 1 -- 172.21.15.98:0/3249363066 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f67800cccd0 msgr2=0x7f67800cdbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:33.843 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.842+0000 7f6786fa3640 1 --2- 172.21.15.98:0/3249363066 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f67800cccd0 0x7f67800cdbb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6778009830 tx=0x7f677802a480 comp rx=0 tx=0).stop 2024-09-17T05:22:33.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.842+0000 7f6786fa3640 1 -- 172.21.15.98:0/3249363066 shutdown_connections 2024-09-17T05:22:33.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.842+0000 7f6786fa3640 1 --2- 172.21.15.98:0/3249363066 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f67800cccd0 0x7f67800cdbb0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:33.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.842+0000 7f6786fa3640 1 --2- 172.21.15.98:0/3249363066 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6780145750 0x7f6780073440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:33.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.842+0000 7f6786fa3640 1 -- 172.21.15.98:0/3249363066 >> 172.21.15.98:0/3249363066 conn(0x7f67800b1840 msgr2=0x7f67800b1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:33.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.842+0000 7f6786fa3640 1 -- 172.21.15.98:0/3249363066 shutdown_connections 2024-09-17T05:22:33.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.842+0000 7f6786fa3640 1 -- 172.21.15.98:0/3249363066 wait complete. 2024-09-17T05:22:33.846 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.843+0000 7f6786fa3640 1 Processor -- start 2024-09-17T05:22:33.846 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.843+0000 7f6786fa3640 1 -- start start 2024-09-17T05:22:33.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.844+0000 7f6786fa3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f678006efa0 0x7f678015eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:33.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.844+0000 7f6786fa3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f67800cccd0 0x7f67800b3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:33.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.844+0000 7f6786fa3640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6780145750 0x7f678012abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:33.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.844+0000 7f6786fa3640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f67800ce480 con 0x7f678006efa0 2024-09-17T05:22:33.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.844+0000 7f6786fa3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f67800ce300 con 0x7f67800cccd0 2024-09-17T05:22:33.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.844+0000 7f6786fa3640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f67800ce600 con 0x7f6780145750 2024-09-17T05:22:33.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.844+0000 7f6784d3f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f678006efa0 0x7f678015eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:33.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.844+0000 7f6784d3f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f678006efa0 0x7f678015eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56708/0 (socket says 172.21.15.98:56708) 2024-09-17T05:22:33.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.844+0000 7f6784d3f640 1 -- 172.21.15.98:0/2462637725 learned_addr learned my addr 172.21.15.98:0/2462637725 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:33.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.844+0000 7f6785540640 1 --2- 172.21.15.98:0/2462637725 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6780145750 0x7f678012abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:33.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.844+0000 7f677ffff640 1 --2- 172.21.15.98:0/2462637725 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f67800cccd0 0x7f67800b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:33.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.845+0000 7f6784d3f640 1 -- 172.21.15.98:0/2462637725 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6780145750 msgr2=0x7f678012abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:33.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.845+0000 7f6784d3f640 1 --2- 172.21.15.98:0/2462637725 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6780145750 0x7f678012abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:33.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.845+0000 7f6784d3f640 1 -- 172.21.15.98:0/2462637725 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f67800cccd0 msgr2=0x7f67800b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:33.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.845+0000 7f6784d3f640 1 --2- 172.21.15.98:0/2462637725 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f67800cccd0 0x7f67800b3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:33.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.845+0000 7f6784d3f640 1 -- 172.21.15.98:0/2462637725 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67800b4830 con 0x7f678006efa0 2024-09-17T05:22:33.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.845+0000 7f6784d3f640 1 --2- 172.21.15.98:0/2462637725 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f678006efa0 0x7f678015eca0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f677000ef60 tx=0x7f677000ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:33.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.845+0000 7f677d7fa640 1 -- 172.21.15.98:0/2462637725 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6770003970 con 0x7f678006efa0 2024-09-17T05:22:33.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.845+0000 7f677d7fa640 1 -- 172.21.15.98:0/2462637725 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6770003c00 con 0x7f678006efa0 2024-09-17T05:22:33.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.845+0000 7f6786fa3640 1 -- 172.21.15.98:0/2462637725 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67800b4b10 con 0x7f678006efa0 2024-09-17T05:22:33.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.845+0000 7f677d7fa640 1 -- 172.21.15.98:0/2462637725 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6770004020 con 0x7f678006efa0 2024-09-17T05:22:33.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.845+0000 7f6786fa3640 1 -- 172.21.15.98:0/2462637725 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67800adff0 con 0x7f678006efa0 2024-09-17T05:22:33.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.846+0000 7f6786fa3640 1 -- 172.21.15.98:0/2462637725 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67800cf910 con 0x7f678006efa0 2024-09-17T05:22:33.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.847+0000 7f677d7fa640 1 -- 172.21.15.98:0/2462637725 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6770009780 con 0x7f678006efa0 2024-09-17T05:22:33.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.847+0000 7f677d7fa640 1 --2- 172.21.15.98:0/2462637725 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f6760078b90 0x7f676007b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:33.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.847+0000 7f677d7fa640 1 -- 172.21.15.98:0/2462637725 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f677009b470 con 0x7f678006efa0 2024-09-17T05:22:33.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.847+0000 7f677ffff640 1 --2- 172.21.15.98:0/2462637725 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f6760078b90 0x7f676007b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:33.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.848+0000 7f677ffff640 1 --2- 172.21.15.98:0/2462637725 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f6760078b90 0x7f676007b050 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f67801400e0 tx=0x7f6768009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:33.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:33.852+0000 7f677d7fa640 1 -- 172.21.15.98:0/2462637725 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f67700632f0 con 0x7f678006efa0 2024-09-17T05:22:34.064 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:34.063+0000 7f6786fa3640 1 -- 172.21.15.98:0/2462637725 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f67800cf630 con 0x7f678006efa0 2024-09-17T05:22:34.109 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:34.108+0000 7f677d7fa640 1 -- 172.21.15.98:0/2462637725 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v13) ==== 118+0+0 (secure 0 0 0) 0x7f6770067d20 con 0x7f678006efa0 2024-09-17T05:22:34.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:34.111+0000 7f6786fa3640 1 -- 172.21.15.98:0/2462637725 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f6760078b90 msgr2=0x7f676007b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:34.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:34.111+0000 7f6786fa3640 1 --2- 172.21.15.98:0/2462637725 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f6760078b90 0x7f676007b050 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f67801400e0 tx=0x7f6768009040 comp rx=0 tx=0).stop 2024-09-17T05:22:34.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:34.111+0000 7f6786fa3640 1 -- 172.21.15.98:0/2462637725 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f678006efa0 msgr2=0x7f678015eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:34.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:34.111+0000 7f6786fa3640 1 --2- 172.21.15.98:0/2462637725 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f678006efa0 0x7f678015eca0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f677000ef60 tx=0x7f677000ef90 comp rx=0 tx=0).stop 2024-09-17T05:22:34.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:34.111+0000 7f6786fa3640 1 -- 172.21.15.98:0/2462637725 shutdown_connections 2024-09-17T05:22:34.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:34.111+0000 7f6786fa3640 1 --2- 172.21.15.98:0/2462637725 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f6760078b90 0x7f676007b050 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:34.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:34.111+0000 7f6786fa3640 1 --2- 172.21.15.98:0/2462637725 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6780145750 0x7f678012abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:34.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:34.111+0000 7f6786fa3640 1 --2- 172.21.15.98:0/2462637725 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f67800cccd0 0x7f67800b3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:34.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:34.111+0000 7f6786fa3640 1 --2- 172.21.15.98:0/2462637725 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f678006efa0 0x7f678015eca0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:34.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:34.111+0000 7f6786fa3640 1 -- 172.21.15.98:0/2462637725 >> 172.21.15.98:0/2462637725 conn(0x7f67800b1840 msgr2=0x7f6780144160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:34.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:34.111+0000 7f6786fa3640 1 -- 172.21.15.98:0/2462637725 shutdown_connections 2024-09-17T05:22:34.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:34.111+0000 7f6786fa3640 1 -- 172.21.15.98:0/2462637725 wait complete. 2024-09-17T05:22:34.124 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T05:22:34.124 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T05:22:34.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:34.227+0000 7f7c3662a640 1 -- 172.21.15.98:0/1198058527 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c300add40 msgr2=0x7f7c300ae1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:34.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:34.227+0000 7f7c3662a640 1 --2- 172.21.15.98:0/1198058527 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c300add40 0x7f7c300ae1d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7c300d0b70 tx=0x7f7c2802a980 comp rx=0 tx=0).stop 2024-09-17T05:22:34.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:34.227+0000 7f7c3662a640 1 -- 172.21.15.98:0/1198058527 shutdown_connections 2024-09-17T05:22:34.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:34.227+0000 7f7c3662a640 1 --2- 172.21.15.98:0/1198058527 >> v2:172.21.15.167:3300/0 conn(0x7f7c300afd30 0x7f7c300b0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:34.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:34.227+0000 7f7c3662a640 1 --2- 172.21.15.98:0/1198058527 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c300add40 0x7f7c300ae1d0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:34.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:34.227+0000 7f7c3662a640 1 --2- 172.21.15.98:0/1198058527 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c3015f130 0x7f7c300cc490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:34.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:34.227+0000 7f7c3662a640 1 -- 172.21.15.98:0/1198058527 >> 172.21.15.98:0/1198058527 conn(0x7f7c300d0d40 msgr2=0x7f7c300d1150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:34.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:34.227+0000 7f7c3662a640 1 -- 172.21.15.98:0/1198058527 shutdown_connections 2024-09-17T05:22:34.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:34.227+0000 7f7c3662a640 1 -- 172.21.15.98:0/1198058527 wait complete. 2024-09-17T05:22:34.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:34.229+0000 7f7c3662a640 1 Processor -- start 2024-09-17T05:22:34.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:34.229+0000 7f7c3662a640 1 -- start start 2024-09-17T05:22:34.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:34.229+0000 7f7c3662a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c300add40 0x7f7c300b1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:34.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:34.229+0000 7f7c3662a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c300afd30 0x7f7c3009d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:34.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:34.229+0000 7f7c3662a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c3015f130 0x7f7c3009d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:34.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:34.229+0000 7f7c3662a640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7c3006f7f0 con 0x7f7c300afd30 2024-09-17T05:22:34.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:34.229+0000 7f7c3662a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7c3006f670 con 0x7f7c300add40 2024-09-17T05:22:34.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:34.229+0000 7f7c3662a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f7c3006f970 con 0x7f7c3015f130 2024-09-17T05:22:34.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:34.230+0000 7f7c2f7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c300afd30 0x7f7c3009d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:34.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:34.230+0000 7f7c2f7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c300afd30 0x7f7c3009d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56722/0 (socket says 172.21.15.98:56722) 2024-09-17T05:22:34.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:34.230+0000 7f7c2f7fe640 1 -- 172.21.15.98:0/2127476345 learned_addr learned my addr 172.21.15.98:0/2127476345 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:34.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:34.230+0000 7f7c2ffff640 1 --2- 172.21.15.98:0/2127476345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c300add40 0x7f7c300b1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:34.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:34.230+0000 7f7c34bc7640 1 --2- 172.21.15.98:0/2127476345 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c3015f130 0x7f7c3009d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:34.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:34.230+0000 7f7c2f7fe640 1 -- 172.21.15.98:0/2127476345 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c3015f130 msgr2=0x7f7c3009d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:34.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:34.230+0000 7f7c2f7fe640 1 --2- 172.21.15.98:0/2127476345 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c3015f130 0x7f7c3009d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:34.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:34.230+0000 7f7c2f7fe640 1 -- 172.21.15.98:0/2127476345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c300add40 msgr2=0x7f7c300b1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:34.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:34.230+0000 7f7c2f7fe640 1 --2- 172.21.15.98:0/2127476345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c300add40 0x7f7c300b1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:34.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:34.230+0000 7f7c2f7fe640 1 -- 172.21.15.98:0/2127476345 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c3014cc80 con 0x7f7c300afd30 2024-09-17T05:22:34.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:34.230+0000 7f7c34bc7640 1 --2- 172.21.15.98:0/2127476345 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c3015f130 0x7f7c3009d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:22:34.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:34.230+0000 7f7c2f7fe640 1 --2- 172.21.15.98:0/2127476345 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c300afd30 0x7f7c3009d3a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7c2400c9a0 tx=0x7f7c2400ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:34.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:34.230+0000 7f7c2cff9640 1 -- 172.21.15.98:0/2127476345 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c24004220 con 0x7f7c300afd30 2024-09-17T05:22:34.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:34.230+0000 7f7c2cff9640 1 -- 172.21.15.98:0/2127476345 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7c240044b0 con 0x7f7c300afd30 2024-09-17T05:22:34.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:34.230+0000 7f7c3662a640 1 -- 172.21.15.98:0/2127476345 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c3014cf60 con 0x7f7c300afd30 2024-09-17T05:22:34.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:34.230+0000 7f7c2cff9640 1 -- 172.21.15.98:0/2127476345 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c24007c10 con 0x7f7c300afd30 2024-09-17T05:22:34.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:34.230+0000 7f7c3662a640 1 -- 172.21.15.98:0/2127476345 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c3014d520 con 0x7f7c300afd30 2024-09-17T05:22:34.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:34.231+0000 7f7c3662a640 1 -- 172.21.15.98:0/2127476345 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c3006fe90 con 0x7f7c300afd30 2024-09-17T05:22:34.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:34.232+0000 7f7c2cff9640 1 -- 172.21.15.98:0/2127476345 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7c24003610 con 0x7f7c300afd30 2024-09-17T05:22:34.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:34.232+0000 7f7c2cff9640 1 --2- 172.21.15.98:0/2127476345 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f7c1c078b90 0x7f7c1c07b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:34.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:34.232+0000 7f7c2cff9640 1 -- 172.21.15.98:0/2127476345 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f7c2409b1d0 con 0x7f7c300afd30 2024-09-17T05:22:34.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:34.232+0000 7f7c2ffff640 1 --2- 172.21.15.98:0/2127476345 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f7c1c078b90 0x7f7c1c07b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:34.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:34.233+0000 7f7c2ffff640 1 --2- 172.21.15.98:0/2127476345 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f7c1c078b90 0x7f7c1c07b050 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7c200058c0 tx=0x7f7c20005f60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:34.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:34.236+0000 7f7c2cff9640 1 -- 172.21.15.98:0/2127476345 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f7c24014030 con 0x7f7c300afd30 2024-09-17T05:22:34.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:34.448+0000 7f7c3662a640 1 -- 172.21.15.98:0/2127476345 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f7c3015e8e0 con 0x7f7c300afd30 2024-09-17T05:22:35.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.117+0000 7f7c2cff9640 1 -- 172.21.15.98:0/2127476345 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v14) ==== 122+0+0 (secure 0 0 0) 0x7f7c24062fd0 con 0x7f7c300afd30 2024-09-17T05:22:35.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.120+0000 7f7c3662a640 1 -- 172.21.15.98:0/2127476345 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f7c1c078b90 msgr2=0x7f7c1c07b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:35.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.120+0000 7f7c3662a640 1 --2- 172.21.15.98:0/2127476345 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f7c1c078b90 0x7f7c1c07b050 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7c200058c0 tx=0x7f7c20005f60 comp rx=0 tx=0).stop 2024-09-17T05:22:35.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.120+0000 7f7c3662a640 1 -- 172.21.15.98:0/2127476345 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c300afd30 msgr2=0x7f7c3009d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:35.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.120+0000 7f7c3662a640 1 --2- 172.21.15.98:0/2127476345 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c300afd30 0x7f7c3009d3a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7c2400c9a0 tx=0x7f7c2400ce60 comp rx=0 tx=0).stop 2024-09-17T05:22:35.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.120+0000 7f7c3662a640 1 -- 172.21.15.98:0/2127476345 shutdown_connections 2024-09-17T05:22:35.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.120+0000 7f7c3662a640 1 --2- 172.21.15.98:0/2127476345 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f7c1c078b90 0x7f7c1c07b050 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:35.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.120+0000 7f7c3662a640 1 --2- 172.21.15.98:0/2127476345 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c3015f130 0x7f7c3009d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:35.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.120+0000 7f7c3662a640 1 --2- 172.21.15.98:0/2127476345 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c300afd30 0x7f7c3009d3a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:35.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.120+0000 7f7c3662a640 1 --2- 172.21.15.98:0/2127476345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c300add40 0x7f7c300b1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:35.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.120+0000 7f7c3662a640 1 -- 172.21.15.98:0/2127476345 >> 172.21.15.98:0/2127476345 conn(0x7f7c300d0d40 msgr2=0x7f7c300710d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:35.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.121+0000 7f7c3662a640 1 -- 172.21.15.98:0/2127476345 shutdown_connections 2024-09-17T05:22:35.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.121+0000 7f7c3662a640 1 -- 172.21.15.98:0/2127476345 wait complete. 2024-09-17T05:22:35.133 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T05:22:35.134 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:22:35.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.236+0000 7fa85b1d3640 1 -- 172.21.15.98:0/2575084341 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8540d2050 msgr2=0x7fa8540d0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:35.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.236+0000 7fa85b1d3640 1 --2- 172.21.15.98:0/2575084341 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8540d2050 0x7fa8540d0f00 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa83c005fd0 tx=0x7fa83c02a530 comp rx=0 tx=0).stop 2024-09-17T05:22:35.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.236+0000 7fa85b1d3640 1 -- 172.21.15.98:0/2575084341 shutdown_connections 2024-09-17T05:22:35.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.236+0000 7fa85b1d3640 1 --2- 172.21.15.98:0/2575084341 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8540d2050 0x7fa8540d0f00 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:35.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.236+0000 7fa85b1d3640 1 --2- 172.21.15.98:0/2575084341 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa85415e0d0 0x7fa8540d09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:35.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.236+0000 7fa85b1d3640 1 -- 172.21.15.98:0/2575084341 >> 172.21.15.98:0/2575084341 conn(0x7fa8540d3fe0 msgr2=0x7fa8540d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:35.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.236+0000 7fa85b1d3640 1 -- 172.21.15.98:0/2575084341 shutdown_connections 2024-09-17T05:22:35.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.236+0000 7fa85b1d3640 1 -- 172.21.15.98:0/2575084341 wait complete. 2024-09-17T05:22:35.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.237+0000 7fa85b1d3640 1 Processor -- start 2024-09-17T05:22:35.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.237+0000 7fa85b1d3640 1 -- start start 2024-09-17T05:22:35.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.238+0000 7fa85b1d3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8540d1440 0x7fa8540cc100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:35.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.238+0000 7fa85b1d3640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8540d2050 0x7fa8541f80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:35.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.238+0000 7fa85b1d3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa85415e0d0 0x7fa8541f8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:35.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.238+0000 7fa85b1d3640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa85415ebc0 con 0x7fa85415e0d0 2024-09-17T05:22:35.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.238+0000 7fa85b1d3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa8540cfee0 con 0x7fa8540d1440 2024-09-17T05:22:35.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.238+0000 7fa85b1d3640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fa85415ed40 con 0x7fa8540d2050 2024-09-17T05:22:35.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.239+0000 7fa859770640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa85415e0d0 0x7fa8541f8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:35.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.239+0000 7fa859770640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa85415e0d0 0x7fa8541f8600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56740/0 (socket says 172.21.15.98:56740) 2024-09-17T05:22:35.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.239+0000 7fa859770640 1 -- 172.21.15.98:0/296929405 learned_addr learned my addr 172.21.15.98:0/296929405 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:35.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.239+0000 7fa858f6f640 1 --2- 172.21.15.98:0/296929405 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8540d1440 0x7fa8540cc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:35.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.239+0000 7fa853fff640 1 --2- 172.21.15.98:0/296929405 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8540d2050 0x7fa8541f80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:35.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.239+0000 7fa859770640 1 -- 172.21.15.98:0/296929405 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8540d2050 msgr2=0x7fa8541f80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:35.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.239+0000 7fa859770640 1 --2- 172.21.15.98:0/296929405 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8540d2050 0x7fa8541f80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:35.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.239+0000 7fa859770640 1 -- 172.21.15.98:0/296929405 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8540d1440 msgr2=0x7fa8540cc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:35.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.239+0000 7fa859770640 1 --2- 172.21.15.98:0/296929405 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8540d1440 0x7fa8540cc100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:35.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.239+0000 7fa859770640 1 -- 172.21.15.98:0/296929405 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8540cc7a0 con 0x7fa85415e0d0 2024-09-17T05:22:35.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.239+0000 7fa853fff640 1 --2- 172.21.15.98:0/296929405 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8540d2050 0x7fa8541f80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:22:35.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.239+0000 7fa859770640 1 --2- 172.21.15.98:0/296929405 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa85415e0d0 0x7fa8541f8600 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa84c00c3c0 tx=0x7fa84c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:35.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.239+0000 7fa8517fa640 1 -- 172.21.15.98:0/296929405 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa84c017070 con 0x7fa85415e0d0 2024-09-17T05:22:35.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.239+0000 7fa8517fa640 1 -- 172.21.15.98:0/296929405 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa84c0035f0 con 0x7fa85415e0d0 2024-09-17T05:22:35.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.239+0000 7fa8517fa640 1 -- 172.21.15.98:0/296929405 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa84c003a40 con 0x7fa85415e0d0 2024-09-17T05:22:35.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.239+0000 7fa85b1d3640 1 -- 172.21.15.98:0/296929405 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8540cca80 con 0x7fa85415e0d0 2024-09-17T05:22:35.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.239+0000 7fa85b1d3640 1 -- 172.21.15.98:0/296929405 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8540cd040 con 0x7fa85415e0d0 2024-09-17T05:22:35.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.240+0000 7fa85b1d3640 1 -- 172.21.15.98:0/296929405 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa85415f2a0 con 0x7fa85415e0d0 2024-09-17T05:22:35.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.241+0000 7fa8517fa640 1 -- 172.21.15.98:0/296929405 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa84c01a070 con 0x7fa85415e0d0 2024-09-17T05:22:35.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.241+0000 7fa8517fa640 1 --2- 172.21.15.98:0/296929405 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fa834078b90 0x7fa83407b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:35.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.242+0000 7fa8517fa640 1 -- 172.21.15.98:0/296929405 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fa84c099ec0 con 0x7fa85415e0d0 2024-09-17T05:22:35.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.242+0000 7fa858f6f640 1 --2- 172.21.15.98:0/296929405 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fa834078b90 0x7fa83407b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:35.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.242+0000 7fa858f6f640 1 --2- 172.21.15.98:0/296929405 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fa834078b90 0x7fa83407b050 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa84400a400 tx=0x7fa84400d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:35.246 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.246+0000 7fa8517fa640 1 -- 172.21.15.98:0/296929405 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fa84c061dd0 con 0x7fa85415e0d0 2024-09-17T05:22:35.461 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.460+0000 7fa85b1d3640 1 -- 172.21.15.98:0/296929405 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa8540b6290 con 0x7fa85415e0d0 2024-09-17T05:22:35.461 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.460+0000 7fa8517fa640 1 -- 172.21.15.98:0/296929405 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5226 (secure 0 0 0) 0x7fa84c066800 con 0x7fa85415e0d0 2024-09-17T05:22:35.461 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:22:35.462 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":14,"btime":"2024-09-17T05:22:35:113505+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4771,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/387934311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":387934311},{"type":"v1","addr":"172.21.15.167:6836","nonce":387934311}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4878,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6834/2571517660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2571517660},{"type":"v1","addr":"172.21.15.98:6834","nonce":2571517660}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4881,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/1837285444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6833","nonce":1837285444},{"type":"v1","addr":"172.21.15.98:6835","nonce":1837285444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:22:32.448852+0000","modified":"2024-09-17T05:22:34.449535+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4890},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4890":{"gid":4890,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6837/3889162905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":3889162905},{"type":"v1","addr":"172.21.15.167:6837","nonce":3889162905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4890,"qdb_cluster":[4890]},"id":2}]} 2024-09-17T05:22:35.462 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 14 2024-09-17T05:22:35.464 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.463+0000 7fa85b1d3640 1 -- 172.21.15.98:0/296929405 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fa834078b90 msgr2=0x7fa83407b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:35.464 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.463+0000 7fa85b1d3640 1 --2- 172.21.15.98:0/296929405 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fa834078b90 0x7fa83407b050 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa84400a400 tx=0x7fa84400d040 comp rx=0 tx=0).stop 2024-09-17T05:22:35.464 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.463+0000 7fa85b1d3640 1 -- 172.21.15.98:0/296929405 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa85415e0d0 msgr2=0x7fa8541f8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:35.464 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.463+0000 7fa85b1d3640 1 --2- 172.21.15.98:0/296929405 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa85415e0d0 0x7fa8541f8600 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa84c00c3c0 tx=0x7fa84c00c880 comp rx=0 tx=0).stop 2024-09-17T05:22:35.464 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.463+0000 7fa85b1d3640 1 -- 172.21.15.98:0/296929405 shutdown_connections 2024-09-17T05:22:35.464 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.463+0000 7fa85b1d3640 1 --2- 172.21.15.98:0/296929405 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fa834078b90 0x7fa83407b050 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:35.464 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.463+0000 7fa85b1d3640 1 --2- 172.21.15.98:0/296929405 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa85415e0d0 0x7fa8541f8600 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:35.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.463+0000 7fa85b1d3640 1 --2- 172.21.15.98:0/296929405 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8540d2050 0x7fa8541f80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:35.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.463+0000 7fa85b1d3640 1 --2- 172.21.15.98:0/296929405 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8540d1440 0x7fa8540cc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:35.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.463+0000 7fa85b1d3640 1 -- 172.21.15.98:0/296929405 >> 172.21.15.98:0/296929405 conn(0x7fa8540d3fe0 msgr2=0x7fa8540b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:35.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.463+0000 7fa85b1d3640 1 -- 172.21.15.98:0/296929405 shutdown_connections 2024-09-17T05:22:35.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.463+0000 7fa85b1d3640 1 -- 172.21.15.98:0/296929405 wait complete. 2024-09-17T05:22:35.475 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:22:35.576 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.575+0000 7fbc42fd3640 1 -- 172.21.15.98:0/507266228 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc3c0b43f0 msgr2=0x7fbc3c0b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:35.576 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.575+0000 7fbc42fd3640 1 --2- 172.21.15.98:0/507266228 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc3c0b43f0 0x7fbc3c0b47d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c0b24d0 tx=0x7fbc2c02a410 comp rx=0 tx=0).stop 2024-09-17T05:22:35.576 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.575+0000 7fbc42fd3640 1 -- 172.21.15.98:0/507266228 shutdown_connections 2024-09-17T05:22:35.576 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.575+0000 7fbc42fd3640 1 --2- 172.21.15.98:0/507266228 >> v2:172.21.15.167:3300/0 conn(0x7fbc3c073bb0 0x7fbc3c06ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:35.576 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.575+0000 7fbc42fd3640 1 --2- 172.21.15.98:0/507266228 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc3c0b43f0 0x7fbc3c0b47d0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:35.576 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.575+0000 7fbc42fd3640 1 -- 172.21.15.98:0/507266228 >> 172.21.15.98:0/507266228 conn(0x7fbc3c0b1950 msgr2=0x7fbc3c0b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:35.576 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.575+0000 7fbc42fd3640 1 -- 172.21.15.98:0/507266228 shutdown_connections 2024-09-17T05:22:35.576 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.575+0000 7fbc42fd3640 1 -- 172.21.15.98:0/507266228 wait complete. 2024-09-17T05:22:35.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.576+0000 7fbc42fd3640 1 Processor -- start 2024-09-17T05:22:35.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.576+0000 7fbc42fd3640 1 -- start start 2024-09-17T05:22:35.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.577+0000 7fbc42fd3640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc3c073bb0 0x7fbc3c0c9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:35.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.577+0000 7fbc42fd3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc3c074150 0x7fbc3c0cb110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:35.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.577+0000 7fbc42fd3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc3c0b43f0 0x7fbc3c0ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:35.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.577+0000 7fbc42fd3640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fbc3c06f3b0 con 0x7fbc3c0b43f0 2024-09-17T05:22:35.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.577+0000 7fbc42fd3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbc3c0704c0 con 0x7fbc3c074150 2024-09-17T05:22:35.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.577+0000 7fbc42fd3640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fbc3c06f530 con 0x7fbc3c073bb0 2024-09-17T05:22:35.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.577+0000 7fbc41570640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc3c0b43f0 0x7fbc3c0ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:35.580 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.577+0000 7fbc41570640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc3c0b43f0 0x7fbc3c0ce3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56768/0 (socket says 172.21.15.98:56768) 2024-09-17T05:22:35.580 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.577+0000 7fbc41570640 1 -- 172.21.15.98:0/1843651415 learned_addr learned my addr 172.21.15.98:0/1843651415 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:35.580 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.577+0000 7fbc3bfff640 1 --2- 172.21.15.98:0/1843651415 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc3c074150 0x7fbc3c0cb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:35.580 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.577+0000 7fbc40d6f640 1 --2- 172.21.15.98:0/1843651415 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc3c073bb0 0x7fbc3c0c9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:35.580 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.577+0000 7fbc41570640 1 -- 172.21.15.98:0/1843651415 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc3c073bb0 msgr2=0x7fbc3c0c9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:35.580 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.577+0000 7fbc41570640 1 --2- 172.21.15.98:0/1843651415 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc3c073bb0 0x7fbc3c0c9870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:35.580 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.577+0000 7fbc41570640 1 -- 172.21.15.98:0/1843651415 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc3c074150 msgr2=0x7fbc3c0cb110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:35.580 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.577+0000 7fbc41570640 1 --2- 172.21.15.98:0/1843651415 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc3c074150 0x7fbc3c0cb110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:35.580 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.577+0000 7fbc41570640 1 -- 172.21.15.98:0/1843651415 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc3c0cb770 con 0x7fbc3c0b43f0 2024-09-17T05:22:35.580 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.577+0000 7fbc3bfff640 1 --2- 172.21.15.98:0/1843651415 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc3c074150 0x7fbc3c0cb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:22:35.580 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.577+0000 7fbc41570640 1 --2- 172.21.15.98:0/1843651415 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc3c0b43f0 0x7fbc3c0ce3f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fbc3400cad0 tx=0x7fbc3400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:35.580 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.577+0000 7fbc397fa640 1 -- 172.21.15.98:0/1843651415 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc3400ae20 con 0x7fbc3c0b43f0 2024-09-17T05:22:35.580 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.577+0000 7fbc397fa640 1 -- 172.21.15.98:0/1843651415 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbc3400f450 con 0x7fbc3c0b43f0 2024-09-17T05:22:35.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.577+0000 7fbc42fd3640 1 -- 172.21.15.98:0/1843651415 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc3c0cba50 con 0x7fbc3c0b43f0 2024-09-17T05:22:35.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.577+0000 7fbc397fa640 1 -- 172.21.15.98:0/1843651415 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc3400f8c0 con 0x7fbc3c0b43f0 2024-09-17T05:22:35.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.578+0000 7fbc42fd3640 1 -- 172.21.15.98:0/1843651415 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc3c0cbd30 con 0x7fbc3c0b43f0 2024-09-17T05:22:35.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.578+0000 7fbc42fd3640 1 -- 172.21.15.98:0/1843651415 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc3c0760b0 con 0x7fbc3c0b43f0 2024-09-17T05:22:35.582 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.579+0000 7fbc397fa640 1 -- 172.21.15.98:0/1843651415 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbc3400fa60 con 0x7fbc3c0b43f0 2024-09-17T05:22:35.582 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.579+0000 7fbc397fa640 1 --2- 172.21.15.98:0/1843651415 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fbc28078b90 0x7fbc2807b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:35.582 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.580+0000 7fbc397fa640 1 -- 172.21.15.98:0/1843651415 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fbc3409b880 con 0x7fbc3c0b43f0 2024-09-17T05:22:35.582 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.580+0000 7fbc40d6f640 1 --2- 172.21.15.98:0/1843651415 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fbc28078b90 0x7fbc2807b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:35.582 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.580+0000 7fbc40d6f640 1 --2- 172.21.15.98:0/1843651415 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fbc28078b90 0x7fbc2807b050 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c034000 tx=0x7fbc2c004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:35.584 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.584+0000 7fbc397fa640 1 -- 172.21.15.98:0/1843651415 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fbc34014030 con 0x7fbc3c0b43f0 2024-09-17T05:22:35.763 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.762+0000 7fbc42fd3640 1 -- 172.21.15.98:0/1843651415 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbc3c06f190 con 0x7fbc3c0b43f0 2024-09-17T05:22:35.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.763+0000 7fbc397fa640 1 -- 172.21.15.98:0/1843651415 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16717 (secure 0 0 0) 0x7fbc34063d50 con 0x7fbc3c0b43f0 2024-09-17T05:22:35.764 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:22:35.764 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":32,"fsid":"fcbf5a43-b3d8-497c-b15d-3cc022477cf0","created":"2024-09-17T05:21:29.852143+0000","modified":"2024-09-17T05:22:34.108589+0000","last_up_change":"2024-09-17T05:21:42.925756+0000","last_in_change":"2024-09-17T05:21:32.893880+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:21:42.263011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:22:30.174068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-17T05:22:31.410605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ad711a-df74-438b-b0dc-1499d685c958","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6825","nonce":3644101529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6827","nonce":3644101529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6831","nonce":3644101529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6829","nonce":3644101529}]},"public_addr":"172.21.15.98:6825/3644101529","cluster_addr":"172.21.15.98:6827/3644101529","heartbeat_back_addr":"172.21.15.98:6831/3644101529","heartbeat_front_addr":"172.21.15.98:6829/3644101529","state":["exists","up"]},{"osd":1,"uuid":"f0ccb08d-4d8d-47b8-9320-8c372a6605b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6817","nonce":3902180920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6819","nonce":3902180920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6823","nonce":3902180920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6821","nonce":3902180920}]},"public_addr":"172.21.15.98:6817/3902180920","cluster_addr":"172.21.15.98:6819/3902180920","heartbeat_back_addr":"172.21.15.98:6823/3902180920","heartbeat_front_addr":"172.21.15.98:6821/3902180920","state":["exists","up"]},{"osd":2,"uuid":"a0985398-5e5f-494f-8abf-f785f19e94ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6801","nonce":1518887101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6803","nonce":1518887101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6807","nonce":1518887101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6805","nonce":1518887101}]},"public_addr":"172.21.15.98:6801/1518887101","cluster_addr":"172.21.15.98:6803/1518887101","heartbeat_back_addr":"172.21.15.98:6807/1518887101","heartbeat_front_addr":"172.21.15.98:6805/1518887101","state":["exists","up"]},{"osd":3,"uuid":"e960be2e-0c3a-426e-9507-d3be5895f9e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6809","nonce":4125246091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6811","nonce":4125246091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6815","nonce":4125246091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6813","nonce":4125246091}]},"public_addr":"172.21.15.98:6809/4125246091","cluster_addr":"172.21.15.98:6811/4125246091","heartbeat_back_addr":"172.21.15.98:6815/4125246091","heartbeat_front_addr":"172.21.15.98:6813/4125246091","state":["exists","up"]},{"osd":4,"uuid":"49118c00-3dc1-43ef-8ed4-aca61e56a507","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6811","nonce":765789888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6813","nonce":765789888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6817","nonce":765789888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6815","nonce":765789888}]},"public_addr":"172.21.15.167:6811/765789888","cluster_addr":"172.21.15.167:6813/765789888","heartbeat_back_addr":"172.21.15.167:6817/765789888","heartbeat_front_addr":"172.21.15.167:6815/765789888","state":["exists","up"]},{"osd":5,"uuid":"9f4e0143-2b3d-40e4-bfb5-043d9a9f4ba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6803","nonce":2567019914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6805","nonce":2567019914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6809","nonce":2567019914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6807","nonce":2567019914}]},"public_addr":"172.21.15.167:6803/2567019914","cluster_addr":"172.21.15.167:6805/2567019914","heartbeat_back_addr":"172.21.15.167:6809/2567019914","heartbeat_front_addr":"172.21.15.167:6807/2567019914","state":["exists","up"]},{"osd":6,"uuid":"28720514-e627-4dea-8f4d-bd311ec31361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6819","nonce":96262631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6821","nonce":96262631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6825","nonce":96262631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6823","nonce":96262631}]},"public_addr":"172.21.15.167:6819/96262631","cluster_addr":"172.21.15.167:6821/96262631","heartbeat_back_addr":"172.21.15.167:6825/96262631","heartbeat_front_addr":"172.21.15.167:6823/96262631","state":["exists","up"]},{"osd":7,"uuid":"01edaf9c-3898-406e-85b0-774cfda60adf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6827","nonce":4169560909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6829","nonce":4169560909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6833","nonce":4169560909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6831","nonce":4169560909}]},"public_addr":"172.21.15.167:6827/4169560909","cluster_addr":"172.21.15.167:6829/4169560909","heartbeat_back_addr":"172.21.15.167:6833/4169560909","heartbeat_front_addr":"172.21.15.167:6831/4169560909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:40.054920+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.177110+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.749278+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.400155+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.503576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.196417+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.371063+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.212852+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:22:35.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.765+0000 7fbc42fd3640 1 -- 172.21.15.98:0/1843651415 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fbc28078b90 msgr2=0x7fbc2807b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:35.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.765+0000 7fbc42fd3640 1 --2- 172.21.15.98:0/1843651415 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fbc28078b90 0x7fbc2807b050 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c034000 tx=0x7fbc2c004730 comp rx=0 tx=0).stop 2024-09-17T05:22:35.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.765+0000 7fbc42fd3640 1 -- 172.21.15.98:0/1843651415 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc3c0b43f0 msgr2=0x7fbc3c0ce3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:35.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.765+0000 7fbc42fd3640 1 --2- 172.21.15.98:0/1843651415 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc3c0b43f0 0x7fbc3c0ce3f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fbc3400cad0 tx=0x7fbc3400cf90 comp rx=0 tx=0).stop 2024-09-17T05:22:35.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.765+0000 7fbc42fd3640 1 -- 172.21.15.98:0/1843651415 shutdown_connections 2024-09-17T05:22:35.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.765+0000 7fbc42fd3640 1 --2- 172.21.15.98:0/1843651415 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fbc28078b90 0x7fbc2807b050 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:35.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.765+0000 7fbc42fd3640 1 --2- 172.21.15.98:0/1843651415 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc3c0b43f0 0x7fbc3c0ce3f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:35.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.765+0000 7fbc42fd3640 1 --2- 172.21.15.98:0/1843651415 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc3c074150 0x7fbc3c0cb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:35.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.765+0000 7fbc42fd3640 1 --2- 172.21.15.98:0/1843651415 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc3c073bb0 0x7fbc3c0c9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:35.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.765+0000 7fbc42fd3640 1 -- 172.21.15.98:0/1843651415 >> 172.21.15.98:0/1843651415 conn(0x7fbc3c0b1950 msgr2=0x7fbc3c0b0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:35.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.765+0000 7fbc42fd3640 1 -- 172.21.15.98:0/1843651415 shutdown_connections 2024-09-17T05:22:35.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.765+0000 7fbc42fd3640 1 -- 172.21.15.98:0/1843651415 wait complete. 2024-09-17T05:22:35.778 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T05:22:35.778 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:22:35.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.879+0000 7fe951039640 1 -- 172.21.15.98:0/4014543204 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe934004d40 msgr2=0x7fe9340051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:35.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.879+0000 7fe951039640 1 --2- 172.21.15.98:0/4014543204 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe934004d40 0x7fe9340051c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe944006fc0 tx=0x7fe934005830 comp rx=0 tx=0).stop 2024-09-17T05:22:35.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.879+0000 7fe94b59e640 1 -- 172.21.15.98:0/4014543204 reap_dead start 2024-09-17T05:22:35.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.879+0000 7fe951039640 1 -- 172.21.15.98:0/4014543204 shutdown_connections 2024-09-17T05:22:35.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.879+0000 7fe951039640 1 -- 172.21.15.98:0/4014543204 >> 172.21.15.98:0/4014543204 conn(0x7fe94c0b1950 msgr2=0x7fe94c0b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:35.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.879+0000 7fe951039640 1 -- 172.21.15.98:0/4014543204 shutdown_connections 2024-09-17T05:22:35.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.879+0000 7fe951039640 1 -- 172.21.15.98:0/4014543204 wait complete. 2024-09-17T05:22:35.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.881+0000 7fe951039640 1 Processor -- start 2024-09-17T05:22:35.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.881+0000 7fe951039640 1 -- start start 2024-09-17T05:22:35.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.882+0000 7fe951039640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe934004d40 0x7fe94c1f5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:35.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.882+0000 7fe951039640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe94c0c6dd0 0x7fe94c15e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:35.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.882+0000 7fe951039640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe94c1f3010 0x7fe94c09ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:35.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.882+0000 7fe951039640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe94c0729a0 con 0x7fe94c1f3010 2024-09-17T05:22:35.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.882+0000 7fe951039640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe94c0b4eb0 con 0x7fe934004d40 2024-09-17T05:22:35.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.882+0000 7fe951039640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fe94c072b20 con 0x7fe94c0c6dd0 2024-09-17T05:22:35.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.882+0000 7fe94b59e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe94c1f3010 0x7fe94c09ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:35.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.882+0000 7fe94b59e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe94c1f3010 0x7fe94c09ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56796/0 (socket says 172.21.15.98:56796) 2024-09-17T05:22:35.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.882+0000 7fe94b59e640 1 -- 172.21.15.98:0/3988918759 learned_addr learned my addr 172.21.15.98:0/3988918759 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:35.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.882+0000 7fe94a59c640 1 --2- 172.21.15.98:0/3988918759 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe94c0c6dd0 0x7fe94c15e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:35.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.882+0000 7fe94ad9d640 1 --2- 172.21.15.98:0/3988918759 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe934004d40 0x7fe94c1f5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:35.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.882+0000 7fe94b59e640 1 -- 172.21.15.98:0/3988918759 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe94c0c6dd0 msgr2=0x7fe94c15e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:35.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.882+0000 7fe94b59e640 1 --2- 172.21.15.98:0/3988918759 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe94c0c6dd0 0x7fe94c15e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:35.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.882+0000 7fe94b59e640 1 -- 172.21.15.98:0/3988918759 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe934004d40 msgr2=0x7fe94c1f5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:35.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.882+0000 7fe94b59e640 1 --2- 172.21.15.98:0/3988918759 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe934004d40 0x7fe94c1f5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:35.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.882+0000 7fe94b59e640 1 -- 172.21.15.98:0/3988918759 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe94c1f6540 con 0x7fe94c1f3010 2024-09-17T05:22:35.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.882+0000 7fe94b59e640 1 --2- 172.21.15.98:0/3988918759 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe94c1f3010 0x7fe94c09ba50 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe94400c320 tx=0x7fe944006670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:35.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.882+0000 7fe9337fe640 1 -- 172.21.15.98:0/3988918759 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe944031050 con 0x7fe94c1f3010 2024-09-17T05:22:35.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.882+0000 7fe9337fe640 1 -- 172.21.15.98:0/3988918759 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe944036660 con 0x7fe94c1f3010 2024-09-17T05:22:35.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.882+0000 7fe951039640 1 -- 172.21.15.98:0/3988918759 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe94c1f6820 con 0x7fe94c1f3010 2024-09-17T05:22:35.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.882+0000 7fe9337fe640 1 -- 172.21.15.98:0/3988918759 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe944001c90 con 0x7fe94c1f3010 2024-09-17T05:22:35.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.882+0000 7fe951039640 1 -- 172.21.15.98:0/3988918759 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe94c0c7230 con 0x7fe94c1f3010 2024-09-17T05:22:35.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.884+0000 7fe951039640 1 -- 172.21.15.98:0/3988918759 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe94c1f6d40 con 0x7fe94c1f3010 2024-09-17T05:22:35.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.884+0000 7fe9337fe640 1 -- 172.21.15.98:0/3988918759 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe944034070 con 0x7fe94c1f3010 2024-09-17T05:22:35.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.885+0000 7fe9337fe640 1 --2- 172.21.15.98:0/3988918759 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fe938078b90 0x7fe93807b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:35.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.885+0000 7fe9337fe640 1 -- 172.21.15.98:0/3988918759 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fe9440ba2d0 con 0x7fe94c1f3010 2024-09-17T05:22:35.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.885+0000 7fe94ad9d640 1 --2- 172.21.15.98:0/3988918759 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fe938078b90 0x7fe93807b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:35.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.885+0000 7fe94ad9d640 1 --2- 172.21.15.98:0/3988918759 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fe938078b90 0x7fe93807b050 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe93c001520 tx=0x7fe93c006e90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:35.889 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:35.889+0000 7fe9337fe640 1 -- 172.21.15.98:0/3988918759 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fe94c1f6d40 con 0x7fe94c1f3010 2024-09-17T05:22:36.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.060+0000 7fe951039640 1 -- 172.21.15.98:0/3988918759 --> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe94c0b0d30 con 0x7fe938078b90 2024-09-17T05:22:36.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.064+0000 7fe9337fe640 1 -- 172.21.15.98:0/3988918759 <== mgr.4103 v2:172.21.15.167:6800/610796449 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247577 (secure 0 0 0) 0x7fe94c0b0d30 con 0x7fe938078b90 2024-09-17T05:22:36.068 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:22:36.069 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-17T05:22:36.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.067+0000 7fe951039640 1 -- 172.21.15.98:0/3988918759 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fe938078b90 msgr2=0x7fe93807b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:36.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.067+0000 7fe951039640 1 --2- 172.21.15.98:0/3988918759 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fe938078b90 0x7fe93807b050 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe93c001520 tx=0x7fe93c006e90 comp rx=0 tx=0).stop 2024-09-17T05:22:36.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.067+0000 7fe951039640 1 -- 172.21.15.98:0/3988918759 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe94c1f3010 msgr2=0x7fe94c09ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:36.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.067+0000 7fe951039640 1 --2- 172.21.15.98:0/3988918759 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe94c1f3010 0x7fe94c09ba50 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe94400c320 tx=0x7fe944006670 comp rx=0 tx=0).stop 2024-09-17T05:22:36.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.067+0000 7fe951039640 1 -- 172.21.15.98:0/3988918759 shutdown_connections 2024-09-17T05:22:36.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.067+0000 7fe951039640 1 --2- 172.21.15.98:0/3988918759 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fe938078b90 0x7fe93807b050 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:36.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.067+0000 7fe951039640 1 --2- 172.21.15.98:0/3988918759 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe94c1f3010 0x7fe94c09ba50 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:36.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.067+0000 7fe951039640 1 --2- 172.21.15.98:0/3988918759 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe94c0c6dd0 0x7fe94c15e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:36.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.067+0000 7fe951039640 1 --2- 172.21.15.98:0/3988918759 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe934004d40 0x7fe94c1f5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:36.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.067+0000 7fe951039640 1 -- 172.21.15.98:0/3988918759 >> 172.21.15.98:0/3988918759 conn(0x7fe94c0b1950 msgr2=0x7fe94c075890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:36.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.067+0000 7fe951039640 1 -- 172.21.15.98:0/3988918759 shutdown_connections 2024-09-17T05:22:36.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.067+0000 7fe951039640 1 -- 172.21.15.98:0/3988918759 wait complete. 2024-09-17T05:22:36.079 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2024-09-17T05:22:34.256265+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591980,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":126,"num_write_kb":1631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":93,"ondisk_log_size":93,"up":178,"acting":178,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":37,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224068,"kb_used_data":3672,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750652,"statfs":{"total":773094113280,"available":772864667648,"internally_reserved":0,"allocated":3760128,"data_stored":2143652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1612,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000754"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.103573+0000","last_change":"2024-09-17T05:22:32.103573+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.103573+0000","last_undegraded":"2024-09-17T05:22:32.103573+0000","last_fullsized":"2024-09-17T05:22:32.103573+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.126491+0000","last_change":"2024-09-17T05:22:33.116777+0000","last_active":"2024-09-17T05:22:33.126491+0000","last_peered":"2024-09-17T05:22:33.126491+0000","last_clean":"2024-09-17T05:22:33.126491+0000","last_became_active":"2024-09-17T05:22:33.116516+0000","last_became_peered":"2024-09-17T05:22:33.116516+0000","last_unstale":"2024-09-17T05:22:33.126491+0000","last_undegraded":"2024-09-17T05:22:33.126491+0000","last_fullsized":"2024-09-17T05:22:33.126491+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:11:33.740686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.107279+0000","last_change":"2024-09-17T05:22:32.107279+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.107279+0000","last_undegraded":"2024-09-17T05:22:32.107279+0000","last_fullsized":"2024-09-17T05:22:32.107279+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:22:32.090862+0000","last_change":"2024-09-17T05:22:32.090862+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.090862+0000","last_undegraded":"2024-09-17T05:22:32.090862+0000","last_fullsized":"2024-09-17T05:22:32.090862+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.118319+0000","last_change":"2024-09-17T05:22:33.111841+0000","last_active":"2024-09-17T05:22:33.118319+0000","last_peered":"2024-09-17T05:22:33.118319+0000","last_clean":"2024-09-17T05:22:33.118319+0000","last_became_active":"2024-09-17T05:22:33.111527+0000","last_became_peered":"2024-09-17T05:22:33.111527+0000","last_unstale":"2024-09-17T05:22:33.118319+0000","last_undegraded":"2024-09-17T05:22:33.118319+0000","last_fullsized":"2024-09-17T05:22:33.118319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:08.676086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.134538+0000","last_change":"2024-09-17T05:22:33.129531+0000","last_active":"2024-09-17T05:22:33.134538+0000","last_peered":"2024-09-17T05:22:33.134538+0000","last_clean":"2024-09-17T05:22:33.134538+0000","last_became_active":"2024-09-17T05:22:33.129298+0000","last_became_peered":"2024-09-17T05:22:33.129298+0000","last_unstale":"2024-09-17T05:22:33.134538+0000","last_undegraded":"2024-09-17T05:22:33.134538+0000","last_fullsized":"2024-09-17T05:22:33.134538+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:24:49.441913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.104413+0000","last_change":"2024-09-17T05:22:32.104413+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.104413+0000","last_undegraded":"2024-09-17T05:22:32.104413+0000","last_fullsized":"2024-09-17T05:22:32.104413+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.103975+0000","last_change":"2024-09-17T05:22:32.103975+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.103975+0000","last_undegraded":"2024-09-17T05:22:32.103975+0000","last_fullsized":"2024-09-17T05:22:32.103975+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.100213+0000","last_change":"2024-09-17T05:22:32.100213+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.100213+0000","last_undegraded":"2024-09-17T05:22:32.100213+0000","last_fullsized":"2024-09-17T05:22:32.100213+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:22:32.090862+0000","last_change":"2024-09-17T05:22:32.090862+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.090862+0000","last_undegraded":"2024-09-17T05:22:32.090862+0000","last_fullsized":"2024-09-17T05:22:32.090862+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.102694+0000","last_change":"2024-09-17T05:22:32.102694+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.102694+0000","last_undegraded":"2024-09-17T05:22:32.102694+0000","last_fullsized":"2024-09-17T05:22:32.102694+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.103820+0000","last_change":"2024-09-17T05:22:32.103820+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.103820+0000","last_undegraded":"2024-09-17T05:22:32.103820+0000","last_fullsized":"2024-09-17T05:22:32.103820+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.126132+0000","last_change":"2024-09-17T05:22:33.122187+0000","last_active":"2024-09-17T05:22:33.126132+0000","last_peered":"2024-09-17T05:22:33.126132+0000","last_clean":"2024-09-17T05:22:33.126132+0000","last_became_active":"2024-09-17T05:22:33.121907+0000","last_became_peered":"2024-09-17T05:22:33.121907+0000","last_unstale":"2024-09-17T05:22:33.126132+0000","last_undegraded":"2024-09-17T05:22:33.126132+0000","last_fullsized":"2024-09-17T05:22:33.126132+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:00:38.010787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.126610+0000","last_change":"2024-09-17T05:22:33.119051+0000","last_active":"2024-09-17T05:22:33.126610+0000","last_peered":"2024-09-17T05:22:33.126610+0000","last_clean":"2024-09-17T05:22:33.126610+0000","last_became_active":"2024-09-17T05:22:33.118758+0000","last_became_peered":"2024-09-17T05:22:33.118758+0000","last_unstale":"2024-09-17T05:22:33.126610+0000","last_undegraded":"2024-09-17T05:22:33.126610+0000","last_fullsized":"2024-09-17T05:22:33.126610+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:16:18.864713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.105887+0000","last_change":"2024-09-17T05:22:32.105887+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.105887+0000","last_undegraded":"2024-09-17T05:22:32.105887+0000","last_fullsized":"2024-09-17T05:22:32.105887+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.103203+0000","last_change":"2024-09-17T05:22:32.103203+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.103203+0000","last_undegraded":"2024-09-17T05:22:32.103203+0000","last_fullsized":"2024-09-17T05:22:32.103203+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.104894+0000","last_change":"2024-09-17T05:22:32.104894+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.104894+0000","last_undegraded":"2024-09-17T05:22:32.104894+0000","last_fullsized":"2024-09-17T05:22:32.104894+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.134490+0000","last_change":"2024-09-17T05:22:33.126595+0000","last_active":"2024-09-17T05:22:33.134490+0000","last_peered":"2024-09-17T05:22:33.134490+0000","last_clean":"2024-09-17T05:22:33.134490+0000","last_became_active":"2024-09-17T05:22:33.126328+0000","last_became_peered":"2024-09-17T05:22:33.126328+0000","last_unstale":"2024-09-17T05:22:33.134490+0000","last_undegraded":"2024-09-17T05:22:33.134490+0000","last_fullsized":"2024-09-17T05:22:33.134490+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:34:26.391003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.131795+0000","last_change":"2024-09-17T05:22:33.124786+0000","last_active":"2024-09-17T05:22:33.131795+0000","last_peered":"2024-09-17T05:22:33.131795+0000","last_clean":"2024-09-17T05:22:33.131795+0000","last_became_active":"2024-09-17T05:22:33.124527+0000","last_became_peered":"2024-09-17T05:22:33.124527+0000","last_unstale":"2024-09-17T05:22:33.131795+0000","last_undegraded":"2024-09-17T05:22:33.131795+0000","last_fullsized":"2024-09-17T05:22:33.131795+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:54:51.462172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.134408+0000","last_change":"2024-09-17T05:22:33.129657+0000","last_active":"2024-09-17T05:22:33.134408+0000","last_peered":"2024-09-17T05:22:33.134408+0000","last_clean":"2024-09-17T05:22:33.134408+0000","last_became_active":"2024-09-17T05:22:33.129360+0000","last_became_peered":"2024-09-17T05:22:33.129360+0000","last_unstale":"2024-09-17T05:22:33.134408+0000","last_undegraded":"2024-09-17T05:22:33.134408+0000","last_fullsized":"2024-09-17T05:22:33.134408+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:20.372997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.100812+0000","last_change":"2024-09-17T05:22:32.100812+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.100812+0000","last_undegraded":"2024-09-17T05:22:32.100812+0000","last_fullsized":"2024-09-17T05:22:32.100812+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.100516+0000","last_change":"2024-09-17T05:22:32.100516+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.100516+0000","last_undegraded":"2024-09-17T05:22:32.100516+0000","last_fullsized":"2024-09-17T05:22:32.100516+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.116601+0000","last_change":"2024-09-17T05:22:33.114614+0000","last_active":"2024-09-17T05:22:33.116601+0000","last_peered":"2024-09-17T05:22:33.116601+0000","last_clean":"2024-09-17T05:22:33.116601+0000","last_became_active":"2024-09-17T05:22:33.114367+0000","last_became_peered":"2024-09-17T05:22:33.114367+0000","last_unstale":"2024-09-17T05:22:33.116601+0000","last_undegraded":"2024-09-17T05:22:33.116601+0000","last_fullsized":"2024-09-17T05:22:33.116601+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:55:40.665695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.105440+0000","last_change":"2024-09-17T05:22:32.105440+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.105440+0000","last_undegraded":"2024-09-17T05:22:32.105440+0000","last_fullsized":"2024-09-17T05:22:32.105440+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:22:32.090862+0000","last_change":"2024-09-17T05:22:32.090862+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.090862+0000","last_undegraded":"2024-09-17T05:22:32.090862+0000","last_fullsized":"2024-09-17T05:22:32.090862+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.126512+0000","last_change":"2024-09-17T05:22:33.117947+0000","last_active":"2024-09-17T05:22:33.126512+0000","last_peered":"2024-09-17T05:22:33.126512+0000","last_clean":"2024-09-17T05:22:33.126512+0000","last_became_active":"2024-09-17T05:22:33.117035+0000","last_became_peered":"2024-09-17T05:22:33.117035+0000","last_unstale":"2024-09-17T05:22:33.126512+0000","last_undegraded":"2024-09-17T05:22:33.126512+0000","last_fullsized":"2024-09-17T05:22:33.126512+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:03:01.527461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:22:32.090862+0000","last_change":"2024-09-17T05:22:32.090862+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.090862+0000","last_undegraded":"2024-09-17T05:22:32.090862+0000","last_fullsized":"2024-09-17T05:22:32.090862+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.103312+0000","last_change":"2024-09-17T05:22:32.103312+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.103312+0000","last_undegraded":"2024-09-17T05:22:32.103312+0000","last_fullsized":"2024-09-17T05:22:32.103312+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.100364+0000","last_change":"2024-09-17T05:22:32.100364+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.100364+0000","last_undegraded":"2024-09-17T05:22:32.100364+0000","last_fullsized":"2024-09-17T05:22:32.100364+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.102243+0000","last_change":"2024-09-17T05:22:32.102243+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.102243+0000","last_undegraded":"2024-09-17T05:22:32.102243+0000","last_fullsized":"2024-09-17T05:22:32.102243+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.101675+0000","last_change":"2024-09-17T05:22:32.101675+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.101675+0000","last_undegraded":"2024-09-17T05:22:32.101675+0000","last_fullsized":"2024-09-17T05:22:32.101675+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.102712+0000","last_change":"2024-09-17T05:22:32.102712+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.102712+0000","last_undegraded":"2024-09-17T05:22:32.102712+0000","last_fullsized":"2024-09-17T05:22:32.102712+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.116637+0000","last_change":"2024-09-17T05:22:33.113816+0000","last_active":"2024-09-17T05:22:33.116637+0000","last_peered":"2024-09-17T05:22:33.116637+0000","last_clean":"2024-09-17T05:22:33.116637+0000","last_became_active":"2024-09-17T05:22:33.113489+0000","last_became_peered":"2024-09-17T05:22:33.113489+0000","last_unstale":"2024-09-17T05:22:33.116637+0000","last_undegraded":"2024-09-17T05:22:33.116637+0000","last_fullsized":"2024-09-17T05:22:33.116637+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:24:12.851750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:22:32.115027+0000","last_change":"2024-09-17T05:22:32.113612+0000","last_active":"2024-09-17T05:22:32.115027+0000","last_peered":"2024-09-17T05:22:32.115027+0000","last_clean":"2024-09-17T05:22:32.115027+0000","last_became_active":"2024-09-17T05:22:32.113283+0000","last_became_peered":"2024-09-17T05:22:32.113283+0000","last_unstale":"2024-09-17T05:22:32.115027+0000","last_undegraded":"2024-09-17T05:22:32.115027+0000","last_fullsized":"2024-09-17T05:22:32.115027+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:34:14.594010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.102140+0000","last_change":"2024-09-17T05:22:32.102140+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.102140+0000","last_undegraded":"2024-09-17T05:22:32.102140+0000","last_fullsized":"2024-09-17T05:22:32.102140+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.131245+0000","last_change":"2024-09-17T05:22:32.110226+0000","last_active":"2024-09-17T05:22:33.131245+0000","last_peered":"2024-09-17T05:22:33.131245+0000","last_clean":"2024-09-17T05:22:33.131245+0000","last_became_active":"2024-09-17T05:22:32.109954+0000","last_became_peered":"2024-09-17T05:22:32.109954+0000","last_unstale":"2024-09-17T05:22:33.131245+0000","last_undegraded":"2024-09-17T05:22:33.131245+0000","last_fullsized":"2024-09-17T05:22:33.131245+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:40.467869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.100405+0000","last_change":"2024-09-17T05:22:32.100405+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.100405+0000","last_undegraded":"2024-09-17T05:22:32.100405+0000","last_fullsized":"2024-09-17T05:22:32.100405+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.127957+0000","last_change":"2024-09-17T05:22:32.114627+0000","last_active":"2024-09-17T05:22:33.127957+0000","last_peered":"2024-09-17T05:22:33.127957+0000","last_clean":"2024-09-17T05:22:33.127957+0000","last_became_active":"2024-09-17T05:22:32.114380+0000","last_became_peered":"2024-09-17T05:22:32.114380+0000","last_unstale":"2024-09-17T05:22:33.127957+0000","last_undegraded":"2024-09-17T05:22:33.127957+0000","last_fullsized":"2024-09-17T05:22:33.127957+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:50:22.991581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:22:32.090862+0000","last_change":"2024-09-17T05:22:32.090862+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.090862+0000","last_undegraded":"2024-09-17T05:22:32.090862+0000","last_fullsized":"2024-09-17T05:22:32.090862+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.126216+0000","last_change":"2024-09-17T05:22:32.112558+0000","last_active":"2024-09-17T05:22:33.126216+0000","last_peered":"2024-09-17T05:22:33.126216+0000","last_clean":"2024-09-17T05:22:33.126216+0000","last_became_active":"2024-09-17T05:22:32.112226+0000","last_became_peered":"2024-09-17T05:22:32.112226+0000","last_unstale":"2024-09-17T05:22:33.126216+0000","last_undegraded":"2024-09-17T05:22:33.126216+0000","last_fullsized":"2024-09-17T05:22:33.126216+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:44.503659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.101721+0000","last_change":"2024-09-17T05:22:32.101721+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.101721+0000","last_undegraded":"2024-09-17T05:22:32.101721+0000","last_fullsized":"2024-09-17T05:22:32.101721+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:22:32.115807+0000","last_change":"2024-09-17T05:22:32.114701+0000","last_active":"2024-09-17T05:22:32.115807+0000","last_peered":"2024-09-17T05:22:32.115807+0000","last_clean":"2024-09-17T05:22:32.115807+0000","last_became_active":"2024-09-17T05:22:32.114418+0000","last_became_peered":"2024-09-17T05:22:32.114418+0000","last_unstale":"2024-09-17T05:22:32.115807+0000","last_undegraded":"2024-09-17T05:22:32.115807+0000","last_fullsized":"2024-09-17T05:22:32.115807+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:00:37.005942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.104951+0000","last_change":"2024-09-17T05:22:32.104951+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.104951+0000","last_undegraded":"2024-09-17T05:22:32.104951+0000","last_fullsized":"2024-09-17T05:22:32.104951+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:22:32.113826+0000","last_change":"2024-09-17T05:22:32.111748+0000","last_active":"2024-09-17T05:22:32.113826+0000","last_peered":"2024-09-17T05:22:32.113826+0000","last_clean":"2024-09-17T05:22:32.113826+0000","last_became_active":"2024-09-17T05:22:32.111430+0000","last_became_peered":"2024-09-17T05:22:32.111430+0000","last_unstale":"2024-09-17T05:22:32.113826+0000","last_undegraded":"2024-09-17T05:22:32.113826+0000","last_fullsized":"2024-09-17T05:22:32.113826+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:31.538467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.098828+0000","last_change":"2024-09-17T05:22:32.098828+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.098828+0000","last_undegraded":"2024-09-17T05:22:32.098828+0000","last_fullsized":"2024-09-17T05:22:32.098828+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.113493+0000","last_change":"2024-09-17T05:22:32.112680+0000","last_active":"2024-09-17T05:22:33.113493+0000","last_peered":"2024-09-17T05:22:33.113493+0000","last_clean":"2024-09-17T05:22:33.113493+0000","last_became_active":"2024-09-17T05:22:32.111854+0000","last_became_peered":"2024-09-17T05:22:32.111854+0000","last_unstale":"2024-09-17T05:22:33.113493+0000","last_undegraded":"2024-09-17T05:22:33.113493+0000","last_fullsized":"2024-09-17T05:22:33.113493+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:04:44.102722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:22:32.090862+0000","last_change":"2024-09-17T05:22:32.090862+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.090862+0000","last_undegraded":"2024-09-17T05:22:32.090862+0000","last_fullsized":"2024-09-17T05:22:32.090862+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:22:32.110438+0000","last_change":"2024-09-17T05:22:32.107007+0000","last_active":"2024-09-17T05:22:32.110438+0000","last_peered":"2024-09-17T05:22:32.110438+0000","last_clean":"2024-09-17T05:22:32.110438+0000","last_became_active":"2024-09-17T05:22:32.106728+0000","last_became_peered":"2024-09-17T05:22:32.106728+0000","last_unstale":"2024-09-17T05:22:32.110438+0000","last_undegraded":"2024-09-17T05:22:32.110438+0000","last_fullsized":"2024-09-17T05:22:32.110438+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:37.928289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.104338+0000","last_change":"2024-09-17T05:22:32.104338+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.104338+0000","last_undegraded":"2024-09-17T05:22:32.104338+0000","last_fullsized":"2024-09-17T05:22:32.104338+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.109645+0000","last_change":"2024-09-17T05:22:32.110685+0000","last_active":"2024-09-17T05:22:33.109645+0000","last_peered":"2024-09-17T05:22:33.109645+0000","last_clean":"2024-09-17T05:22:33.109645+0000","last_became_active":"2024-09-17T05:22:32.110434+0000","last_became_peered":"2024-09-17T05:22:32.110434+0000","last_unstale":"2024-09-17T05:22:33.109645+0000","last_undegraded":"2024-09-17T05:22:33.109645+0000","last_fullsized":"2024-09-17T05:22:33.109645+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:07:17.711718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.131828+0000","last_change":"2024-09-17T05:22:33.125565+0000","last_active":"2024-09-17T05:22:33.131828+0000","last_peered":"2024-09-17T05:22:33.131828+0000","last_clean":"2024-09-17T05:22:33.131828+0000","last_became_active":"2024-09-17T05:22:33.125307+0000","last_became_peered":"2024-09-17T05:22:33.125307+0000","last_unstale":"2024-09-17T05:22:33.131828+0000","last_undegraded":"2024-09-17T05:22:33.131828+0000","last_fullsized":"2024-09-17T05:22:33.131828+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:00:20.640357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.102748+0000","last_change":"2024-09-17T05:22:32.113885+0000","last_active":"2024-09-17T05:22:33.102748+0000","last_peered":"2024-09-17T05:22:33.102748+0000","last_clean":"2024-09-17T05:22:33.102748+0000","last_became_active":"2024-09-17T05:22:32.113348+0000","last_became_peered":"2024-09-17T05:22:32.113348+0000","last_unstale":"2024-09-17T05:22:33.102748+0000","last_undegraded":"2024-09-17T05:22:33.102748+0000","last_fullsized":"2024-09-17T05:22:33.102748+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:02:41.167223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.131890+0000","last_change":"2024-09-17T05:22:33.126125+0000","last_active":"2024-09-17T05:22:33.131890+0000","last_peered":"2024-09-17T05:22:33.131890+0000","last_clean":"2024-09-17T05:22:33.131890+0000","last_became_active":"2024-09-17T05:22:33.125624+0000","last_became_peered":"2024-09-17T05:22:33.125624+0000","last_unstale":"2024-09-17T05:22:33.131890+0000","last_undegraded":"2024-09-17T05:22:33.131890+0000","last_fullsized":"2024-09-17T05:22:33.131890+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:20:43.253271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:22:32.113210+0000","last_change":"2024-09-17T05:22:32.112204+0000","last_active":"2024-09-17T05:22:32.113210+0000","last_peered":"2024-09-17T05:22:32.113210+0000","last_clean":"2024-09-17T05:22:32.113210+0000","last_became_active":"2024-09-17T05:22:32.111922+0000","last_became_peered":"2024-09-17T05:22:32.111922+0000","last_unstale":"2024-09-17T05:22:32.113210+0000","last_undegraded":"2024-09-17T05:22:32.113210+0000","last_fullsized":"2024-09-17T05:22:32.113210+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:30:54.900213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.107714+0000","last_change":"2024-09-17T05:22:32.107714+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.107714+0000","last_undegraded":"2024-09-17T05:22:32.107714+0000","last_fullsized":"2024-09-17T05:22:32.107714+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.136195+0000","last_change":"2024-09-17T05:22:32.116128+0000","last_active":"2024-09-17T05:22:33.136195+0000","last_peered":"2024-09-17T05:22:33.136195+0000","last_clean":"2024-09-17T05:22:33.136195+0000","last_became_active":"2024-09-17T05:22:32.115820+0000","last_became_peered":"2024-09-17T05:22:32.115820+0000","last_unstale":"2024-09-17T05:22:33.136195+0000","last_undegraded":"2024-09-17T05:22:33.136195+0000","last_fullsized":"2024-09-17T05:22:33.136195+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:45:31.962824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:22:32.090862+0000","last_change":"2024-09-17T05:22:32.090862+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.090862+0000","last_undegraded":"2024-09-17T05:22:32.090862+0000","last_fullsized":"2024-09-17T05:22:32.090862+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:22:32.111457+0000","last_change":"2024-09-17T05:22:32.105639+0000","last_active":"2024-09-17T05:22:32.111457+0000","last_peered":"2024-09-17T05:22:32.111457+0000","last_clean":"2024-09-17T05:22:32.111457+0000","last_became_active":"2024-09-17T05:22:32.105366+0000","last_became_peered":"2024-09-17T05:22:32.105366+0000","last_unstale":"2024-09-17T05:22:32.111457+0000","last_undegraded":"2024-09-17T05:22:32.111457+0000","last_fullsized":"2024-09-17T05:22:32.111457+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:04.098750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.116301+0000","last_change":"2024-09-17T05:22:33.111017+0000","last_active":"2024-09-17T05:22:33.116301+0000","last_peered":"2024-09-17T05:22:33.116301+0000","last_clean":"2024-09-17T05:22:33.116301+0000","last_became_active":"2024-09-17T05:22:33.110671+0000","last_became_peered":"2024-09-17T05:22:33.110671+0000","last_unstale":"2024-09-17T05:22:33.116301+0000","last_undegraded":"2024-09-17T05:22:33.116301+0000","last_fullsized":"2024-09-17T05:22:33.116301+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:04:59.112204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-17T05:22:31.099354+0000","last_change":"2024-09-17T05:22:31.099354+0000","last_active":"2024-09-17T05:22:31.086017+0000","last_peered":"2024-09-17T05:22:31.086017+0000","last_clean":"2024-09-17T05:22:31.086017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:31.099354+0000","last_undegraded":"2024-09-17T05:22:31.099354+0000","last_fullsized":"2024-09-17T05:22:31.099354+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.101750+0000","last_change":"2024-09-17T05:22:32.101750+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.101750+0000","last_undegraded":"2024-09-17T05:22:32.101750+0000","last_fullsized":"2024-09-17T05:22:32.101750+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.115995+0000","last_change":"2024-09-17T05:22:32.111645+0000","last_active":"2024-09-17T05:22:33.115995+0000","last_peered":"2024-09-17T05:22:33.115995+0000","last_clean":"2024-09-17T05:22:33.115995+0000","last_became_active":"2024-09-17T05:22:32.111343+0000","last_became_peered":"2024-09-17T05:22:32.111343+0000","last_unstale":"2024-09-17T05:22:33.115995+0000","last_undegraded":"2024-09-17T05:22:33.115995+0000","last_fullsized":"2024-09-17T05:22:33.115995+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:44:35.681368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.101124+0000","last_change":"2024-09-17T05:22:32.101124+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.101124+0000","last_undegraded":"2024-09-17T05:22:32.101124+0000","last_fullsized":"2024-09-17T05:22:32.101124+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.132127+0000","last_change":"2024-09-17T05:22:32.112489+0000","last_active":"2024-09-17T05:22:33.132127+0000","last_peered":"2024-09-17T05:22:33.132127+0000","last_clean":"2024-09-17T05:22:33.132127+0000","last_became_active":"2024-09-17T05:22:32.112221+0000","last_became_peered":"2024-09-17T05:22:32.112221+0000","last_unstale":"2024-09-17T05:22:33.132127+0000","last_undegraded":"2024-09-17T05:22:33.132127+0000","last_fullsized":"2024-09-17T05:22:33.132127+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:14:17.389902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.099669+0000","last_change":"2024-09-17T05:22:32.099669+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.099669+0000","last_undegraded":"2024-09-17T05:22:32.099669+0000","last_fullsized":"2024-09-17T05:22:32.099669+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-17T05:22:31.099412+0000","last_change":"2024-09-17T05:22:31.099412+0000","last_active":"2024-09-17T05:22:31.086017+0000","last_peered":"2024-09-17T05:22:31.086017+0000","last_clean":"2024-09-17T05:22:31.086017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:31.099412+0000","last_undegraded":"2024-09-17T05:22:31.099412+0000","last_fullsized":"2024-09-17T05:22:31.099412+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.106749+0000","last_change":"2024-09-17T05:22:32.106749+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.106749+0000","last_undegraded":"2024-09-17T05:22:32.106749+0000","last_fullsized":"2024-09-17T05:22:32.106749+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:22:32.110402+0000","last_change":"2024-09-17T05:22:32.105623+0000","last_active":"2024-09-17T05:22:32.110402+0000","last_peered":"2024-09-17T05:22:32.110402+0000","last_clean":"2024-09-17T05:22:32.110402+0000","last_became_active":"2024-09-17T05:22:32.105328+0000","last_became_peered":"2024-09-17T05:22:32.105328+0000","last_unstale":"2024-09-17T05:22:32.110402+0000","last_undegraded":"2024-09-17T05:22:32.110402+0000","last_fullsized":"2024-09-17T05:22:32.110402+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:10.346686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:22:32.090862+0000","last_change":"2024-09-17T05:22:32.090862+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.090862+0000","last_undegraded":"2024-09-17T05:22:32.090862+0000","last_fullsized":"2024-09-17T05:22:32.090862+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:22:32.111111+0000","last_change":"2024-09-17T05:22:32.109272+0000","last_active":"2024-09-17T05:22:32.111111+0000","last_peered":"2024-09-17T05:22:32.111111+0000","last_clean":"2024-09-17T05:22:32.111111+0000","last_became_active":"2024-09-17T05:22:32.109013+0000","last_became_peered":"2024-09-17T05:22:32.109013+0000","last_unstale":"2024-09-17T05:22:32.111111+0000","last_undegraded":"2024-09-17T05:22:32.111111+0000","last_fullsized":"2024-09-17T05:22:32.111111+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:48.542813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.118374+0000","last_change":"2024-09-17T05:22:33.113978+0000","last_active":"2024-09-17T05:22:33.118374+0000","last_peered":"2024-09-17T05:22:33.118374+0000","last_clean":"2024-09-17T05:22:33.118374+0000","last_became_active":"2024-09-17T05:22:33.113492+0000","last_became_peered":"2024-09-17T05:22:33.113492+0000","last_unstale":"2024-09-17T05:22:33.118374+0000","last_undegraded":"2024-09-17T05:22:33.118374+0000","last_fullsized":"2024-09-17T05:22:33.118374+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:45:33.140357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:22:32.116497+0000","last_change":"2024-09-17T05:22:32.115027+0000","last_active":"2024-09-17T05:22:32.116497+0000","last_peered":"2024-09-17T05:22:32.116497+0000","last_clean":"2024-09-17T05:22:32.116497+0000","last_became_active":"2024-09-17T05:22:32.114435+0000","last_became_peered":"2024-09-17T05:22:32.114435+0000","last_unstale":"2024-09-17T05:22:32.116497+0000","last_undegraded":"2024-09-17T05:22:32.116497+0000","last_fullsized":"2024-09-17T05:22:32.116497+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:54:48.890240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.118065+0000","last_change":"2024-09-17T05:22:33.110478+0000","last_active":"2024-09-17T05:22:33.118065+0000","last_peered":"2024-09-17T05:22:33.118065+0000","last_clean":"2024-09-17T05:22:33.118065+0000","last_became_active":"2024-09-17T05:22:33.110196+0000","last_became_peered":"2024-09-17T05:22:33.110196+0000","last_unstale":"2024-09-17T05:22:33.118065+0000","last_undegraded":"2024-09-17T05:22:33.118065+0000","last_fullsized":"2024-09-17T05:22:33.118065+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:49.547658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.124641+0000","last_change":"2024-09-17T05:22:32.113308+0000","last_active":"2024-09-17T05:22:33.124641+0000","last_peered":"2024-09-17T05:22:33.124641+0000","last_clean":"2024-09-17T05:22:33.124641+0000","last_became_active":"2024-09-17T05:22:32.113050+0000","last_became_peered":"2024-09-17T05:22:32.113050+0000","last_unstale":"2024-09-17T05:22:33.124641+0000","last_undegraded":"2024-09-17T05:22:33.124641+0000","last_fullsized":"2024-09-17T05:22:33.124641+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:29:10.172995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.118345+0000","last_change":"2024-09-17T05:22:33.112503+0000","last_active":"2024-09-17T05:22:33.118345+0000","last_peered":"2024-09-17T05:22:33.118345+0000","last_clean":"2024-09-17T05:22:33.118345+0000","last_became_active":"2024-09-17T05:22:33.112236+0000","last_became_peered":"2024-09-17T05:22:33.112236+0000","last_unstale":"2024-09-17T05:22:33.118345+0000","last_undegraded":"2024-09-17T05:22:33.118345+0000","last_fullsized":"2024-09-17T05:22:33.118345+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:32.543311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:22:32.114344+0000","last_change":"2024-09-17T05:22:32.112694+0000","last_active":"2024-09-17T05:22:32.114344+0000","last_peered":"2024-09-17T05:22:32.114344+0000","last_clean":"2024-09-17T05:22:32.114344+0000","last_became_active":"2024-09-17T05:22:32.112438+0000","last_became_peered":"2024-09-17T05:22:32.112438+0000","last_unstale":"2024-09-17T05:22:32.114344+0000","last_undegraded":"2024-09-17T05:22:32.114344+0000","last_fullsized":"2024-09-17T05:22:32.114344+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:09:03.522949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.118145+0000","last_change":"2024-09-17T05:22:33.109656+0000","last_active":"2024-09-17T05:22:33.118145+0000","last_peered":"2024-09-17T05:22:33.118145+0000","last_clean":"2024-09-17T05:22:33.118145+0000","last_became_active":"2024-09-17T05:22:33.109356+0000","last_became_peered":"2024-09-17T05:22:33.109356+0000","last_unstale":"2024-09-17T05:22:33.118145+0000","last_undegraded":"2024-09-17T05:22:33.118145+0000","last_fullsized":"2024-09-17T05:22:33.118145+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:38.933134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:22:32.111144+0000","last_change":"2024-09-17T05:22:32.109644+0000","last_active":"2024-09-17T05:22:32.111144+0000","last_peered":"2024-09-17T05:22:32.111144+0000","last_clean":"2024-09-17T05:22:32.111144+0000","last_became_active":"2024-09-17T05:22:32.108599+0000","last_became_peered":"2024-09-17T05:22:32.108599+0000","last_unstale":"2024-09-17T05:22:32.111144+0000","last_undegraded":"2024-09-17T05:22:32.111144+0000","last_fullsized":"2024-09-17T05:22:32.111144+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:07.671241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.101599+0000","last_change":"2024-09-17T05:22:32.101599+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.101599+0000","last_undegraded":"2024-09-17T05:22:32.101599+0000","last_fullsized":"2024-09-17T05:22:32.101599+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:22:32.113819+0000","last_change":"2024-09-17T05:22:32.113056+0000","last_active":"2024-09-17T05:22:32.113819+0000","last_peered":"2024-09-17T05:22:32.113819+0000","last_clean":"2024-09-17T05:22:32.113819+0000","last_became_active":"2024-09-17T05:22:32.112769+0000","last_became_peered":"2024-09-17T05:22:32.112769+0000","last_unstale":"2024-09-17T05:22:32.113819+0000","last_undegraded":"2024-09-17T05:22:32.113819+0000","last_fullsized":"2024-09-17T05:22:32.113819+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:02:19.357061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.128853+0000","last_change":"2024-09-17T05:22:33.127577+0000","last_active":"2024-09-17T05:22:33.128853+0000","last_peered":"2024-09-17T05:22:33.128853+0000","last_clean":"2024-09-17T05:22:33.128853+0000","last_became_active":"2024-09-17T05:22:33.127321+0000","last_became_peered":"2024-09-17T05:22:33.127321+0000","last_unstale":"2024-09-17T05:22:33.128853+0000","last_undegraded":"2024-09-17T05:22:33.128853+0000","last_fullsized":"2024-09-17T05:22:33.128853+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:54:49.895084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-17T05:22:31.098954+0000","last_change":"2024-09-17T05:22:31.098954+0000","last_active":"2024-09-17T05:22:31.086017+0000","last_peered":"2024-09-17T05:22:31.086017+0000","last_clean":"2024-09-17T05:22:31.086017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:31.098954+0000","last_undegraded":"2024-09-17T05:22:31.098954+0000","last_fullsized":"2024-09-17T05:22:31.098954+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.106313+0000","last_change":"2024-09-17T05:22:32.106313+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.106313+0000","last_undegraded":"2024-09-17T05:22:32.106313+0000","last_fullsized":"2024-09-17T05:22:32.106313+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.102870+0000","last_change":"2024-09-17T05:22:32.113614+0000","last_active":"2024-09-17T05:22:33.102870+0000","last_peered":"2024-09-17T05:22:33.102870+0000","last_clean":"2024-09-17T05:22:33.102870+0000","last_became_active":"2024-09-17T05:22:32.113005+0000","last_became_peered":"2024-09-17T05:22:32.113005+0000","last_unstale":"2024-09-17T05:22:33.102870+0000","last_undegraded":"2024-09-17T05:22:33.102870+0000","last_fullsized":"2024-09-17T05:22:33.102870+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:35.883658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.126536+0000","last_change":"2024-09-17T05:22:33.123577+0000","last_active":"2024-09-17T05:22:33.126536+0000","last_peered":"2024-09-17T05:22:33.126536+0000","last_clean":"2024-09-17T05:22:33.126536+0000","last_became_active":"2024-09-17T05:22:33.123017+0000","last_became_peered":"2024-09-17T05:22:33.123017+0000","last_unstale":"2024-09-17T05:22:33.126536+0000","last_undegraded":"2024-09-17T05:22:33.126536+0000","last_fullsized":"2024-09-17T05:22:33.126536+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:32.109566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-17T05:22:31.099095+0000","last_change":"2024-09-17T05:22:31.099095+0000","last_active":"2024-09-17T05:22:31.086017+0000","last_peered":"2024-09-17T05:22:31.086017+0000","last_clean":"2024-09-17T05:22:31.086017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:31.099095+0000","last_undegraded":"2024-09-17T05:22:31.099095+0000","last_fullsized":"2024-09-17T05:22:31.099095+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.102446+0000","last_change":"2024-09-17T05:22:32.102446+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.102446+0000","last_undegraded":"2024-09-17T05:22:32.102446+0000","last_fullsized":"2024-09-17T05:22:32.102446+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.102793+0000","last_change":"2024-09-17T05:22:32.114729+0000","last_active":"2024-09-17T05:22:33.102793+0000","last_peered":"2024-09-17T05:22:33.102793+0000","last_clean":"2024-09-17T05:22:33.102793+0000","last_became_active":"2024-09-17T05:22:32.113768+0000","last_became_peered":"2024-09-17T05:22:32.113768+0000","last_unstale":"2024-09-17T05:22:33.102793+0000","last_undegraded":"2024-09-17T05:22:33.102793+0000","last_fullsized":"2024-09-17T05:22:33.102793+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:26.320381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.115791+0000","last_change":"2024-09-17T05:22:33.110012+0000","last_active":"2024-09-17T05:22:33.115791+0000","last_peered":"2024-09-17T05:22:33.115791+0000","last_clean":"2024-09-17T05:22:33.115791+0000","last_became_active":"2024-09-17T05:22:33.109695+0000","last_became_peered":"2024-09-17T05:22:33.109695+0000","last_unstale":"2024-09-17T05:22:33.115791+0000","last_undegraded":"2024-09-17T05:22:33.115791+0000","last_fullsized":"2024-09-17T05:22:33.115791+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:29.107242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-17T05:22:31.098914+0000","last_change":"2024-09-17T05:22:31.098914+0000","last_active":"2024-09-17T05:22:31.086017+0000","last_peered":"2024-09-17T05:22:31.086017+0000","last_clean":"2024-09-17T05:22:31.086017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:31.098914+0000","last_undegraded":"2024-09-17T05:22:31.098914+0000","last_fullsized":"2024-09-17T05:22:31.098914+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.132164+0000","last_change":"2024-09-17T05:22:33.125596+0000","last_active":"2024-09-17T05:22:33.132164+0000","last_peered":"2024-09-17T05:22:33.132164+0000","last_clean":"2024-09-17T05:22:33.132164+0000","last_became_active":"2024-09-17T05:22:33.125320+0000","last_became_peered":"2024-09-17T05:22:33.125320+0000","last_unstale":"2024-09-17T05:22:33.132164+0000","last_undegraded":"2024-09-17T05:22:33.132164+0000","last_fullsized":"2024-09-17T05:22:33.132164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:14:03.413516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:22:32.113967+0000","last_change":"2024-09-17T05:22:32.112210+0000","last_active":"2024-09-17T05:22:32.113967+0000","last_peered":"2024-09-17T05:22:32.113967+0000","last_clean":"2024-09-17T05:22:32.113967+0000","last_became_active":"2024-09-17T05:22:32.111748+0000","last_became_peered":"2024-09-17T05:22:32.111748+0000","last_unstale":"2024-09-17T05:22:32.113967+0000","last_undegraded":"2024-09-17T05:22:32.113967+0000","last_fullsized":"2024-09-17T05:22:32.113967+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:45:32.135513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.099530+0000","last_change":"2024-09-17T05:22:32.099530+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.099530+0000","last_undegraded":"2024-09-17T05:22:32.099530+0000","last_fullsized":"2024-09-17T05:22:32.099530+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.112366+0000","last_change":"2024-09-17T05:22:32.111929+0000","last_active":"2024-09-17T05:22:33.112366+0000","last_peered":"2024-09-17T05:22:33.112366+0000","last_clean":"2024-09-17T05:22:33.112366+0000","last_became_active":"2024-09-17T05:22:32.111570+0000","last_became_peered":"2024-09-17T05:22:32.111570+0000","last_unstale":"2024-09-17T05:22:33.112366+0000","last_undegraded":"2024-09-17T05:22:33.112366+0000","last_fullsized":"2024-09-17T05:22:33.112366+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:07:58.877603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.100898+0000","last_change":"2024-09-17T05:22:32.100898+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.100898+0000","last_undegraded":"2024-09-17T05:22:32.100898+0000","last_fullsized":"2024-09-17T05:22:32.100898+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:22:32.113694+0000","last_change":"2024-09-17T05:22:32.112360+0000","last_active":"2024-09-17T05:22:32.113694+0000","last_peered":"2024-09-17T05:22:32.113694+0000","last_clean":"2024-09-17T05:22:32.113694+0000","last_became_active":"2024-09-17T05:22:32.112001+0000","last_became_peered":"2024-09-17T05:22:32.112001+0000","last_unstale":"2024-09-17T05:22:32.113694+0000","last_undegraded":"2024-09-17T05:22:32.113694+0000","last_fullsized":"2024-09-17T05:22:32.113694+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:53:37.577343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":127,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:22:32.097806+0000","last_change":"2024-09-17T05:21:44.086098+0000","last_active":"2024-09-17T05:22:32.097806+0000","last_peered":"2024-09-17T05:22:32.097806+0000","last_clean":"2024-09-17T05:22:32.097806+0000","last_became_active":"2024-09-17T05:21:44.083477+0000","last_became_peered":"2024-09-17T05:21:44.083477+0000","last_unstale":"2024-09-17T05:22:32.097806+0000","last_undegraded":"2024-09-17T05:22:32.097806+0000","last_fullsized":"2024-09-17T05:22:32.097806+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:42.925756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:42.925756+0000","last_clean_scrub_stamp":"2024-09-17T05:21:42.925756+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:11.410250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":112,"acting":112,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1612,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21,"ondisk_log_size":21,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":327680,"data_stored":123498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509455,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":327680,"data_stored":123498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509455,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":921600,"data_stored":713866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542157,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":909312,"data_stored":707599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542157,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":327680,"data_stored":123498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542158,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":315392,"data_stored":117231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542158,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":315392,"data_stored":117231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":315392,"data_stored":117231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:22:36.084 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:22:36.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.220+0000 7fed52aa9640 1 -- 172.21.15.98:0/250724678 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed4c0ccfd0 msgr2=0x7fed4c0730b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:36.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.220+0000 7fed52aa9640 1 --2- 172.21.15.98:0/250724678 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed4c0ccfd0 0x7fed4c0730b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fed44009ca0 tx=0x7fed4402aac0 comp rx=0 tx=0).stop 2024-09-17T05:22:36.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.220+0000 7fed52aa9640 1 -- 172.21.15.98:0/250724678 shutdown_connections 2024-09-17T05:22:36.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.220+0000 7fed52aa9640 1 --2- 172.21.15.98:0/250724678 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed4c0ccfd0 0x7fed4c0730b0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:36.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.220+0000 7fed52aa9640 1 -- 172.21.15.98:0/250724678 >> 172.21.15.98:0/250724678 conn(0x7fed4c0b1950 msgr2=0x7fed4c0b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:36.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.220+0000 7fed52aa9640 1 -- 172.21.15.98:0/250724678 shutdown_connections 2024-09-17T05:22:36.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.220+0000 7fed52aa9640 1 -- 172.21.15.98:0/250724678 wait complete. 2024-09-17T05:22:36.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.221+0000 7fed52aa9640 1 Processor -- start 2024-09-17T05:22:36.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.221+0000 7fed52aa9640 1 -- start start 2024-09-17T05:22:36.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.222+0000 7fed52aa9640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed4c0ccfd0 0x7fed4c1524f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:36.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.222+0000 7fed52aa9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed4c0cf300 0x7fed4c1f8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:36.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.222+0000 7fed52aa9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed4c1445d0 0x7fed4c15e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:36.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.222+0000 7fed52aa9640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fed4c0735f0 con 0x7fed4c1445d0 2024-09-17T05:22:36.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.222+0000 7fed52aa9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fed4c0b4f70 con 0x7fed4c0cf300 2024-09-17T05:22:36.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.222+0000 7fed52aa9640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fed4c073770 con 0x7fed4c0ccfd0 2024-09-17T05:22:36.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.222+0000 7fed51046640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed4c1445d0 0x7fed4c15e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:36.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.222+0000 7fed51046640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed4c1445d0 0x7fed4c15e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56806/0 (socket says 172.21.15.98:56806) 2024-09-17T05:22:36.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.222+0000 7fed51046640 1 -- 172.21.15.98:0/2844147419 learned_addr learned my addr 172.21.15.98:0/2844147419 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:36.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.222+0000 7fed50845640 1 --2- 172.21.15.98:0/2844147419 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed4c0ccfd0 0x7fed4c1524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:36.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.222+0000 7fed43fff640 1 --2- 172.21.15.98:0/2844147419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed4c0cf300 0x7fed4c1f8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:36.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.222+0000 7fed51046640 1 -- 172.21.15.98:0/2844147419 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed4c0ccfd0 msgr2=0x7fed4c1524f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:36.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.222+0000 7fed51046640 1 --2- 172.21.15.98:0/2844147419 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed4c0ccfd0 0x7fed4c1524f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:36.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.222+0000 7fed51046640 1 -- 172.21.15.98:0/2844147419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed4c0cf300 msgr2=0x7fed4c1f8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:36.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.222+0000 7fed51046640 1 --2- 172.21.15.98:0/2844147419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed4c0cf300 0x7fed4c1f8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:36.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.222+0000 7fed51046640 1 -- 172.21.15.98:0/2844147419 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed4c152a30 con 0x7fed4c1445d0 2024-09-17T05:22:36.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.222+0000 7fed43fff640 1 --2- 172.21.15.98:0/2844147419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed4c0cf300 0x7fed4c1f8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:22:36.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.222+0000 7fed51046640 1 --2- 172.21.15.98:0/2844147419 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed4c1445d0 0x7fed4c15e4b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fed44006010 tx=0x7fed44003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:36.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.222+0000 7fed417fa640 1 -- 172.21.15.98:0/2844147419 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed44046070 con 0x7fed4c1445d0 2024-09-17T05:22:36.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.222+0000 7fed417fa640 1 -- 172.21.15.98:0/2844147419 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fed44004250 con 0x7fed4c1445d0 2024-09-17T05:22:36.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.222+0000 7fed52aa9640 1 -- 172.21.15.98:0/2844147419 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed4c1e49c0 con 0x7fed4c1445d0 2024-09-17T05:22:36.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.223+0000 7fed417fa640 1 -- 172.21.15.98:0/2844147419 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed44004680 con 0x7fed4c1445d0 2024-09-17T05:22:36.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.223+0000 7fed52aa9640 1 -- 172.21.15.98:0/2844147419 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed4c09be40 con 0x7fed4c1445d0 2024-09-17T05:22:36.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.224+0000 7fed52aa9640 1 -- 172.21.15.98:0/2844147419 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed4c073be0 con 0x7fed4c1445d0 2024-09-17T05:22:36.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.224+0000 7fed417fa640 1 -- 172.21.15.98:0/2844147419 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fed44049070 con 0x7fed4c1445d0 2024-09-17T05:22:36.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.224+0000 7fed417fa640 1 --2- 172.21.15.98:0/2844147419 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fed38078b90 0x7fed3807b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:36.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.225+0000 7fed417fa640 1 -- 172.21.15.98:0/2844147419 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fed440bbb00 con 0x7fed4c1445d0 2024-09-17T05:22:36.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.225+0000 7fed50845640 1 --2- 172.21.15.98:0/2844147419 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fed38078b90 0x7fed3807b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:36.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.225+0000 7fed50845640 1 --2- 172.21.15.98:0/2844147419 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fed38078b90 0x7fed3807b050 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fed48006fd0 tx=0x7fed48008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:36.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.229+0000 7fed417fa640 1 -- 172.21.15.98:0/2844147419 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fed4c152a30 con 0x7fed4c1445d0 2024-09-17T05:22:36.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.401+0000 7fed52aa9640 1 -- 172.21.15.98:0/2844147419 --> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fed4c09c080 con 0x7fed38078b90 2024-09-17T05:22:36.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.406+0000 7fed417fa640 1 -- 172.21.15.98:0/2844147419 <== mgr.4103 v2:172.21.15.167:6800/610796449 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247577 (secure 0 0 0) 0x7fed4800be30 con 0x7fed38078b90 2024-09-17T05:22:36.409 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:22:36.410 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-17T05:22:36.412 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.409+0000 7fed52aa9640 1 -- 172.21.15.98:0/2844147419 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fed38078b90 msgr2=0x7fed3807b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:36.412 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.409+0000 7fed52aa9640 1 --2- 172.21.15.98:0/2844147419 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fed38078b90 0x7fed3807b050 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fed48006fd0 tx=0x7fed48008040 comp rx=0 tx=0).stop 2024-09-17T05:22:36.413 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.409+0000 7fed52aa9640 1 -- 172.21.15.98:0/2844147419 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed4c1445d0 msgr2=0x7fed4c15e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:36.413 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.409+0000 7fed52aa9640 1 --2- 172.21.15.98:0/2844147419 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed4c1445d0 0x7fed4c15e4b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fed44006010 tx=0x7fed44003f10 comp rx=0 tx=0).stop 2024-09-17T05:22:36.413 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.409+0000 7fed52aa9640 1 -- 172.21.15.98:0/2844147419 shutdown_connections 2024-09-17T05:22:36.413 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.409+0000 7fed52aa9640 1 --2- 172.21.15.98:0/2844147419 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fed38078b90 0x7fed3807b050 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:36.413 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.409+0000 7fed52aa9640 1 --2- 172.21.15.98:0/2844147419 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed4c1445d0 0x7fed4c15e4b0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:36.413 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.409+0000 7fed52aa9640 1 --2- 172.21.15.98:0/2844147419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed4c0cf300 0x7fed4c1f8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:36.413 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.409+0000 7fed52aa9640 1 --2- 172.21.15.98:0/2844147419 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed4c0ccfd0 0x7fed4c1524f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:36.413 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.409+0000 7fed52aa9640 1 -- 172.21.15.98:0/2844147419 >> 172.21.15.98:0/2844147419 conn(0x7fed4c0b1950 msgr2=0x7fed4c0aed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:36.414 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.409+0000 7fed52aa9640 1 -- 172.21.15.98:0/2844147419 shutdown_connections 2024-09-17T05:22:36.414 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.409+0000 7fed52aa9640 1 -- 172.21.15.98:0/2844147419 wait complete. 2024-09-17T05:22:36.420 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2024-09-17T05:22:36.256613+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591980,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":126,"num_write_kb":1631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":93,"ondisk_log_size":93,"up":178,"acting":178,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":37,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224068,"kb_used_data":3672,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750652,"statfs":{"total":773094113280,"available":772864667648,"internally_reserved":0,"allocated":3760128,"data_stored":2143652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1612,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.158226"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.103573+0000","last_change":"2024-09-17T05:22:32.103573+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.103573+0000","last_undegraded":"2024-09-17T05:22:32.103573+0000","last_fullsized":"2024-09-17T05:22:32.103573+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.126491+0000","last_change":"2024-09-17T05:22:33.116777+0000","last_active":"2024-09-17T05:22:33.126491+0000","last_peered":"2024-09-17T05:22:33.126491+0000","last_clean":"2024-09-17T05:22:33.126491+0000","last_became_active":"2024-09-17T05:22:33.116516+0000","last_became_peered":"2024-09-17T05:22:33.116516+0000","last_unstale":"2024-09-17T05:22:33.126491+0000","last_undegraded":"2024-09-17T05:22:33.126491+0000","last_fullsized":"2024-09-17T05:22:33.126491+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:11:33.740686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.107279+0000","last_change":"2024-09-17T05:22:32.107279+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.107279+0000","last_undegraded":"2024-09-17T05:22:32.107279+0000","last_fullsized":"2024-09-17T05:22:32.107279+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:22:32.090862+0000","last_change":"2024-09-17T05:22:32.090862+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.090862+0000","last_undegraded":"2024-09-17T05:22:32.090862+0000","last_fullsized":"2024-09-17T05:22:32.090862+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.118319+0000","last_change":"2024-09-17T05:22:33.111841+0000","last_active":"2024-09-17T05:22:33.118319+0000","last_peered":"2024-09-17T05:22:33.118319+0000","last_clean":"2024-09-17T05:22:33.118319+0000","last_became_active":"2024-09-17T05:22:33.111527+0000","last_became_peered":"2024-09-17T05:22:33.111527+0000","last_unstale":"2024-09-17T05:22:33.118319+0000","last_undegraded":"2024-09-17T05:22:33.118319+0000","last_fullsized":"2024-09-17T05:22:33.118319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:08.676086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.134538+0000","last_change":"2024-09-17T05:22:33.129531+0000","last_active":"2024-09-17T05:22:33.134538+0000","last_peered":"2024-09-17T05:22:33.134538+0000","last_clean":"2024-09-17T05:22:33.134538+0000","last_became_active":"2024-09-17T05:22:33.129298+0000","last_became_peered":"2024-09-17T05:22:33.129298+0000","last_unstale":"2024-09-17T05:22:33.134538+0000","last_undegraded":"2024-09-17T05:22:33.134538+0000","last_fullsized":"2024-09-17T05:22:33.134538+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:24:49.441913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.104413+0000","last_change":"2024-09-17T05:22:32.104413+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.104413+0000","last_undegraded":"2024-09-17T05:22:32.104413+0000","last_fullsized":"2024-09-17T05:22:32.104413+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.103975+0000","last_change":"2024-09-17T05:22:32.103975+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.103975+0000","last_undegraded":"2024-09-17T05:22:32.103975+0000","last_fullsized":"2024-09-17T05:22:32.103975+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.100213+0000","last_change":"2024-09-17T05:22:32.100213+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.100213+0000","last_undegraded":"2024-09-17T05:22:32.100213+0000","last_fullsized":"2024-09-17T05:22:32.100213+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:22:32.090862+0000","last_change":"2024-09-17T05:22:32.090862+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.090862+0000","last_undegraded":"2024-09-17T05:22:32.090862+0000","last_fullsized":"2024-09-17T05:22:32.090862+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.102694+0000","last_change":"2024-09-17T05:22:32.102694+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.102694+0000","last_undegraded":"2024-09-17T05:22:32.102694+0000","last_fullsized":"2024-09-17T05:22:32.102694+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.103820+0000","last_change":"2024-09-17T05:22:32.103820+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.103820+0000","last_undegraded":"2024-09-17T05:22:32.103820+0000","last_fullsized":"2024-09-17T05:22:32.103820+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.126132+0000","last_change":"2024-09-17T05:22:33.122187+0000","last_active":"2024-09-17T05:22:33.126132+0000","last_peered":"2024-09-17T05:22:33.126132+0000","last_clean":"2024-09-17T05:22:33.126132+0000","last_became_active":"2024-09-17T05:22:33.121907+0000","last_became_peered":"2024-09-17T05:22:33.121907+0000","last_unstale":"2024-09-17T05:22:33.126132+0000","last_undegraded":"2024-09-17T05:22:33.126132+0000","last_fullsized":"2024-09-17T05:22:33.126132+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:00:38.010787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.126610+0000","last_change":"2024-09-17T05:22:33.119051+0000","last_active":"2024-09-17T05:22:33.126610+0000","last_peered":"2024-09-17T05:22:33.126610+0000","last_clean":"2024-09-17T05:22:33.126610+0000","last_became_active":"2024-09-17T05:22:33.118758+0000","last_became_peered":"2024-09-17T05:22:33.118758+0000","last_unstale":"2024-09-17T05:22:33.126610+0000","last_undegraded":"2024-09-17T05:22:33.126610+0000","last_fullsized":"2024-09-17T05:22:33.126610+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:16:18.864713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.105887+0000","last_change":"2024-09-17T05:22:32.105887+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.105887+0000","last_undegraded":"2024-09-17T05:22:32.105887+0000","last_fullsized":"2024-09-17T05:22:32.105887+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.103203+0000","last_change":"2024-09-17T05:22:32.103203+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.103203+0000","last_undegraded":"2024-09-17T05:22:32.103203+0000","last_fullsized":"2024-09-17T05:22:32.103203+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.104894+0000","last_change":"2024-09-17T05:22:32.104894+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.104894+0000","last_undegraded":"2024-09-17T05:22:32.104894+0000","last_fullsized":"2024-09-17T05:22:32.104894+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.134490+0000","last_change":"2024-09-17T05:22:33.126595+0000","last_active":"2024-09-17T05:22:33.134490+0000","last_peered":"2024-09-17T05:22:33.134490+0000","last_clean":"2024-09-17T05:22:33.134490+0000","last_became_active":"2024-09-17T05:22:33.126328+0000","last_became_peered":"2024-09-17T05:22:33.126328+0000","last_unstale":"2024-09-17T05:22:33.134490+0000","last_undegraded":"2024-09-17T05:22:33.134490+0000","last_fullsized":"2024-09-17T05:22:33.134490+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:34:26.391003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.131795+0000","last_change":"2024-09-17T05:22:33.124786+0000","last_active":"2024-09-17T05:22:33.131795+0000","last_peered":"2024-09-17T05:22:33.131795+0000","last_clean":"2024-09-17T05:22:33.131795+0000","last_became_active":"2024-09-17T05:22:33.124527+0000","last_became_peered":"2024-09-17T05:22:33.124527+0000","last_unstale":"2024-09-17T05:22:33.131795+0000","last_undegraded":"2024-09-17T05:22:33.131795+0000","last_fullsized":"2024-09-17T05:22:33.131795+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:54:51.462172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.134408+0000","last_change":"2024-09-17T05:22:33.129657+0000","last_active":"2024-09-17T05:22:33.134408+0000","last_peered":"2024-09-17T05:22:33.134408+0000","last_clean":"2024-09-17T05:22:33.134408+0000","last_became_active":"2024-09-17T05:22:33.129360+0000","last_became_peered":"2024-09-17T05:22:33.129360+0000","last_unstale":"2024-09-17T05:22:33.134408+0000","last_undegraded":"2024-09-17T05:22:33.134408+0000","last_fullsized":"2024-09-17T05:22:33.134408+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:20.372997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.100812+0000","last_change":"2024-09-17T05:22:32.100812+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.100812+0000","last_undegraded":"2024-09-17T05:22:32.100812+0000","last_fullsized":"2024-09-17T05:22:32.100812+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.100516+0000","last_change":"2024-09-17T05:22:32.100516+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.100516+0000","last_undegraded":"2024-09-17T05:22:32.100516+0000","last_fullsized":"2024-09-17T05:22:32.100516+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.116601+0000","last_change":"2024-09-17T05:22:33.114614+0000","last_active":"2024-09-17T05:22:33.116601+0000","last_peered":"2024-09-17T05:22:33.116601+0000","last_clean":"2024-09-17T05:22:33.116601+0000","last_became_active":"2024-09-17T05:22:33.114367+0000","last_became_peered":"2024-09-17T05:22:33.114367+0000","last_unstale":"2024-09-17T05:22:33.116601+0000","last_undegraded":"2024-09-17T05:22:33.116601+0000","last_fullsized":"2024-09-17T05:22:33.116601+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:55:40.665695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.105440+0000","last_change":"2024-09-17T05:22:32.105440+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.105440+0000","last_undegraded":"2024-09-17T05:22:32.105440+0000","last_fullsized":"2024-09-17T05:22:32.105440+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:22:32.090862+0000","last_change":"2024-09-17T05:22:32.090862+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.090862+0000","last_undegraded":"2024-09-17T05:22:32.090862+0000","last_fullsized":"2024-09-17T05:22:32.090862+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.126512+0000","last_change":"2024-09-17T05:22:33.117947+0000","last_active":"2024-09-17T05:22:33.126512+0000","last_peered":"2024-09-17T05:22:33.126512+0000","last_clean":"2024-09-17T05:22:33.126512+0000","last_became_active":"2024-09-17T05:22:33.117035+0000","last_became_peered":"2024-09-17T05:22:33.117035+0000","last_unstale":"2024-09-17T05:22:33.126512+0000","last_undegraded":"2024-09-17T05:22:33.126512+0000","last_fullsized":"2024-09-17T05:22:33.126512+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:03:01.527461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:22:32.090862+0000","last_change":"2024-09-17T05:22:32.090862+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.090862+0000","last_undegraded":"2024-09-17T05:22:32.090862+0000","last_fullsized":"2024-09-17T05:22:32.090862+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.103312+0000","last_change":"2024-09-17T05:22:32.103312+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.103312+0000","last_undegraded":"2024-09-17T05:22:32.103312+0000","last_fullsized":"2024-09-17T05:22:32.103312+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.100364+0000","last_change":"2024-09-17T05:22:32.100364+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.100364+0000","last_undegraded":"2024-09-17T05:22:32.100364+0000","last_fullsized":"2024-09-17T05:22:32.100364+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.102243+0000","last_change":"2024-09-17T05:22:32.102243+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.102243+0000","last_undegraded":"2024-09-17T05:22:32.102243+0000","last_fullsized":"2024-09-17T05:22:32.102243+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.101675+0000","last_change":"2024-09-17T05:22:32.101675+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.101675+0000","last_undegraded":"2024-09-17T05:22:32.101675+0000","last_fullsized":"2024-09-17T05:22:32.101675+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.102712+0000","last_change":"2024-09-17T05:22:32.102712+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.102712+0000","last_undegraded":"2024-09-17T05:22:32.102712+0000","last_fullsized":"2024-09-17T05:22:32.102712+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.116637+0000","last_change":"2024-09-17T05:22:33.113816+0000","last_active":"2024-09-17T05:22:33.116637+0000","last_peered":"2024-09-17T05:22:33.116637+0000","last_clean":"2024-09-17T05:22:33.116637+0000","last_became_active":"2024-09-17T05:22:33.113489+0000","last_became_peered":"2024-09-17T05:22:33.113489+0000","last_unstale":"2024-09-17T05:22:33.116637+0000","last_undegraded":"2024-09-17T05:22:33.116637+0000","last_fullsized":"2024-09-17T05:22:33.116637+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:24:12.851750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:22:32.115027+0000","last_change":"2024-09-17T05:22:32.113612+0000","last_active":"2024-09-17T05:22:32.115027+0000","last_peered":"2024-09-17T05:22:32.115027+0000","last_clean":"2024-09-17T05:22:32.115027+0000","last_became_active":"2024-09-17T05:22:32.113283+0000","last_became_peered":"2024-09-17T05:22:32.113283+0000","last_unstale":"2024-09-17T05:22:32.115027+0000","last_undegraded":"2024-09-17T05:22:32.115027+0000","last_fullsized":"2024-09-17T05:22:32.115027+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:34:14.594010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.102140+0000","last_change":"2024-09-17T05:22:32.102140+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.102140+0000","last_undegraded":"2024-09-17T05:22:32.102140+0000","last_fullsized":"2024-09-17T05:22:32.102140+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.131245+0000","last_change":"2024-09-17T05:22:32.110226+0000","last_active":"2024-09-17T05:22:33.131245+0000","last_peered":"2024-09-17T05:22:33.131245+0000","last_clean":"2024-09-17T05:22:33.131245+0000","last_became_active":"2024-09-17T05:22:32.109954+0000","last_became_peered":"2024-09-17T05:22:32.109954+0000","last_unstale":"2024-09-17T05:22:33.131245+0000","last_undegraded":"2024-09-17T05:22:33.131245+0000","last_fullsized":"2024-09-17T05:22:33.131245+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:40.467869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.100405+0000","last_change":"2024-09-17T05:22:32.100405+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.100405+0000","last_undegraded":"2024-09-17T05:22:32.100405+0000","last_fullsized":"2024-09-17T05:22:32.100405+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.127957+0000","last_change":"2024-09-17T05:22:32.114627+0000","last_active":"2024-09-17T05:22:33.127957+0000","last_peered":"2024-09-17T05:22:33.127957+0000","last_clean":"2024-09-17T05:22:33.127957+0000","last_became_active":"2024-09-17T05:22:32.114380+0000","last_became_peered":"2024-09-17T05:22:32.114380+0000","last_unstale":"2024-09-17T05:22:33.127957+0000","last_undegraded":"2024-09-17T05:22:33.127957+0000","last_fullsized":"2024-09-17T05:22:33.127957+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:50:22.991581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:22:32.090862+0000","last_change":"2024-09-17T05:22:32.090862+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.090862+0000","last_undegraded":"2024-09-17T05:22:32.090862+0000","last_fullsized":"2024-09-17T05:22:32.090862+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.126216+0000","last_change":"2024-09-17T05:22:32.112558+0000","last_active":"2024-09-17T05:22:33.126216+0000","last_peered":"2024-09-17T05:22:33.126216+0000","last_clean":"2024-09-17T05:22:33.126216+0000","last_became_active":"2024-09-17T05:22:32.112226+0000","last_became_peered":"2024-09-17T05:22:32.112226+0000","last_unstale":"2024-09-17T05:22:33.126216+0000","last_undegraded":"2024-09-17T05:22:33.126216+0000","last_fullsized":"2024-09-17T05:22:33.126216+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:44.503659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.101721+0000","last_change":"2024-09-17T05:22:32.101721+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.101721+0000","last_undegraded":"2024-09-17T05:22:32.101721+0000","last_fullsized":"2024-09-17T05:22:32.101721+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:22:32.115807+0000","last_change":"2024-09-17T05:22:32.114701+0000","last_active":"2024-09-17T05:22:32.115807+0000","last_peered":"2024-09-17T05:22:32.115807+0000","last_clean":"2024-09-17T05:22:32.115807+0000","last_became_active":"2024-09-17T05:22:32.114418+0000","last_became_peered":"2024-09-17T05:22:32.114418+0000","last_unstale":"2024-09-17T05:22:32.115807+0000","last_undegraded":"2024-09-17T05:22:32.115807+0000","last_fullsized":"2024-09-17T05:22:32.115807+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:00:37.005942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.104951+0000","last_change":"2024-09-17T05:22:32.104951+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.104951+0000","last_undegraded":"2024-09-17T05:22:32.104951+0000","last_fullsized":"2024-09-17T05:22:32.104951+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:22:32.113826+0000","last_change":"2024-09-17T05:22:32.111748+0000","last_active":"2024-09-17T05:22:32.113826+0000","last_peered":"2024-09-17T05:22:32.113826+0000","last_clean":"2024-09-17T05:22:32.113826+0000","last_became_active":"2024-09-17T05:22:32.111430+0000","last_became_peered":"2024-09-17T05:22:32.111430+0000","last_unstale":"2024-09-17T05:22:32.113826+0000","last_undegraded":"2024-09-17T05:22:32.113826+0000","last_fullsized":"2024-09-17T05:22:32.113826+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:31.538467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.098828+0000","last_change":"2024-09-17T05:22:32.098828+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.098828+0000","last_undegraded":"2024-09-17T05:22:32.098828+0000","last_fullsized":"2024-09-17T05:22:32.098828+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.113493+0000","last_change":"2024-09-17T05:22:32.112680+0000","last_active":"2024-09-17T05:22:33.113493+0000","last_peered":"2024-09-17T05:22:33.113493+0000","last_clean":"2024-09-17T05:22:33.113493+0000","last_became_active":"2024-09-17T05:22:32.111854+0000","last_became_peered":"2024-09-17T05:22:32.111854+0000","last_unstale":"2024-09-17T05:22:33.113493+0000","last_undegraded":"2024-09-17T05:22:33.113493+0000","last_fullsized":"2024-09-17T05:22:33.113493+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:04:44.102722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:22:32.090862+0000","last_change":"2024-09-17T05:22:32.090862+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.090862+0000","last_undegraded":"2024-09-17T05:22:32.090862+0000","last_fullsized":"2024-09-17T05:22:32.090862+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:22:32.110438+0000","last_change":"2024-09-17T05:22:32.107007+0000","last_active":"2024-09-17T05:22:32.110438+0000","last_peered":"2024-09-17T05:22:32.110438+0000","last_clean":"2024-09-17T05:22:32.110438+0000","last_became_active":"2024-09-17T05:22:32.106728+0000","last_became_peered":"2024-09-17T05:22:32.106728+0000","last_unstale":"2024-09-17T05:22:32.110438+0000","last_undegraded":"2024-09-17T05:22:32.110438+0000","last_fullsized":"2024-09-17T05:22:32.110438+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:37.928289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.104338+0000","last_change":"2024-09-17T05:22:32.104338+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.104338+0000","last_undegraded":"2024-09-17T05:22:32.104338+0000","last_fullsized":"2024-09-17T05:22:32.104338+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.109645+0000","last_change":"2024-09-17T05:22:32.110685+0000","last_active":"2024-09-17T05:22:33.109645+0000","last_peered":"2024-09-17T05:22:33.109645+0000","last_clean":"2024-09-17T05:22:33.109645+0000","last_became_active":"2024-09-17T05:22:32.110434+0000","last_became_peered":"2024-09-17T05:22:32.110434+0000","last_unstale":"2024-09-17T05:22:33.109645+0000","last_undegraded":"2024-09-17T05:22:33.109645+0000","last_fullsized":"2024-09-17T05:22:33.109645+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:07:17.711718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.131828+0000","last_change":"2024-09-17T05:22:33.125565+0000","last_active":"2024-09-17T05:22:33.131828+0000","last_peered":"2024-09-17T05:22:33.131828+0000","last_clean":"2024-09-17T05:22:33.131828+0000","last_became_active":"2024-09-17T05:22:33.125307+0000","last_became_peered":"2024-09-17T05:22:33.125307+0000","last_unstale":"2024-09-17T05:22:33.131828+0000","last_undegraded":"2024-09-17T05:22:33.131828+0000","last_fullsized":"2024-09-17T05:22:33.131828+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:00:20.640357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.102748+0000","last_change":"2024-09-17T05:22:32.113885+0000","last_active":"2024-09-17T05:22:33.102748+0000","last_peered":"2024-09-17T05:22:33.102748+0000","last_clean":"2024-09-17T05:22:33.102748+0000","last_became_active":"2024-09-17T05:22:32.113348+0000","last_became_peered":"2024-09-17T05:22:32.113348+0000","last_unstale":"2024-09-17T05:22:33.102748+0000","last_undegraded":"2024-09-17T05:22:33.102748+0000","last_fullsized":"2024-09-17T05:22:33.102748+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:02:41.167223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.131890+0000","last_change":"2024-09-17T05:22:33.126125+0000","last_active":"2024-09-17T05:22:33.131890+0000","last_peered":"2024-09-17T05:22:33.131890+0000","last_clean":"2024-09-17T05:22:33.131890+0000","last_became_active":"2024-09-17T05:22:33.125624+0000","last_became_peered":"2024-09-17T05:22:33.125624+0000","last_unstale":"2024-09-17T05:22:33.131890+0000","last_undegraded":"2024-09-17T05:22:33.131890+0000","last_fullsized":"2024-09-17T05:22:33.131890+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:20:43.253271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:22:32.113210+0000","last_change":"2024-09-17T05:22:32.112204+0000","last_active":"2024-09-17T05:22:32.113210+0000","last_peered":"2024-09-17T05:22:32.113210+0000","last_clean":"2024-09-17T05:22:32.113210+0000","last_became_active":"2024-09-17T05:22:32.111922+0000","last_became_peered":"2024-09-17T05:22:32.111922+0000","last_unstale":"2024-09-17T05:22:32.113210+0000","last_undegraded":"2024-09-17T05:22:32.113210+0000","last_fullsized":"2024-09-17T05:22:32.113210+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:30:54.900213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.107714+0000","last_change":"2024-09-17T05:22:32.107714+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.107714+0000","last_undegraded":"2024-09-17T05:22:32.107714+0000","last_fullsized":"2024-09-17T05:22:32.107714+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.136195+0000","last_change":"2024-09-17T05:22:32.116128+0000","last_active":"2024-09-17T05:22:33.136195+0000","last_peered":"2024-09-17T05:22:33.136195+0000","last_clean":"2024-09-17T05:22:33.136195+0000","last_became_active":"2024-09-17T05:22:32.115820+0000","last_became_peered":"2024-09-17T05:22:32.115820+0000","last_unstale":"2024-09-17T05:22:33.136195+0000","last_undegraded":"2024-09-17T05:22:33.136195+0000","last_fullsized":"2024-09-17T05:22:33.136195+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:45:31.962824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:22:32.090862+0000","last_change":"2024-09-17T05:22:32.090862+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.090862+0000","last_undegraded":"2024-09-17T05:22:32.090862+0000","last_fullsized":"2024-09-17T05:22:32.090862+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:22:32.111457+0000","last_change":"2024-09-17T05:22:32.105639+0000","last_active":"2024-09-17T05:22:32.111457+0000","last_peered":"2024-09-17T05:22:32.111457+0000","last_clean":"2024-09-17T05:22:32.111457+0000","last_became_active":"2024-09-17T05:22:32.105366+0000","last_became_peered":"2024-09-17T05:22:32.105366+0000","last_unstale":"2024-09-17T05:22:32.111457+0000","last_undegraded":"2024-09-17T05:22:32.111457+0000","last_fullsized":"2024-09-17T05:22:32.111457+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:04.098750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.116301+0000","last_change":"2024-09-17T05:22:33.111017+0000","last_active":"2024-09-17T05:22:33.116301+0000","last_peered":"2024-09-17T05:22:33.116301+0000","last_clean":"2024-09-17T05:22:33.116301+0000","last_became_active":"2024-09-17T05:22:33.110671+0000","last_became_peered":"2024-09-17T05:22:33.110671+0000","last_unstale":"2024-09-17T05:22:33.116301+0000","last_undegraded":"2024-09-17T05:22:33.116301+0000","last_fullsized":"2024-09-17T05:22:33.116301+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:04:59.112204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-17T05:22:31.099354+0000","last_change":"2024-09-17T05:22:31.099354+0000","last_active":"2024-09-17T05:22:31.086017+0000","last_peered":"2024-09-17T05:22:31.086017+0000","last_clean":"2024-09-17T05:22:31.086017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:31.099354+0000","last_undegraded":"2024-09-17T05:22:31.099354+0000","last_fullsized":"2024-09-17T05:22:31.099354+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.101750+0000","last_change":"2024-09-17T05:22:32.101750+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.101750+0000","last_undegraded":"2024-09-17T05:22:32.101750+0000","last_fullsized":"2024-09-17T05:22:32.101750+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.115995+0000","last_change":"2024-09-17T05:22:32.111645+0000","last_active":"2024-09-17T05:22:33.115995+0000","last_peered":"2024-09-17T05:22:33.115995+0000","last_clean":"2024-09-17T05:22:33.115995+0000","last_became_active":"2024-09-17T05:22:32.111343+0000","last_became_peered":"2024-09-17T05:22:32.111343+0000","last_unstale":"2024-09-17T05:22:33.115995+0000","last_undegraded":"2024-09-17T05:22:33.115995+0000","last_fullsized":"2024-09-17T05:22:33.115995+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:44:35.681368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.101124+0000","last_change":"2024-09-17T05:22:32.101124+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.101124+0000","last_undegraded":"2024-09-17T05:22:32.101124+0000","last_fullsized":"2024-09-17T05:22:32.101124+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.132127+0000","last_change":"2024-09-17T05:22:32.112489+0000","last_active":"2024-09-17T05:22:33.132127+0000","last_peered":"2024-09-17T05:22:33.132127+0000","last_clean":"2024-09-17T05:22:33.132127+0000","last_became_active":"2024-09-17T05:22:32.112221+0000","last_became_peered":"2024-09-17T05:22:32.112221+0000","last_unstale":"2024-09-17T05:22:33.132127+0000","last_undegraded":"2024-09-17T05:22:33.132127+0000","last_fullsized":"2024-09-17T05:22:33.132127+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:14:17.389902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.099669+0000","last_change":"2024-09-17T05:22:32.099669+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.099669+0000","last_undegraded":"2024-09-17T05:22:32.099669+0000","last_fullsized":"2024-09-17T05:22:32.099669+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-17T05:22:31.099412+0000","last_change":"2024-09-17T05:22:31.099412+0000","last_active":"2024-09-17T05:22:31.086017+0000","last_peered":"2024-09-17T05:22:31.086017+0000","last_clean":"2024-09-17T05:22:31.086017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:31.099412+0000","last_undegraded":"2024-09-17T05:22:31.099412+0000","last_fullsized":"2024-09-17T05:22:31.099412+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.106749+0000","last_change":"2024-09-17T05:22:32.106749+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.106749+0000","last_undegraded":"2024-09-17T05:22:32.106749+0000","last_fullsized":"2024-09-17T05:22:32.106749+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:22:32.110402+0000","last_change":"2024-09-17T05:22:32.105623+0000","last_active":"2024-09-17T05:22:32.110402+0000","last_peered":"2024-09-17T05:22:32.110402+0000","last_clean":"2024-09-17T05:22:32.110402+0000","last_became_active":"2024-09-17T05:22:32.105328+0000","last_became_peered":"2024-09-17T05:22:32.105328+0000","last_unstale":"2024-09-17T05:22:32.110402+0000","last_undegraded":"2024-09-17T05:22:32.110402+0000","last_fullsized":"2024-09-17T05:22:32.110402+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:10.346686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:22:32.090862+0000","last_change":"2024-09-17T05:22:32.090862+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.090862+0000","last_undegraded":"2024-09-17T05:22:32.090862+0000","last_fullsized":"2024-09-17T05:22:32.090862+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:22:32.111111+0000","last_change":"2024-09-17T05:22:32.109272+0000","last_active":"2024-09-17T05:22:32.111111+0000","last_peered":"2024-09-17T05:22:32.111111+0000","last_clean":"2024-09-17T05:22:32.111111+0000","last_became_active":"2024-09-17T05:22:32.109013+0000","last_became_peered":"2024-09-17T05:22:32.109013+0000","last_unstale":"2024-09-17T05:22:32.111111+0000","last_undegraded":"2024-09-17T05:22:32.111111+0000","last_fullsized":"2024-09-17T05:22:32.111111+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:48.542813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.118374+0000","last_change":"2024-09-17T05:22:33.113978+0000","last_active":"2024-09-17T05:22:33.118374+0000","last_peered":"2024-09-17T05:22:33.118374+0000","last_clean":"2024-09-17T05:22:33.118374+0000","last_became_active":"2024-09-17T05:22:33.113492+0000","last_became_peered":"2024-09-17T05:22:33.113492+0000","last_unstale":"2024-09-17T05:22:33.118374+0000","last_undegraded":"2024-09-17T05:22:33.118374+0000","last_fullsized":"2024-09-17T05:22:33.118374+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:45:33.140357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:22:32.116497+0000","last_change":"2024-09-17T05:22:32.115027+0000","last_active":"2024-09-17T05:22:32.116497+0000","last_peered":"2024-09-17T05:22:32.116497+0000","last_clean":"2024-09-17T05:22:32.116497+0000","last_became_active":"2024-09-17T05:22:32.114435+0000","last_became_peered":"2024-09-17T05:22:32.114435+0000","last_unstale":"2024-09-17T05:22:32.116497+0000","last_undegraded":"2024-09-17T05:22:32.116497+0000","last_fullsized":"2024-09-17T05:22:32.116497+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:54:48.890240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.118065+0000","last_change":"2024-09-17T05:22:33.110478+0000","last_active":"2024-09-17T05:22:33.118065+0000","last_peered":"2024-09-17T05:22:33.118065+0000","last_clean":"2024-09-17T05:22:33.118065+0000","last_became_active":"2024-09-17T05:22:33.110196+0000","last_became_peered":"2024-09-17T05:22:33.110196+0000","last_unstale":"2024-09-17T05:22:33.118065+0000","last_undegraded":"2024-09-17T05:22:33.118065+0000","last_fullsized":"2024-09-17T05:22:33.118065+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:49.547658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.124641+0000","last_change":"2024-09-17T05:22:32.113308+0000","last_active":"2024-09-17T05:22:33.124641+0000","last_peered":"2024-09-17T05:22:33.124641+0000","last_clean":"2024-09-17T05:22:33.124641+0000","last_became_active":"2024-09-17T05:22:32.113050+0000","last_became_peered":"2024-09-17T05:22:32.113050+0000","last_unstale":"2024-09-17T05:22:33.124641+0000","last_undegraded":"2024-09-17T05:22:33.124641+0000","last_fullsized":"2024-09-17T05:22:33.124641+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:29:10.172995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.118345+0000","last_change":"2024-09-17T05:22:33.112503+0000","last_active":"2024-09-17T05:22:33.118345+0000","last_peered":"2024-09-17T05:22:33.118345+0000","last_clean":"2024-09-17T05:22:33.118345+0000","last_became_active":"2024-09-17T05:22:33.112236+0000","last_became_peered":"2024-09-17T05:22:33.112236+0000","last_unstale":"2024-09-17T05:22:33.118345+0000","last_undegraded":"2024-09-17T05:22:33.118345+0000","last_fullsized":"2024-09-17T05:22:33.118345+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:32.543311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:22:32.114344+0000","last_change":"2024-09-17T05:22:32.112694+0000","last_active":"2024-09-17T05:22:32.114344+0000","last_peered":"2024-09-17T05:22:32.114344+0000","last_clean":"2024-09-17T05:22:32.114344+0000","last_became_active":"2024-09-17T05:22:32.112438+0000","last_became_peered":"2024-09-17T05:22:32.112438+0000","last_unstale":"2024-09-17T05:22:32.114344+0000","last_undegraded":"2024-09-17T05:22:32.114344+0000","last_fullsized":"2024-09-17T05:22:32.114344+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:09:03.522949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.118145+0000","last_change":"2024-09-17T05:22:33.109656+0000","last_active":"2024-09-17T05:22:33.118145+0000","last_peered":"2024-09-17T05:22:33.118145+0000","last_clean":"2024-09-17T05:22:33.118145+0000","last_became_active":"2024-09-17T05:22:33.109356+0000","last_became_peered":"2024-09-17T05:22:33.109356+0000","last_unstale":"2024-09-17T05:22:33.118145+0000","last_undegraded":"2024-09-17T05:22:33.118145+0000","last_fullsized":"2024-09-17T05:22:33.118145+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:38.933134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:22:32.111144+0000","last_change":"2024-09-17T05:22:32.109644+0000","last_active":"2024-09-17T05:22:32.111144+0000","last_peered":"2024-09-17T05:22:32.111144+0000","last_clean":"2024-09-17T05:22:32.111144+0000","last_became_active":"2024-09-17T05:22:32.108599+0000","last_became_peered":"2024-09-17T05:22:32.108599+0000","last_unstale":"2024-09-17T05:22:32.111144+0000","last_undegraded":"2024-09-17T05:22:32.111144+0000","last_fullsized":"2024-09-17T05:22:32.111144+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:07.671241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.101599+0000","last_change":"2024-09-17T05:22:32.101599+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.101599+0000","last_undegraded":"2024-09-17T05:22:32.101599+0000","last_fullsized":"2024-09-17T05:22:32.101599+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:22:32.113819+0000","last_change":"2024-09-17T05:22:32.113056+0000","last_active":"2024-09-17T05:22:32.113819+0000","last_peered":"2024-09-17T05:22:32.113819+0000","last_clean":"2024-09-17T05:22:32.113819+0000","last_became_active":"2024-09-17T05:22:32.112769+0000","last_became_peered":"2024-09-17T05:22:32.112769+0000","last_unstale":"2024-09-17T05:22:32.113819+0000","last_undegraded":"2024-09-17T05:22:32.113819+0000","last_fullsized":"2024-09-17T05:22:32.113819+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:02:19.357061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.128853+0000","last_change":"2024-09-17T05:22:33.127577+0000","last_active":"2024-09-17T05:22:33.128853+0000","last_peered":"2024-09-17T05:22:33.128853+0000","last_clean":"2024-09-17T05:22:33.128853+0000","last_became_active":"2024-09-17T05:22:33.127321+0000","last_became_peered":"2024-09-17T05:22:33.127321+0000","last_unstale":"2024-09-17T05:22:33.128853+0000","last_undegraded":"2024-09-17T05:22:33.128853+0000","last_fullsized":"2024-09-17T05:22:33.128853+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:54:49.895084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-17T05:22:31.098954+0000","last_change":"2024-09-17T05:22:31.098954+0000","last_active":"2024-09-17T05:22:31.086017+0000","last_peered":"2024-09-17T05:22:31.086017+0000","last_clean":"2024-09-17T05:22:31.086017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:31.098954+0000","last_undegraded":"2024-09-17T05:22:31.098954+0000","last_fullsized":"2024-09-17T05:22:31.098954+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.106313+0000","last_change":"2024-09-17T05:22:32.106313+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.106313+0000","last_undegraded":"2024-09-17T05:22:32.106313+0000","last_fullsized":"2024-09-17T05:22:32.106313+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.102870+0000","last_change":"2024-09-17T05:22:32.113614+0000","last_active":"2024-09-17T05:22:33.102870+0000","last_peered":"2024-09-17T05:22:33.102870+0000","last_clean":"2024-09-17T05:22:33.102870+0000","last_became_active":"2024-09-17T05:22:32.113005+0000","last_became_peered":"2024-09-17T05:22:32.113005+0000","last_unstale":"2024-09-17T05:22:33.102870+0000","last_undegraded":"2024-09-17T05:22:33.102870+0000","last_fullsized":"2024-09-17T05:22:33.102870+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:35.883658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.126536+0000","last_change":"2024-09-17T05:22:33.123577+0000","last_active":"2024-09-17T05:22:33.126536+0000","last_peered":"2024-09-17T05:22:33.126536+0000","last_clean":"2024-09-17T05:22:33.126536+0000","last_became_active":"2024-09-17T05:22:33.123017+0000","last_became_peered":"2024-09-17T05:22:33.123017+0000","last_unstale":"2024-09-17T05:22:33.126536+0000","last_undegraded":"2024-09-17T05:22:33.126536+0000","last_fullsized":"2024-09-17T05:22:33.126536+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:32.109566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-17T05:22:31.099095+0000","last_change":"2024-09-17T05:22:31.099095+0000","last_active":"2024-09-17T05:22:31.086017+0000","last_peered":"2024-09-17T05:22:31.086017+0000","last_clean":"2024-09-17T05:22:31.086017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:31.099095+0000","last_undegraded":"2024-09-17T05:22:31.099095+0000","last_fullsized":"2024-09-17T05:22:31.099095+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.102446+0000","last_change":"2024-09-17T05:22:32.102446+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.102446+0000","last_undegraded":"2024-09-17T05:22:32.102446+0000","last_fullsized":"2024-09-17T05:22:32.102446+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.102793+0000","last_change":"2024-09-17T05:22:32.114729+0000","last_active":"2024-09-17T05:22:33.102793+0000","last_peered":"2024-09-17T05:22:33.102793+0000","last_clean":"2024-09-17T05:22:33.102793+0000","last_became_active":"2024-09-17T05:22:32.113768+0000","last_became_peered":"2024-09-17T05:22:32.113768+0000","last_unstale":"2024-09-17T05:22:33.102793+0000","last_undegraded":"2024-09-17T05:22:33.102793+0000","last_fullsized":"2024-09-17T05:22:33.102793+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:26.320381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.115791+0000","last_change":"2024-09-17T05:22:33.110012+0000","last_active":"2024-09-17T05:22:33.115791+0000","last_peered":"2024-09-17T05:22:33.115791+0000","last_clean":"2024-09-17T05:22:33.115791+0000","last_became_active":"2024-09-17T05:22:33.109695+0000","last_became_peered":"2024-09-17T05:22:33.109695+0000","last_unstale":"2024-09-17T05:22:33.115791+0000","last_undegraded":"2024-09-17T05:22:33.115791+0000","last_fullsized":"2024-09-17T05:22:33.115791+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:29.107242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-17T05:22:31.098914+0000","last_change":"2024-09-17T05:22:31.098914+0000","last_active":"2024-09-17T05:22:31.086017+0000","last_peered":"2024-09-17T05:22:31.086017+0000","last_clean":"2024-09-17T05:22:31.086017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:31.098914+0000","last_undegraded":"2024-09-17T05:22:31.098914+0000","last_fullsized":"2024-09-17T05:22:31.098914+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.132164+0000","last_change":"2024-09-17T05:22:33.125596+0000","last_active":"2024-09-17T05:22:33.132164+0000","last_peered":"2024-09-17T05:22:33.132164+0000","last_clean":"2024-09-17T05:22:33.132164+0000","last_became_active":"2024-09-17T05:22:33.125320+0000","last_became_peered":"2024-09-17T05:22:33.125320+0000","last_unstale":"2024-09-17T05:22:33.132164+0000","last_undegraded":"2024-09-17T05:22:33.132164+0000","last_fullsized":"2024-09-17T05:22:33.132164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:14:03.413516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:22:32.113967+0000","last_change":"2024-09-17T05:22:32.112210+0000","last_active":"2024-09-17T05:22:32.113967+0000","last_peered":"2024-09-17T05:22:32.113967+0000","last_clean":"2024-09-17T05:22:32.113967+0000","last_became_active":"2024-09-17T05:22:32.111748+0000","last_became_peered":"2024-09-17T05:22:32.111748+0000","last_unstale":"2024-09-17T05:22:32.113967+0000","last_undegraded":"2024-09-17T05:22:32.113967+0000","last_fullsized":"2024-09-17T05:22:32.113967+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:45:32.135513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.099530+0000","last_change":"2024-09-17T05:22:32.099530+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.099530+0000","last_undegraded":"2024-09-17T05:22:32.099530+0000","last_fullsized":"2024-09-17T05:22:32.099530+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.112366+0000","last_change":"2024-09-17T05:22:32.111929+0000","last_active":"2024-09-17T05:22:33.112366+0000","last_peered":"2024-09-17T05:22:33.112366+0000","last_clean":"2024-09-17T05:22:33.112366+0000","last_became_active":"2024-09-17T05:22:32.111570+0000","last_became_peered":"2024-09-17T05:22:32.111570+0000","last_unstale":"2024-09-17T05:22:33.112366+0000","last_undegraded":"2024-09-17T05:22:33.112366+0000","last_fullsized":"2024-09-17T05:22:33.112366+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:07:58.877603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.100898+0000","last_change":"2024-09-17T05:22:32.100898+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.100898+0000","last_undegraded":"2024-09-17T05:22:32.100898+0000","last_fullsized":"2024-09-17T05:22:32.100898+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:22:32.113694+0000","last_change":"2024-09-17T05:22:32.112360+0000","last_active":"2024-09-17T05:22:32.113694+0000","last_peered":"2024-09-17T05:22:32.113694+0000","last_clean":"2024-09-17T05:22:32.113694+0000","last_became_active":"2024-09-17T05:22:32.112001+0000","last_became_peered":"2024-09-17T05:22:32.112001+0000","last_unstale":"2024-09-17T05:22:32.113694+0000","last_undegraded":"2024-09-17T05:22:32.113694+0000","last_fullsized":"2024-09-17T05:22:32.113694+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:53:37.577343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":127,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:22:32.097806+0000","last_change":"2024-09-17T05:21:44.086098+0000","last_active":"2024-09-17T05:22:32.097806+0000","last_peered":"2024-09-17T05:22:32.097806+0000","last_clean":"2024-09-17T05:22:32.097806+0000","last_became_active":"2024-09-17T05:21:44.083477+0000","last_became_peered":"2024-09-17T05:21:44.083477+0000","last_unstale":"2024-09-17T05:22:32.097806+0000","last_undegraded":"2024-09-17T05:22:32.097806+0000","last_fullsized":"2024-09-17T05:22:32.097806+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:42.925756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:42.925756+0000","last_clean_scrub_stamp":"2024-09-17T05:21:42.925756+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:11.410250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":112,"acting":112,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1612,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21,"ondisk_log_size":21,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":327680,"data_stored":123498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509455,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":327680,"data_stored":123498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509455,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":921600,"data_stored":713866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542157,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":909312,"data_stored":707599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542157,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":327680,"data_stored":123498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542158,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":315392,"data_stored":117231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542158,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":315392,"data_stored":117231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":315392,"data_stored":117231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:22:36.424 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:22:36.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.561+0000 7ff0afea2640 1 -- 172.21.15.98:0/405537066 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff090003a50 msgr2=0x7ff090003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:36.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.561+0000 7ff0afea2640 1 --2- 172.21.15.98:0/405537066 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff090003a50 0x7ff090003e70 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff098002230 tx=0x7ff090005830 comp rx=0 tx=0).stop 2024-09-17T05:22:36.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.561+0000 7ff0ae43f640 1 -- 172.21.15.98:0/405537066 reap_dead start 2024-09-17T05:22:36.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.561+0000 7ff0afea2640 1 -- 172.21.15.98:0/405537066 shutdown_connections 2024-09-17T05:22:36.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.561+0000 7ff0afea2640 1 -- 172.21.15.98:0/405537066 >> 172.21.15.98:0/405537066 conn(0x7ff0a80d1eb0 msgr2=0x7ff0a80d22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:36.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.561+0000 7ff0afea2640 1 -- 172.21.15.98:0/405537066 shutdown_connections 2024-09-17T05:22:36.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.561+0000 7ff0afea2640 1 -- 172.21.15.98:0/405537066 wait complete. 2024-09-17T05:22:36.611 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.562+0000 7ff0afea2640 1 Processor -- start 2024-09-17T05:22:36.611 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.562+0000 7ff0afea2640 1 -- start start 2024-09-17T05:22:36.611 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.563+0000 7ff0afea2640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff090003a50 0x7ff0a814d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:36.612 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.563+0000 7ff0afea2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0a80b7480 0x7ff0a8071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:36.612 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.563+0000 7ff0afea2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0a8071ea0 0x7ff0a81f26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:36.612 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.563+0000 7ff0afea2640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a80cf3f0 con 0x7ff0a8071ea0 2024-09-17T05:22:36.612 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.563+0000 7ff0afea2640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a80cf270 con 0x7ff0a80b7480 2024-09-17T05:22:36.612 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.563+0000 7ff0afea2640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7ff0a80cf570 con 0x7ff090003a50 2024-09-17T05:22:36.612 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.563+0000 7ff0ae43f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0a8071ea0 0x7ff0a81f26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:36.612 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.563+0000 7ff0ae43f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0a8071ea0 0x7ff0a81f26b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46752/0 (socket says 172.21.15.98:46752) 2024-09-17T05:22:36.612 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.563+0000 7ff0ae43f640 1 -- 172.21.15.98:0/3996263572 learned_addr learned my addr 172.21.15.98:0/3996263572 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:36.612 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.563+0000 7ff0adc3e640 1 --2- 172.21.15.98:0/3996263572 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff090003a50 0x7ff0a814d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:36.612 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.563+0000 7ff0ad43d640 1 --2- 172.21.15.98:0/3996263572 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0a80b7480 0x7ff0a8071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:36.613 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.563+0000 7ff0ae43f640 1 -- 172.21.15.98:0/3996263572 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff090003a50 msgr2=0x7ff0a814d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:36.613 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.563+0000 7ff0ae43f640 1 --2- 172.21.15.98:0/3996263572 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff090003a50 0x7ff0a814d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:36.613 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.563+0000 7ff0ae43f640 1 -- 172.21.15.98:0/3996263572 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0a80b7480 msgr2=0x7ff0a8071960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:36.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.563+0000 7ff0ae43f640 1 --2- 172.21.15.98:0/3996263572 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0a80b7480 0x7ff0a8071960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:36.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.563+0000 7ff0ae43f640 1 -- 172.21.15.98:0/3996263572 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0a80b69c0 con 0x7ff0a8071ea0 2024-09-17T05:22:36.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.563+0000 7ff0ad43d640 1 --2- 172.21.15.98:0/3996263572 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0a80b7480 0x7ff0a8071960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:22:36.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.563+0000 7ff0ae43f640 1 --2- 172.21.15.98:0/3996263572 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0a8071ea0 0x7ff0a81f26b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff0a80c5770 tx=0x7ff0a000fa20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:36.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.563+0000 7ff0a67fc640 1 -- 172.21.15.98:0/3996263572 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a0004220 con 0x7ff0a8071ea0 2024-09-17T05:22:36.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.563+0000 7ff0a67fc640 1 -- 172.21.15.98:0/3996263572 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff0a0005020 con 0x7ff0a8071ea0 2024-09-17T05:22:36.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.563+0000 7ff0a67fc640 1 -- 172.21.15.98:0/3996263572 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a0005470 con 0x7ff0a8071ea0 2024-09-17T05:22:36.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.563+0000 7ff0afea2640 1 -- 172.21.15.98:0/3996263572 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0a81f3490 con 0x7ff0a8071ea0 2024-09-17T05:22:36.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.564+0000 7ff0afea2640 1 -- 172.21.15.98:0/3996263572 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0a80b6f60 con 0x7ff0a8071ea0 2024-09-17T05:22:36.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.565+0000 7ff0afea2640 1 -- 172.21.15.98:0/3996263572 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0a8072320 con 0x7ff0a8071ea0 2024-09-17T05:22:36.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.565+0000 7ff0a67fc640 1 -- 172.21.15.98:0/3996263572 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff0a0019030 con 0x7ff0a8071ea0 2024-09-17T05:22:36.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.566+0000 7ff0a67fc640 1 --2- 172.21.15.98:0/3996263572 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7ff094078bc0 0x7ff09407b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:36.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.566+0000 7ff0a67fc640 1 -- 172.21.15.98:0/3996263572 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7ff0a009ac60 con 0x7ff0a8071ea0 2024-09-17T05:22:36.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.566+0000 7ff0adc3e640 1 --2- 172.21.15.98:0/3996263572 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7ff094078bc0 0x7ff09407b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:36.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.567+0000 7ff0adc3e640 1 --2- 172.21.15.98:0/3996263572 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7ff094078bc0 0x7ff09407b080 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff098033000 tx=0x7ff098038040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:36.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.570+0000 7ff0a67fc640 1 -- 172.21.15.98:0/3996263572 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7ff0a0062ae0 con 0x7ff0a8071ea0 2024-09-17T05:22:36.744 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.743+0000 7ff0afea2640 1 -- 172.21.15.98:0/3996263572 --> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff0a80b2310 con 0x7ff094078bc0 2024-09-17T05:22:36.748 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.747+0000 7ff0a67fc640 1 -- 172.21.15.98:0/3996263572 <== mgr.4103 v2:172.21.15.167:6800/610796449 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247577 (secure 0 0 0) 0x7ff0a80b2310 con 0x7ff094078bc0 2024-09-17T05:22:36.751 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:22:36.752 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-17T05:22:36.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.750+0000 7ff0afea2640 1 -- 172.21.15.98:0/3996263572 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7ff094078bc0 msgr2=0x7ff09407b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:36.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.750+0000 7ff0afea2640 1 --2- 172.21.15.98:0/3996263572 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7ff094078bc0 0x7ff09407b080 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff098033000 tx=0x7ff098038040 comp rx=0 tx=0).stop 2024-09-17T05:22:36.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.750+0000 7ff0afea2640 1 -- 172.21.15.98:0/3996263572 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0a8071ea0 msgr2=0x7ff0a81f26b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:36.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.750+0000 7ff0afea2640 1 --2- 172.21.15.98:0/3996263572 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0a8071ea0 0x7ff0a81f26b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff0a80c5770 tx=0x7ff0a000fa20 comp rx=0 tx=0).stop 2024-09-17T05:22:36.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.750+0000 7ff0afea2640 1 -- 172.21.15.98:0/3996263572 shutdown_connections 2024-09-17T05:22:36.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.750+0000 7ff0afea2640 1 --2- 172.21.15.98:0/3996263572 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7ff094078bc0 0x7ff09407b080 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:36.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.750+0000 7ff0afea2640 1 --2- 172.21.15.98:0/3996263572 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0a8071ea0 0x7ff0a81f26b0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:36.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.750+0000 7ff0afea2640 1 --2- 172.21.15.98:0/3996263572 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0a80b7480 0x7ff0a8071960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:36.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.750+0000 7ff0afea2640 1 --2- 172.21.15.98:0/3996263572 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff090003a50 0x7ff0a814d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:36.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.750+0000 7ff0afea2640 1 -- 172.21.15.98:0/3996263572 >> 172.21.15.98:0/3996263572 conn(0x7ff0a80d1eb0 msgr2=0x7ff0a80cfa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:36.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.750+0000 7ff0afea2640 1 -- 172.21.15.98:0/3996263572 shutdown_connections 2024-09-17T05:22:36.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.750+0000 7ff0afea2640 1 -- 172.21.15.98:0/3996263572 wait complete. 2024-09-17T05:22:36.762 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2024-09-17T05:22:36.256613+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591980,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":126,"num_write_kb":1631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":93,"ondisk_log_size":93,"up":178,"acting":178,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":37,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224068,"kb_used_data":3672,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750652,"statfs":{"total":773094113280,"available":772864667648,"internally_reserved":0,"allocated":3760128,"data_stored":2143652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1612,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.158226"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.103573+0000","last_change":"2024-09-17T05:22:32.103573+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.103573+0000","last_undegraded":"2024-09-17T05:22:32.103573+0000","last_fullsized":"2024-09-17T05:22:32.103573+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.126491+0000","last_change":"2024-09-17T05:22:33.116777+0000","last_active":"2024-09-17T05:22:33.126491+0000","last_peered":"2024-09-17T05:22:33.126491+0000","last_clean":"2024-09-17T05:22:33.126491+0000","last_became_active":"2024-09-17T05:22:33.116516+0000","last_became_peered":"2024-09-17T05:22:33.116516+0000","last_unstale":"2024-09-17T05:22:33.126491+0000","last_undegraded":"2024-09-17T05:22:33.126491+0000","last_fullsized":"2024-09-17T05:22:33.126491+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:11:33.740686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.107279+0000","last_change":"2024-09-17T05:22:32.107279+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.107279+0000","last_undegraded":"2024-09-17T05:22:32.107279+0000","last_fullsized":"2024-09-17T05:22:32.107279+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:22:32.090862+0000","last_change":"2024-09-17T05:22:32.090862+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.090862+0000","last_undegraded":"2024-09-17T05:22:32.090862+0000","last_fullsized":"2024-09-17T05:22:32.090862+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.118319+0000","last_change":"2024-09-17T05:22:33.111841+0000","last_active":"2024-09-17T05:22:33.118319+0000","last_peered":"2024-09-17T05:22:33.118319+0000","last_clean":"2024-09-17T05:22:33.118319+0000","last_became_active":"2024-09-17T05:22:33.111527+0000","last_became_peered":"2024-09-17T05:22:33.111527+0000","last_unstale":"2024-09-17T05:22:33.118319+0000","last_undegraded":"2024-09-17T05:22:33.118319+0000","last_fullsized":"2024-09-17T05:22:33.118319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:08.676086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.134538+0000","last_change":"2024-09-17T05:22:33.129531+0000","last_active":"2024-09-17T05:22:33.134538+0000","last_peered":"2024-09-17T05:22:33.134538+0000","last_clean":"2024-09-17T05:22:33.134538+0000","last_became_active":"2024-09-17T05:22:33.129298+0000","last_became_peered":"2024-09-17T05:22:33.129298+0000","last_unstale":"2024-09-17T05:22:33.134538+0000","last_undegraded":"2024-09-17T05:22:33.134538+0000","last_fullsized":"2024-09-17T05:22:33.134538+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:24:49.441913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.104413+0000","last_change":"2024-09-17T05:22:32.104413+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.104413+0000","last_undegraded":"2024-09-17T05:22:32.104413+0000","last_fullsized":"2024-09-17T05:22:32.104413+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.103975+0000","last_change":"2024-09-17T05:22:32.103975+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.103975+0000","last_undegraded":"2024-09-17T05:22:32.103975+0000","last_fullsized":"2024-09-17T05:22:32.103975+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.100213+0000","last_change":"2024-09-17T05:22:32.100213+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.100213+0000","last_undegraded":"2024-09-17T05:22:32.100213+0000","last_fullsized":"2024-09-17T05:22:32.100213+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:22:32.090862+0000","last_change":"2024-09-17T05:22:32.090862+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.090862+0000","last_undegraded":"2024-09-17T05:22:32.090862+0000","last_fullsized":"2024-09-17T05:22:32.090862+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.102694+0000","last_change":"2024-09-17T05:22:32.102694+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.102694+0000","last_undegraded":"2024-09-17T05:22:32.102694+0000","last_fullsized":"2024-09-17T05:22:32.102694+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.103820+0000","last_change":"2024-09-17T05:22:32.103820+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.103820+0000","last_undegraded":"2024-09-17T05:22:32.103820+0000","last_fullsized":"2024-09-17T05:22:32.103820+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.126132+0000","last_change":"2024-09-17T05:22:33.122187+0000","last_active":"2024-09-17T05:22:33.126132+0000","last_peered":"2024-09-17T05:22:33.126132+0000","last_clean":"2024-09-17T05:22:33.126132+0000","last_became_active":"2024-09-17T05:22:33.121907+0000","last_became_peered":"2024-09-17T05:22:33.121907+0000","last_unstale":"2024-09-17T05:22:33.126132+0000","last_undegraded":"2024-09-17T05:22:33.126132+0000","last_fullsized":"2024-09-17T05:22:33.126132+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:00:38.010787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.126610+0000","last_change":"2024-09-17T05:22:33.119051+0000","last_active":"2024-09-17T05:22:33.126610+0000","last_peered":"2024-09-17T05:22:33.126610+0000","last_clean":"2024-09-17T05:22:33.126610+0000","last_became_active":"2024-09-17T05:22:33.118758+0000","last_became_peered":"2024-09-17T05:22:33.118758+0000","last_unstale":"2024-09-17T05:22:33.126610+0000","last_undegraded":"2024-09-17T05:22:33.126610+0000","last_fullsized":"2024-09-17T05:22:33.126610+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:16:18.864713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.105887+0000","last_change":"2024-09-17T05:22:32.105887+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.105887+0000","last_undegraded":"2024-09-17T05:22:32.105887+0000","last_fullsized":"2024-09-17T05:22:32.105887+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.103203+0000","last_change":"2024-09-17T05:22:32.103203+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.103203+0000","last_undegraded":"2024-09-17T05:22:32.103203+0000","last_fullsized":"2024-09-17T05:22:32.103203+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.104894+0000","last_change":"2024-09-17T05:22:32.104894+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.104894+0000","last_undegraded":"2024-09-17T05:22:32.104894+0000","last_fullsized":"2024-09-17T05:22:32.104894+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.134490+0000","last_change":"2024-09-17T05:22:33.126595+0000","last_active":"2024-09-17T05:22:33.134490+0000","last_peered":"2024-09-17T05:22:33.134490+0000","last_clean":"2024-09-17T05:22:33.134490+0000","last_became_active":"2024-09-17T05:22:33.126328+0000","last_became_peered":"2024-09-17T05:22:33.126328+0000","last_unstale":"2024-09-17T05:22:33.134490+0000","last_undegraded":"2024-09-17T05:22:33.134490+0000","last_fullsized":"2024-09-17T05:22:33.134490+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:34:26.391003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.131795+0000","last_change":"2024-09-17T05:22:33.124786+0000","last_active":"2024-09-17T05:22:33.131795+0000","last_peered":"2024-09-17T05:22:33.131795+0000","last_clean":"2024-09-17T05:22:33.131795+0000","last_became_active":"2024-09-17T05:22:33.124527+0000","last_became_peered":"2024-09-17T05:22:33.124527+0000","last_unstale":"2024-09-17T05:22:33.131795+0000","last_undegraded":"2024-09-17T05:22:33.131795+0000","last_fullsized":"2024-09-17T05:22:33.131795+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:54:51.462172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.134408+0000","last_change":"2024-09-17T05:22:33.129657+0000","last_active":"2024-09-17T05:22:33.134408+0000","last_peered":"2024-09-17T05:22:33.134408+0000","last_clean":"2024-09-17T05:22:33.134408+0000","last_became_active":"2024-09-17T05:22:33.129360+0000","last_became_peered":"2024-09-17T05:22:33.129360+0000","last_unstale":"2024-09-17T05:22:33.134408+0000","last_undegraded":"2024-09-17T05:22:33.134408+0000","last_fullsized":"2024-09-17T05:22:33.134408+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:20.372997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.100812+0000","last_change":"2024-09-17T05:22:32.100812+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.100812+0000","last_undegraded":"2024-09-17T05:22:32.100812+0000","last_fullsized":"2024-09-17T05:22:32.100812+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.100516+0000","last_change":"2024-09-17T05:22:32.100516+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.100516+0000","last_undegraded":"2024-09-17T05:22:32.100516+0000","last_fullsized":"2024-09-17T05:22:32.100516+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.116601+0000","last_change":"2024-09-17T05:22:33.114614+0000","last_active":"2024-09-17T05:22:33.116601+0000","last_peered":"2024-09-17T05:22:33.116601+0000","last_clean":"2024-09-17T05:22:33.116601+0000","last_became_active":"2024-09-17T05:22:33.114367+0000","last_became_peered":"2024-09-17T05:22:33.114367+0000","last_unstale":"2024-09-17T05:22:33.116601+0000","last_undegraded":"2024-09-17T05:22:33.116601+0000","last_fullsized":"2024-09-17T05:22:33.116601+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:55:40.665695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.105440+0000","last_change":"2024-09-17T05:22:32.105440+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.105440+0000","last_undegraded":"2024-09-17T05:22:32.105440+0000","last_fullsized":"2024-09-17T05:22:32.105440+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:22:32.090862+0000","last_change":"2024-09-17T05:22:32.090862+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.090862+0000","last_undegraded":"2024-09-17T05:22:32.090862+0000","last_fullsized":"2024-09-17T05:22:32.090862+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.126512+0000","last_change":"2024-09-17T05:22:33.117947+0000","last_active":"2024-09-17T05:22:33.126512+0000","last_peered":"2024-09-17T05:22:33.126512+0000","last_clean":"2024-09-17T05:22:33.126512+0000","last_became_active":"2024-09-17T05:22:33.117035+0000","last_became_peered":"2024-09-17T05:22:33.117035+0000","last_unstale":"2024-09-17T05:22:33.126512+0000","last_undegraded":"2024-09-17T05:22:33.126512+0000","last_fullsized":"2024-09-17T05:22:33.126512+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:03:01.527461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:22:32.090862+0000","last_change":"2024-09-17T05:22:32.090862+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.090862+0000","last_undegraded":"2024-09-17T05:22:32.090862+0000","last_fullsized":"2024-09-17T05:22:32.090862+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.103312+0000","last_change":"2024-09-17T05:22:32.103312+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.103312+0000","last_undegraded":"2024-09-17T05:22:32.103312+0000","last_fullsized":"2024-09-17T05:22:32.103312+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.100364+0000","last_change":"2024-09-17T05:22:32.100364+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.100364+0000","last_undegraded":"2024-09-17T05:22:32.100364+0000","last_fullsized":"2024-09-17T05:22:32.100364+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.102243+0000","last_change":"2024-09-17T05:22:32.102243+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.102243+0000","last_undegraded":"2024-09-17T05:22:32.102243+0000","last_fullsized":"2024-09-17T05:22:32.102243+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.101675+0000","last_change":"2024-09-17T05:22:32.101675+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.101675+0000","last_undegraded":"2024-09-17T05:22:32.101675+0000","last_fullsized":"2024-09-17T05:22:32.101675+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.102712+0000","last_change":"2024-09-17T05:22:32.102712+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.102712+0000","last_undegraded":"2024-09-17T05:22:32.102712+0000","last_fullsized":"2024-09-17T05:22:32.102712+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.116637+0000","last_change":"2024-09-17T05:22:33.113816+0000","last_active":"2024-09-17T05:22:33.116637+0000","last_peered":"2024-09-17T05:22:33.116637+0000","last_clean":"2024-09-17T05:22:33.116637+0000","last_became_active":"2024-09-17T05:22:33.113489+0000","last_became_peered":"2024-09-17T05:22:33.113489+0000","last_unstale":"2024-09-17T05:22:33.116637+0000","last_undegraded":"2024-09-17T05:22:33.116637+0000","last_fullsized":"2024-09-17T05:22:33.116637+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:24:12.851750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:22:32.115027+0000","last_change":"2024-09-17T05:22:32.113612+0000","last_active":"2024-09-17T05:22:32.115027+0000","last_peered":"2024-09-17T05:22:32.115027+0000","last_clean":"2024-09-17T05:22:32.115027+0000","last_became_active":"2024-09-17T05:22:32.113283+0000","last_became_peered":"2024-09-17T05:22:32.113283+0000","last_unstale":"2024-09-17T05:22:32.115027+0000","last_undegraded":"2024-09-17T05:22:32.115027+0000","last_fullsized":"2024-09-17T05:22:32.115027+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:34:14.594010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.102140+0000","last_change":"2024-09-17T05:22:32.102140+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.102140+0000","last_undegraded":"2024-09-17T05:22:32.102140+0000","last_fullsized":"2024-09-17T05:22:32.102140+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.131245+0000","last_change":"2024-09-17T05:22:32.110226+0000","last_active":"2024-09-17T05:22:33.131245+0000","last_peered":"2024-09-17T05:22:33.131245+0000","last_clean":"2024-09-17T05:22:33.131245+0000","last_became_active":"2024-09-17T05:22:32.109954+0000","last_became_peered":"2024-09-17T05:22:32.109954+0000","last_unstale":"2024-09-17T05:22:33.131245+0000","last_undegraded":"2024-09-17T05:22:33.131245+0000","last_fullsized":"2024-09-17T05:22:33.131245+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:40.467869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.100405+0000","last_change":"2024-09-17T05:22:32.100405+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.100405+0000","last_undegraded":"2024-09-17T05:22:32.100405+0000","last_fullsized":"2024-09-17T05:22:32.100405+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.127957+0000","last_change":"2024-09-17T05:22:32.114627+0000","last_active":"2024-09-17T05:22:33.127957+0000","last_peered":"2024-09-17T05:22:33.127957+0000","last_clean":"2024-09-17T05:22:33.127957+0000","last_became_active":"2024-09-17T05:22:32.114380+0000","last_became_peered":"2024-09-17T05:22:32.114380+0000","last_unstale":"2024-09-17T05:22:33.127957+0000","last_undegraded":"2024-09-17T05:22:33.127957+0000","last_fullsized":"2024-09-17T05:22:33.127957+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:50:22.991581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:22:32.090862+0000","last_change":"2024-09-17T05:22:32.090862+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.090862+0000","last_undegraded":"2024-09-17T05:22:32.090862+0000","last_fullsized":"2024-09-17T05:22:32.090862+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.126216+0000","last_change":"2024-09-17T05:22:32.112558+0000","last_active":"2024-09-17T05:22:33.126216+0000","last_peered":"2024-09-17T05:22:33.126216+0000","last_clean":"2024-09-17T05:22:33.126216+0000","last_became_active":"2024-09-17T05:22:32.112226+0000","last_became_peered":"2024-09-17T05:22:32.112226+0000","last_unstale":"2024-09-17T05:22:33.126216+0000","last_undegraded":"2024-09-17T05:22:33.126216+0000","last_fullsized":"2024-09-17T05:22:33.126216+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:44.503659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.101721+0000","last_change":"2024-09-17T05:22:32.101721+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.101721+0000","last_undegraded":"2024-09-17T05:22:32.101721+0000","last_fullsized":"2024-09-17T05:22:32.101721+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:22:32.115807+0000","last_change":"2024-09-17T05:22:32.114701+0000","last_active":"2024-09-17T05:22:32.115807+0000","last_peered":"2024-09-17T05:22:32.115807+0000","last_clean":"2024-09-17T05:22:32.115807+0000","last_became_active":"2024-09-17T05:22:32.114418+0000","last_became_peered":"2024-09-17T05:22:32.114418+0000","last_unstale":"2024-09-17T05:22:32.115807+0000","last_undegraded":"2024-09-17T05:22:32.115807+0000","last_fullsized":"2024-09-17T05:22:32.115807+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:00:37.005942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.104951+0000","last_change":"2024-09-17T05:22:32.104951+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.104951+0000","last_undegraded":"2024-09-17T05:22:32.104951+0000","last_fullsized":"2024-09-17T05:22:32.104951+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:22:32.113826+0000","last_change":"2024-09-17T05:22:32.111748+0000","last_active":"2024-09-17T05:22:32.113826+0000","last_peered":"2024-09-17T05:22:32.113826+0000","last_clean":"2024-09-17T05:22:32.113826+0000","last_became_active":"2024-09-17T05:22:32.111430+0000","last_became_peered":"2024-09-17T05:22:32.111430+0000","last_unstale":"2024-09-17T05:22:32.113826+0000","last_undegraded":"2024-09-17T05:22:32.113826+0000","last_fullsized":"2024-09-17T05:22:32.113826+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:31.538467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.098828+0000","last_change":"2024-09-17T05:22:32.098828+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.098828+0000","last_undegraded":"2024-09-17T05:22:32.098828+0000","last_fullsized":"2024-09-17T05:22:32.098828+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.113493+0000","last_change":"2024-09-17T05:22:32.112680+0000","last_active":"2024-09-17T05:22:33.113493+0000","last_peered":"2024-09-17T05:22:33.113493+0000","last_clean":"2024-09-17T05:22:33.113493+0000","last_became_active":"2024-09-17T05:22:32.111854+0000","last_became_peered":"2024-09-17T05:22:32.111854+0000","last_unstale":"2024-09-17T05:22:33.113493+0000","last_undegraded":"2024-09-17T05:22:33.113493+0000","last_fullsized":"2024-09-17T05:22:33.113493+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:04:44.102722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:22:32.090862+0000","last_change":"2024-09-17T05:22:32.090862+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.090862+0000","last_undegraded":"2024-09-17T05:22:32.090862+0000","last_fullsized":"2024-09-17T05:22:32.090862+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:22:32.110438+0000","last_change":"2024-09-17T05:22:32.107007+0000","last_active":"2024-09-17T05:22:32.110438+0000","last_peered":"2024-09-17T05:22:32.110438+0000","last_clean":"2024-09-17T05:22:32.110438+0000","last_became_active":"2024-09-17T05:22:32.106728+0000","last_became_peered":"2024-09-17T05:22:32.106728+0000","last_unstale":"2024-09-17T05:22:32.110438+0000","last_undegraded":"2024-09-17T05:22:32.110438+0000","last_fullsized":"2024-09-17T05:22:32.110438+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:37.928289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.104338+0000","last_change":"2024-09-17T05:22:32.104338+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.104338+0000","last_undegraded":"2024-09-17T05:22:32.104338+0000","last_fullsized":"2024-09-17T05:22:32.104338+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.109645+0000","last_change":"2024-09-17T05:22:32.110685+0000","last_active":"2024-09-17T05:22:33.109645+0000","last_peered":"2024-09-17T05:22:33.109645+0000","last_clean":"2024-09-17T05:22:33.109645+0000","last_became_active":"2024-09-17T05:22:32.110434+0000","last_became_peered":"2024-09-17T05:22:32.110434+0000","last_unstale":"2024-09-17T05:22:33.109645+0000","last_undegraded":"2024-09-17T05:22:33.109645+0000","last_fullsized":"2024-09-17T05:22:33.109645+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:07:17.711718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.131828+0000","last_change":"2024-09-17T05:22:33.125565+0000","last_active":"2024-09-17T05:22:33.131828+0000","last_peered":"2024-09-17T05:22:33.131828+0000","last_clean":"2024-09-17T05:22:33.131828+0000","last_became_active":"2024-09-17T05:22:33.125307+0000","last_became_peered":"2024-09-17T05:22:33.125307+0000","last_unstale":"2024-09-17T05:22:33.131828+0000","last_undegraded":"2024-09-17T05:22:33.131828+0000","last_fullsized":"2024-09-17T05:22:33.131828+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:00:20.640357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.102748+0000","last_change":"2024-09-17T05:22:32.113885+0000","last_active":"2024-09-17T05:22:33.102748+0000","last_peered":"2024-09-17T05:22:33.102748+0000","last_clean":"2024-09-17T05:22:33.102748+0000","last_became_active":"2024-09-17T05:22:32.113348+0000","last_became_peered":"2024-09-17T05:22:32.113348+0000","last_unstale":"2024-09-17T05:22:33.102748+0000","last_undegraded":"2024-09-17T05:22:33.102748+0000","last_fullsized":"2024-09-17T05:22:33.102748+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:02:41.167223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.131890+0000","last_change":"2024-09-17T05:22:33.126125+0000","last_active":"2024-09-17T05:22:33.131890+0000","last_peered":"2024-09-17T05:22:33.131890+0000","last_clean":"2024-09-17T05:22:33.131890+0000","last_became_active":"2024-09-17T05:22:33.125624+0000","last_became_peered":"2024-09-17T05:22:33.125624+0000","last_unstale":"2024-09-17T05:22:33.131890+0000","last_undegraded":"2024-09-17T05:22:33.131890+0000","last_fullsized":"2024-09-17T05:22:33.131890+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:20:43.253271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:22:32.113210+0000","last_change":"2024-09-17T05:22:32.112204+0000","last_active":"2024-09-17T05:22:32.113210+0000","last_peered":"2024-09-17T05:22:32.113210+0000","last_clean":"2024-09-17T05:22:32.113210+0000","last_became_active":"2024-09-17T05:22:32.111922+0000","last_became_peered":"2024-09-17T05:22:32.111922+0000","last_unstale":"2024-09-17T05:22:32.113210+0000","last_undegraded":"2024-09-17T05:22:32.113210+0000","last_fullsized":"2024-09-17T05:22:32.113210+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:30:54.900213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.107714+0000","last_change":"2024-09-17T05:22:32.107714+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.107714+0000","last_undegraded":"2024-09-17T05:22:32.107714+0000","last_fullsized":"2024-09-17T05:22:32.107714+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.136195+0000","last_change":"2024-09-17T05:22:32.116128+0000","last_active":"2024-09-17T05:22:33.136195+0000","last_peered":"2024-09-17T05:22:33.136195+0000","last_clean":"2024-09-17T05:22:33.136195+0000","last_became_active":"2024-09-17T05:22:32.115820+0000","last_became_peered":"2024-09-17T05:22:32.115820+0000","last_unstale":"2024-09-17T05:22:33.136195+0000","last_undegraded":"2024-09-17T05:22:33.136195+0000","last_fullsized":"2024-09-17T05:22:33.136195+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:45:31.962824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:22:32.090862+0000","last_change":"2024-09-17T05:22:32.090862+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.090862+0000","last_undegraded":"2024-09-17T05:22:32.090862+0000","last_fullsized":"2024-09-17T05:22:32.090862+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:22:32.111457+0000","last_change":"2024-09-17T05:22:32.105639+0000","last_active":"2024-09-17T05:22:32.111457+0000","last_peered":"2024-09-17T05:22:32.111457+0000","last_clean":"2024-09-17T05:22:32.111457+0000","last_became_active":"2024-09-17T05:22:32.105366+0000","last_became_peered":"2024-09-17T05:22:32.105366+0000","last_unstale":"2024-09-17T05:22:32.111457+0000","last_undegraded":"2024-09-17T05:22:32.111457+0000","last_fullsized":"2024-09-17T05:22:32.111457+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:04.098750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.116301+0000","last_change":"2024-09-17T05:22:33.111017+0000","last_active":"2024-09-17T05:22:33.116301+0000","last_peered":"2024-09-17T05:22:33.116301+0000","last_clean":"2024-09-17T05:22:33.116301+0000","last_became_active":"2024-09-17T05:22:33.110671+0000","last_became_peered":"2024-09-17T05:22:33.110671+0000","last_unstale":"2024-09-17T05:22:33.116301+0000","last_undegraded":"2024-09-17T05:22:33.116301+0000","last_fullsized":"2024-09-17T05:22:33.116301+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:04:59.112204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-17T05:22:31.099354+0000","last_change":"2024-09-17T05:22:31.099354+0000","last_active":"2024-09-17T05:22:31.086017+0000","last_peered":"2024-09-17T05:22:31.086017+0000","last_clean":"2024-09-17T05:22:31.086017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:31.099354+0000","last_undegraded":"2024-09-17T05:22:31.099354+0000","last_fullsized":"2024-09-17T05:22:31.099354+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.101750+0000","last_change":"2024-09-17T05:22:32.101750+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.101750+0000","last_undegraded":"2024-09-17T05:22:32.101750+0000","last_fullsized":"2024-09-17T05:22:32.101750+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.115995+0000","last_change":"2024-09-17T05:22:32.111645+0000","last_active":"2024-09-17T05:22:33.115995+0000","last_peered":"2024-09-17T05:22:33.115995+0000","last_clean":"2024-09-17T05:22:33.115995+0000","last_became_active":"2024-09-17T05:22:32.111343+0000","last_became_peered":"2024-09-17T05:22:32.111343+0000","last_unstale":"2024-09-17T05:22:33.115995+0000","last_undegraded":"2024-09-17T05:22:33.115995+0000","last_fullsized":"2024-09-17T05:22:33.115995+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:44:35.681368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.101124+0000","last_change":"2024-09-17T05:22:32.101124+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.101124+0000","last_undegraded":"2024-09-17T05:22:32.101124+0000","last_fullsized":"2024-09-17T05:22:32.101124+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.132127+0000","last_change":"2024-09-17T05:22:32.112489+0000","last_active":"2024-09-17T05:22:33.132127+0000","last_peered":"2024-09-17T05:22:33.132127+0000","last_clean":"2024-09-17T05:22:33.132127+0000","last_became_active":"2024-09-17T05:22:32.112221+0000","last_became_peered":"2024-09-17T05:22:32.112221+0000","last_unstale":"2024-09-17T05:22:33.132127+0000","last_undegraded":"2024-09-17T05:22:33.132127+0000","last_fullsized":"2024-09-17T05:22:33.132127+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:14:17.389902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.099669+0000","last_change":"2024-09-17T05:22:32.099669+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.099669+0000","last_undegraded":"2024-09-17T05:22:32.099669+0000","last_fullsized":"2024-09-17T05:22:32.099669+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-17T05:22:31.099412+0000","last_change":"2024-09-17T05:22:31.099412+0000","last_active":"2024-09-17T05:22:31.086017+0000","last_peered":"2024-09-17T05:22:31.086017+0000","last_clean":"2024-09-17T05:22:31.086017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:31.099412+0000","last_undegraded":"2024-09-17T05:22:31.099412+0000","last_fullsized":"2024-09-17T05:22:31.099412+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.106749+0000","last_change":"2024-09-17T05:22:32.106749+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.106749+0000","last_undegraded":"2024-09-17T05:22:32.106749+0000","last_fullsized":"2024-09-17T05:22:32.106749+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:22:32.110402+0000","last_change":"2024-09-17T05:22:32.105623+0000","last_active":"2024-09-17T05:22:32.110402+0000","last_peered":"2024-09-17T05:22:32.110402+0000","last_clean":"2024-09-17T05:22:32.110402+0000","last_became_active":"2024-09-17T05:22:32.105328+0000","last_became_peered":"2024-09-17T05:22:32.105328+0000","last_unstale":"2024-09-17T05:22:32.110402+0000","last_undegraded":"2024-09-17T05:22:32.110402+0000","last_fullsized":"2024-09-17T05:22:32.110402+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:10.346686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:22:32.090862+0000","last_change":"2024-09-17T05:22:32.090862+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.090862+0000","last_undegraded":"2024-09-17T05:22:32.090862+0000","last_fullsized":"2024-09-17T05:22:32.090862+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:22:32.111111+0000","last_change":"2024-09-17T05:22:32.109272+0000","last_active":"2024-09-17T05:22:32.111111+0000","last_peered":"2024-09-17T05:22:32.111111+0000","last_clean":"2024-09-17T05:22:32.111111+0000","last_became_active":"2024-09-17T05:22:32.109013+0000","last_became_peered":"2024-09-17T05:22:32.109013+0000","last_unstale":"2024-09-17T05:22:32.111111+0000","last_undegraded":"2024-09-17T05:22:32.111111+0000","last_fullsized":"2024-09-17T05:22:32.111111+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:48.542813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.118374+0000","last_change":"2024-09-17T05:22:33.113978+0000","last_active":"2024-09-17T05:22:33.118374+0000","last_peered":"2024-09-17T05:22:33.118374+0000","last_clean":"2024-09-17T05:22:33.118374+0000","last_became_active":"2024-09-17T05:22:33.113492+0000","last_became_peered":"2024-09-17T05:22:33.113492+0000","last_unstale":"2024-09-17T05:22:33.118374+0000","last_undegraded":"2024-09-17T05:22:33.118374+0000","last_fullsized":"2024-09-17T05:22:33.118374+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:45:33.140357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:22:32.116497+0000","last_change":"2024-09-17T05:22:32.115027+0000","last_active":"2024-09-17T05:22:32.116497+0000","last_peered":"2024-09-17T05:22:32.116497+0000","last_clean":"2024-09-17T05:22:32.116497+0000","last_became_active":"2024-09-17T05:22:32.114435+0000","last_became_peered":"2024-09-17T05:22:32.114435+0000","last_unstale":"2024-09-17T05:22:32.116497+0000","last_undegraded":"2024-09-17T05:22:32.116497+0000","last_fullsized":"2024-09-17T05:22:32.116497+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:54:48.890240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.118065+0000","last_change":"2024-09-17T05:22:33.110478+0000","last_active":"2024-09-17T05:22:33.118065+0000","last_peered":"2024-09-17T05:22:33.118065+0000","last_clean":"2024-09-17T05:22:33.118065+0000","last_became_active":"2024-09-17T05:22:33.110196+0000","last_became_peered":"2024-09-17T05:22:33.110196+0000","last_unstale":"2024-09-17T05:22:33.118065+0000","last_undegraded":"2024-09-17T05:22:33.118065+0000","last_fullsized":"2024-09-17T05:22:33.118065+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:49.547658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.124641+0000","last_change":"2024-09-17T05:22:32.113308+0000","last_active":"2024-09-17T05:22:33.124641+0000","last_peered":"2024-09-17T05:22:33.124641+0000","last_clean":"2024-09-17T05:22:33.124641+0000","last_became_active":"2024-09-17T05:22:32.113050+0000","last_became_peered":"2024-09-17T05:22:32.113050+0000","last_unstale":"2024-09-17T05:22:33.124641+0000","last_undegraded":"2024-09-17T05:22:33.124641+0000","last_fullsized":"2024-09-17T05:22:33.124641+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:29:10.172995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.118345+0000","last_change":"2024-09-17T05:22:33.112503+0000","last_active":"2024-09-17T05:22:33.118345+0000","last_peered":"2024-09-17T05:22:33.118345+0000","last_clean":"2024-09-17T05:22:33.118345+0000","last_became_active":"2024-09-17T05:22:33.112236+0000","last_became_peered":"2024-09-17T05:22:33.112236+0000","last_unstale":"2024-09-17T05:22:33.118345+0000","last_undegraded":"2024-09-17T05:22:33.118345+0000","last_fullsized":"2024-09-17T05:22:33.118345+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:32.543311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:22:32.114344+0000","last_change":"2024-09-17T05:22:32.112694+0000","last_active":"2024-09-17T05:22:32.114344+0000","last_peered":"2024-09-17T05:22:32.114344+0000","last_clean":"2024-09-17T05:22:32.114344+0000","last_became_active":"2024-09-17T05:22:32.112438+0000","last_became_peered":"2024-09-17T05:22:32.112438+0000","last_unstale":"2024-09-17T05:22:32.114344+0000","last_undegraded":"2024-09-17T05:22:32.114344+0000","last_fullsized":"2024-09-17T05:22:32.114344+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:09:03.522949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.118145+0000","last_change":"2024-09-17T05:22:33.109656+0000","last_active":"2024-09-17T05:22:33.118145+0000","last_peered":"2024-09-17T05:22:33.118145+0000","last_clean":"2024-09-17T05:22:33.118145+0000","last_became_active":"2024-09-17T05:22:33.109356+0000","last_became_peered":"2024-09-17T05:22:33.109356+0000","last_unstale":"2024-09-17T05:22:33.118145+0000","last_undegraded":"2024-09-17T05:22:33.118145+0000","last_fullsized":"2024-09-17T05:22:33.118145+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:38.933134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:22:32.111144+0000","last_change":"2024-09-17T05:22:32.109644+0000","last_active":"2024-09-17T05:22:32.111144+0000","last_peered":"2024-09-17T05:22:32.111144+0000","last_clean":"2024-09-17T05:22:32.111144+0000","last_became_active":"2024-09-17T05:22:32.108599+0000","last_became_peered":"2024-09-17T05:22:32.108599+0000","last_unstale":"2024-09-17T05:22:32.111144+0000","last_undegraded":"2024-09-17T05:22:32.111144+0000","last_fullsized":"2024-09-17T05:22:32.111144+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:07.671241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.101599+0000","last_change":"2024-09-17T05:22:32.101599+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.101599+0000","last_undegraded":"2024-09-17T05:22:32.101599+0000","last_fullsized":"2024-09-17T05:22:32.101599+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:22:32.113819+0000","last_change":"2024-09-17T05:22:32.113056+0000","last_active":"2024-09-17T05:22:32.113819+0000","last_peered":"2024-09-17T05:22:32.113819+0000","last_clean":"2024-09-17T05:22:32.113819+0000","last_became_active":"2024-09-17T05:22:32.112769+0000","last_became_peered":"2024-09-17T05:22:32.112769+0000","last_unstale":"2024-09-17T05:22:32.113819+0000","last_undegraded":"2024-09-17T05:22:32.113819+0000","last_fullsized":"2024-09-17T05:22:32.113819+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:02:19.357061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.128853+0000","last_change":"2024-09-17T05:22:33.127577+0000","last_active":"2024-09-17T05:22:33.128853+0000","last_peered":"2024-09-17T05:22:33.128853+0000","last_clean":"2024-09-17T05:22:33.128853+0000","last_became_active":"2024-09-17T05:22:33.127321+0000","last_became_peered":"2024-09-17T05:22:33.127321+0000","last_unstale":"2024-09-17T05:22:33.128853+0000","last_undegraded":"2024-09-17T05:22:33.128853+0000","last_fullsized":"2024-09-17T05:22:33.128853+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:54:49.895084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-17T05:22:31.098954+0000","last_change":"2024-09-17T05:22:31.098954+0000","last_active":"2024-09-17T05:22:31.086017+0000","last_peered":"2024-09-17T05:22:31.086017+0000","last_clean":"2024-09-17T05:22:31.086017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:31.098954+0000","last_undegraded":"2024-09-17T05:22:31.098954+0000","last_fullsized":"2024-09-17T05:22:31.098954+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.106313+0000","last_change":"2024-09-17T05:22:32.106313+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.106313+0000","last_undegraded":"2024-09-17T05:22:32.106313+0000","last_fullsized":"2024-09-17T05:22:32.106313+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.102870+0000","last_change":"2024-09-17T05:22:32.113614+0000","last_active":"2024-09-17T05:22:33.102870+0000","last_peered":"2024-09-17T05:22:33.102870+0000","last_clean":"2024-09-17T05:22:33.102870+0000","last_became_active":"2024-09-17T05:22:32.113005+0000","last_became_peered":"2024-09-17T05:22:32.113005+0000","last_unstale":"2024-09-17T05:22:33.102870+0000","last_undegraded":"2024-09-17T05:22:33.102870+0000","last_fullsized":"2024-09-17T05:22:33.102870+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:35.883658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.126536+0000","last_change":"2024-09-17T05:22:33.123577+0000","last_active":"2024-09-17T05:22:33.126536+0000","last_peered":"2024-09-17T05:22:33.126536+0000","last_clean":"2024-09-17T05:22:33.126536+0000","last_became_active":"2024-09-17T05:22:33.123017+0000","last_became_peered":"2024-09-17T05:22:33.123017+0000","last_unstale":"2024-09-17T05:22:33.126536+0000","last_undegraded":"2024-09-17T05:22:33.126536+0000","last_fullsized":"2024-09-17T05:22:33.126536+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:32.109566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-17T05:22:31.099095+0000","last_change":"2024-09-17T05:22:31.099095+0000","last_active":"2024-09-17T05:22:31.086017+0000","last_peered":"2024-09-17T05:22:31.086017+0000","last_clean":"2024-09-17T05:22:31.086017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:31.099095+0000","last_undegraded":"2024-09-17T05:22:31.099095+0000","last_fullsized":"2024-09-17T05:22:31.099095+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.102446+0000","last_change":"2024-09-17T05:22:32.102446+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.102446+0000","last_undegraded":"2024-09-17T05:22:32.102446+0000","last_fullsized":"2024-09-17T05:22:32.102446+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.102793+0000","last_change":"2024-09-17T05:22:32.114729+0000","last_active":"2024-09-17T05:22:33.102793+0000","last_peered":"2024-09-17T05:22:33.102793+0000","last_clean":"2024-09-17T05:22:33.102793+0000","last_became_active":"2024-09-17T05:22:32.113768+0000","last_became_peered":"2024-09-17T05:22:32.113768+0000","last_unstale":"2024-09-17T05:22:33.102793+0000","last_undegraded":"2024-09-17T05:22:33.102793+0000","last_fullsized":"2024-09-17T05:22:33.102793+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:26.320381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.115791+0000","last_change":"2024-09-17T05:22:33.110012+0000","last_active":"2024-09-17T05:22:33.115791+0000","last_peered":"2024-09-17T05:22:33.115791+0000","last_clean":"2024-09-17T05:22:33.115791+0000","last_became_active":"2024-09-17T05:22:33.109695+0000","last_became_peered":"2024-09-17T05:22:33.109695+0000","last_unstale":"2024-09-17T05:22:33.115791+0000","last_undegraded":"2024-09-17T05:22:33.115791+0000","last_fullsized":"2024-09-17T05:22:33.115791+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:29.107242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-17T05:22:31.098914+0000","last_change":"2024-09-17T05:22:31.098914+0000","last_active":"2024-09-17T05:22:31.086017+0000","last_peered":"2024-09-17T05:22:31.086017+0000","last_clean":"2024-09-17T05:22:31.086017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:31.098914+0000","last_undegraded":"2024-09-17T05:22:31.098914+0000","last_fullsized":"2024-09-17T05:22:31.098914+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.132164+0000","last_change":"2024-09-17T05:22:33.125596+0000","last_active":"2024-09-17T05:22:33.132164+0000","last_peered":"2024-09-17T05:22:33.132164+0000","last_clean":"2024-09-17T05:22:33.132164+0000","last_became_active":"2024-09-17T05:22:33.125320+0000","last_became_peered":"2024-09-17T05:22:33.125320+0000","last_unstale":"2024-09-17T05:22:33.132164+0000","last_undegraded":"2024-09-17T05:22:33.132164+0000","last_fullsized":"2024-09-17T05:22:33.132164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:14:03.413516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:22:32.113967+0000","last_change":"2024-09-17T05:22:32.112210+0000","last_active":"2024-09-17T05:22:32.113967+0000","last_peered":"2024-09-17T05:22:32.113967+0000","last_clean":"2024-09-17T05:22:32.113967+0000","last_became_active":"2024-09-17T05:22:32.111748+0000","last_became_peered":"2024-09-17T05:22:32.111748+0000","last_unstale":"2024-09-17T05:22:32.113967+0000","last_undegraded":"2024-09-17T05:22:32.113967+0000","last_fullsized":"2024-09-17T05:22:32.113967+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:45:32.135513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.099530+0000","last_change":"2024-09-17T05:22:32.099530+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.099530+0000","last_undegraded":"2024-09-17T05:22:32.099530+0000","last_fullsized":"2024-09-17T05:22:32.099530+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.112366+0000","last_change":"2024-09-17T05:22:32.111929+0000","last_active":"2024-09-17T05:22:33.112366+0000","last_peered":"2024-09-17T05:22:33.112366+0000","last_clean":"2024-09-17T05:22:33.112366+0000","last_became_active":"2024-09-17T05:22:32.111570+0000","last_became_peered":"2024-09-17T05:22:32.111570+0000","last_unstale":"2024-09-17T05:22:33.112366+0000","last_undegraded":"2024-09-17T05:22:33.112366+0000","last_fullsized":"2024-09-17T05:22:33.112366+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:07:58.877603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.100898+0000","last_change":"2024-09-17T05:22:32.100898+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.100898+0000","last_undegraded":"2024-09-17T05:22:32.100898+0000","last_fullsized":"2024-09-17T05:22:32.100898+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:22:32.113694+0000","last_change":"2024-09-17T05:22:32.112360+0000","last_active":"2024-09-17T05:22:32.113694+0000","last_peered":"2024-09-17T05:22:32.113694+0000","last_clean":"2024-09-17T05:22:32.113694+0000","last_became_active":"2024-09-17T05:22:32.112001+0000","last_became_peered":"2024-09-17T05:22:32.112001+0000","last_unstale":"2024-09-17T05:22:32.113694+0000","last_undegraded":"2024-09-17T05:22:32.113694+0000","last_fullsized":"2024-09-17T05:22:32.113694+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:53:37.577343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":127,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:22:32.097806+0000","last_change":"2024-09-17T05:21:44.086098+0000","last_active":"2024-09-17T05:22:32.097806+0000","last_peered":"2024-09-17T05:22:32.097806+0000","last_clean":"2024-09-17T05:22:32.097806+0000","last_became_active":"2024-09-17T05:21:44.083477+0000","last_became_peered":"2024-09-17T05:21:44.083477+0000","last_unstale":"2024-09-17T05:22:32.097806+0000","last_undegraded":"2024-09-17T05:22:32.097806+0000","last_fullsized":"2024-09-17T05:22:32.097806+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:42.925756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:42.925756+0000","last_clean_scrub_stamp":"2024-09-17T05:21:42.925756+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:11.410250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":112,"acting":112,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1612,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21,"ondisk_log_size":21,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":327680,"data_stored":123498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509455,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":327680,"data_stored":123498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509455,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":921600,"data_stored":713866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542157,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":909312,"data_stored":707599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542157,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":327680,"data_stored":123498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542158,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":315392,"data_stored":117231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542158,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":315392,"data_stored":117231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":315392,"data_stored":117231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:22:36.766 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3f is not active+clean 2024-09-17T05:22:36.766 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:22:32.103573+0000', 'last_change': '2024-09-17T05:22:32.103573+0000', 'last_active': '2024-09-17T05:22:32.090862+0000', 'last_peered': '2024-09-17T05:22:32.090862+0000', 'last_clean': '2024-09-17T05:22:32.090862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:22:32.103573+0000', 'last_undegraded': '2024-09-17T05:22:32.103573+0000', 'last_fullsized': '2024-09-17T05:22:32.103573+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:22:36.766 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3d is not active+clean 2024-09-17T05:22:36.766 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:22:32.107279+0000', 'last_change': '2024-09-17T05:22:32.107279+0000', 'last_active': '2024-09-17T05:22:32.090862+0000', 'last_peered': '2024-09-17T05:22:32.090862+0000', 'last_clean': '2024-09-17T05:22:32.090862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:22:32.107279+0000', 'last_undegraded': '2024-09-17T05:22:32.107279+0000', 'last_fullsized': '2024-09-17T05:22:32.107279+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:22:36.767 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3c is not active+clean 2024-09-17T05:22:36.767 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:22:32.090862+0000', 'last_change': '2024-09-17T05:22:32.090862+0000', 'last_active': '2024-09-17T05:22:32.090862+0000', 'last_peered': '2024-09-17T05:22:32.090862+0000', 'last_clean': '2024-09-17T05:22:32.090862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:22:32.090862+0000', 'last_undegraded': '2024-09-17T05:22:32.090862+0000', 'last_fullsized': '2024-09-17T05:22:32.090862+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:22:36.767 INFO:tasks.ceph.ceph_manager.ceph:PG 5.39 is not active+clean 2024-09-17T05:22:36.767 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:22:32.104413+0000', 'last_change': '2024-09-17T05:22:32.104413+0000', 'last_active': '2024-09-17T05:22:32.090862+0000', 'last_peered': '2024-09-17T05:22:32.090862+0000', 'last_clean': '2024-09-17T05:22:32.090862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:22:32.104413+0000', 'last_undegraded': '2024-09-17T05:22:32.104413+0000', 'last_fullsized': '2024-09-17T05:22:32.104413+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:22:36.767 INFO:tasks.ceph.ceph_manager.ceph:PG 5.38 is not active+clean 2024-09-17T05:22:36.767 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:22:32.103975+0000', 'last_change': '2024-09-17T05:22:32.103975+0000', 'last_active': '2024-09-17T05:22:32.090862+0000', 'last_peered': '2024-09-17T05:22:32.090862+0000', 'last_clean': '2024-09-17T05:22:32.090862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:22:32.103975+0000', 'last_undegraded': '2024-09-17T05:22:32.103975+0000', 'last_fullsized': '2024-09-17T05:22:32.103975+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:22:36.767 INFO:tasks.ceph.ceph_manager.ceph:PG 5.37 is not active+clean 2024-09-17T05:22:36.767 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:22:32.100213+0000', 'last_change': '2024-09-17T05:22:32.100213+0000', 'last_active': '2024-09-17T05:22:32.090862+0000', 'last_peered': '2024-09-17T05:22:32.090862+0000', 'last_clean': '2024-09-17T05:22:32.090862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:22:32.100213+0000', 'last_undegraded': '2024-09-17T05:22:32.100213+0000', 'last_fullsized': '2024-09-17T05:22:32.100213+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:22:36.767 INFO:tasks.ceph.ceph_manager.ceph:PG 5.36 is not active+clean 2024-09-17T05:22:36.767 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:22:32.090862+0000', 'last_change': '2024-09-17T05:22:32.090862+0000', 'last_active': '2024-09-17T05:22:32.090862+0000', 'last_peered': '2024-09-17T05:22:32.090862+0000', 'last_clean': '2024-09-17T05:22:32.090862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:22:32.090862+0000', 'last_undegraded': '2024-09-17T05:22:32.090862+0000', 'last_fullsized': '2024-09-17T05:22:32.090862+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:22:36.768 INFO:tasks.ceph.ceph_manager.ceph:PG 5.35 is not active+clean 2024-09-17T05:22:36.768 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:22:32.102694+0000', 'last_change': '2024-09-17T05:22:32.102694+0000', 'last_active': '2024-09-17T05:22:32.090862+0000', 'last_peered': '2024-09-17T05:22:32.090862+0000', 'last_clean': '2024-09-17T05:22:32.090862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:22:32.102694+0000', 'last_undegraded': '2024-09-17T05:22:32.102694+0000', 'last_fullsized': '2024-09-17T05:22:32.102694+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:22:36.768 INFO:tasks.ceph.ceph_manager.ceph:PG 5.34 is not active+clean 2024-09-17T05:22:36.768 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:22:32.103820+0000', 'last_change': '2024-09-17T05:22:32.103820+0000', 'last_active': '2024-09-17T05:22:32.090862+0000', 'last_peered': '2024-09-17T05:22:32.090862+0000', 'last_clean': '2024-09-17T05:22:32.090862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:22:32.103820+0000', 'last_undegraded': '2024-09-17T05:22:32.103820+0000', 'last_fullsized': '2024-09-17T05:22:32.103820+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:22:36.768 INFO:tasks.ceph.ceph_manager.ceph:PG 5.31 is not active+clean 2024-09-17T05:22:36.768 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:22:32.105887+0000', 'last_change': '2024-09-17T05:22:32.105887+0000', 'last_active': '2024-09-17T05:22:32.090862+0000', 'last_peered': '2024-09-17T05:22:32.090862+0000', 'last_clean': '2024-09-17T05:22:32.090862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:22:32.105887+0000', 'last_undegraded': '2024-09-17T05:22:32.105887+0000', 'last_fullsized': '2024-09-17T05:22:32.105887+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:22:36.768 INFO:tasks.ceph.ceph_manager.ceph:PG 5.30 is not active+clean 2024-09-17T05:22:36.768 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:22:32.103203+0000', 'last_change': '2024-09-17T05:22:32.103203+0000', 'last_active': '2024-09-17T05:22:32.090862+0000', 'last_peered': '2024-09-17T05:22:32.090862+0000', 'last_clean': '2024-09-17T05:22:32.090862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:22:32.103203+0000', 'last_undegraded': '2024-09-17T05:22:32.103203+0000', 'last_fullsized': '2024-09-17T05:22:32.103203+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:22:36.768 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2f is not active+clean 2024-09-17T05:22:36.768 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:22:32.104894+0000', 'last_change': '2024-09-17T05:22:32.104894+0000', 'last_active': '2024-09-17T05:22:32.090862+0000', 'last_peered': '2024-09-17T05:22:32.090862+0000', 'last_clean': '2024-09-17T05:22:32.090862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:22:32.104894+0000', 'last_undegraded': '2024-09-17T05:22:32.104894+0000', 'last_fullsized': '2024-09-17T05:22:32.104894+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:22:36.769 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2b is not active+clean 2024-09-17T05:22:36.769 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:22:32.100812+0000', 'last_change': '2024-09-17T05:22:32.100812+0000', 'last_active': '2024-09-17T05:22:32.090862+0000', 'last_peered': '2024-09-17T05:22:32.090862+0000', 'last_clean': '2024-09-17T05:22:32.090862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:22:32.100812+0000', 'last_undegraded': '2024-09-17T05:22:32.100812+0000', 'last_fullsized': '2024-09-17T05:22:32.100812+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:22:36.769 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2a is not active+clean 2024-09-17T05:22:36.769 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:22:32.100516+0000', 'last_change': '2024-09-17T05:22:32.100516+0000', 'last_active': '2024-09-17T05:22:32.090862+0000', 'last_peered': '2024-09-17T05:22:32.090862+0000', 'last_clean': '2024-09-17T05:22:32.090862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:22:32.100516+0000', 'last_undegraded': '2024-09-17T05:22:32.100516+0000', 'last_fullsized': '2024-09-17T05:22:32.100516+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:22:36.769 INFO:tasks.ceph.ceph_manager.ceph:PG 5.28 is not active+clean 2024-09-17T05:22:36.769 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:22:32.105440+0000', 'last_change': '2024-09-17T05:22:32.105440+0000', 'last_active': '2024-09-17T05:22:32.090862+0000', 'last_peered': '2024-09-17T05:22:32.090862+0000', 'last_clean': '2024-09-17T05:22:32.090862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:22:32.105440+0000', 'last_undegraded': '2024-09-17T05:22:32.105440+0000', 'last_fullsized': '2024-09-17T05:22:32.105440+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:22:36.769 INFO:tasks.ceph.ceph_manager.ceph:PG 5.27 is not active+clean 2024-09-17T05:22:36.769 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:22:32.090862+0000', 'last_change': '2024-09-17T05:22:32.090862+0000', 'last_active': '2024-09-17T05:22:32.090862+0000', 'last_peered': '2024-09-17T05:22:32.090862+0000', 'last_clean': '2024-09-17T05:22:32.090862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:22:32.090862+0000', 'last_undegraded': '2024-09-17T05:22:32.090862+0000', 'last_fullsized': '2024-09-17T05:22:32.090862+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:22:36.770 INFO:tasks.ceph.ceph_manager.ceph:PG 5.25 is not active+clean 2024-09-17T05:22:36.770 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:22:32.090862+0000', 'last_change': '2024-09-17T05:22:32.090862+0000', 'last_active': '2024-09-17T05:22:32.090862+0000', 'last_peered': '2024-09-17T05:22:32.090862+0000', 'last_clean': '2024-09-17T05:22:32.090862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:22:32.090862+0000', 'last_undegraded': '2024-09-17T05:22:32.090862+0000', 'last_fullsized': '2024-09-17T05:22:32.090862+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:22:36.770 INFO:tasks.ceph.ceph_manager.ceph:PG 5.24 is not active+clean 2024-09-17T05:22:36.770 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:22:32.103312+0000', 'last_change': '2024-09-17T05:22:32.103312+0000', 'last_active': '2024-09-17T05:22:32.090862+0000', 'last_peered': '2024-09-17T05:22:32.090862+0000', 'last_clean': '2024-09-17T05:22:32.090862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:22:32.103312+0000', 'last_undegraded': '2024-09-17T05:22:32.103312+0000', 'last_fullsized': '2024-09-17T05:22:32.103312+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:22:36.770 INFO:tasks.ceph.ceph_manager.ceph:PG 5.23 is not active+clean 2024-09-17T05:22:36.770 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:22:32.100364+0000', 'last_change': '2024-09-17T05:22:32.100364+0000', 'last_active': '2024-09-17T05:22:32.090862+0000', 'last_peered': '2024-09-17T05:22:32.090862+0000', 'last_clean': '2024-09-17T05:22:32.090862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:22:32.100364+0000', 'last_undegraded': '2024-09-17T05:22:32.100364+0000', 'last_fullsized': '2024-09-17T05:22:32.100364+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:22:36.770 INFO:tasks.ceph.ceph_manager.ceph:PG 5.22 is not active+clean 2024-09-17T05:22:36.770 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:22:32.102243+0000', 'last_change': '2024-09-17T05:22:32.102243+0000', 'last_active': '2024-09-17T05:22:32.090862+0000', 'last_peered': '2024-09-17T05:22:32.090862+0000', 'last_clean': '2024-09-17T05:22:32.090862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:22:32.102243+0000', 'last_undegraded': '2024-09-17T05:22:32.102243+0000', 'last_fullsized': '2024-09-17T05:22:32.102243+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:22:36.770 INFO:tasks.ceph.ceph_manager.ceph:PG 5.21 is not active+clean 2024-09-17T05:22:36.770 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:22:32.101675+0000', 'last_change': '2024-09-17T05:22:32.101675+0000', 'last_active': '2024-09-17T05:22:32.090862+0000', 'last_peered': '2024-09-17T05:22:32.090862+0000', 'last_clean': '2024-09-17T05:22:32.090862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:22:32.101675+0000', 'last_undegraded': '2024-09-17T05:22:32.101675+0000', 'last_fullsized': '2024-09-17T05:22:32.101675+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:22:36.771 INFO:tasks.ceph.ceph_manager.ceph:PG 5.20 is not active+clean 2024-09-17T05:22:36.771 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:22:32.102712+0000', 'last_change': '2024-09-17T05:22:32.102712+0000', 'last_active': '2024-09-17T05:22:32.090862+0000', 'last_peered': '2024-09-17T05:22:32.090862+0000', 'last_clean': '2024-09-17T05:22:32.090862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:22:32.102712+0000', 'last_undegraded': '2024-09-17T05:22:32.102712+0000', 'last_fullsized': '2024-09-17T05:22:32.102712+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:22:36.771 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1f is not active+clean 2024-09-17T05:22:36.771 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:22:32.102140+0000', 'last_change': '2024-09-17T05:22:32.102140+0000', 'last_active': '2024-09-17T05:22:32.090862+0000', 'last_peered': '2024-09-17T05:22:32.090862+0000', 'last_clean': '2024-09-17T05:22:32.090862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:22:32.102140+0000', 'last_undegraded': '2024-09-17T05:22:32.102140+0000', 'last_fullsized': '2024-09-17T05:22:32.102140+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:22:36.771 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1c is not active+clean 2024-09-17T05:22:36.771 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:22:32.100405+0000', 'last_change': '2024-09-17T05:22:32.100405+0000', 'last_active': '2024-09-17T05:22:32.090862+0000', 'last_peered': '2024-09-17T05:22:32.090862+0000', 'last_clean': '2024-09-17T05:22:32.090862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:22:32.100405+0000', 'last_undegraded': '2024-09-17T05:22:32.100405+0000', 'last_fullsized': '2024-09-17T05:22:32.100405+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:22:36.771 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1d is not active+clean 2024-09-17T05:22:36.771 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:22:32.090862+0000', 'last_change': '2024-09-17T05:22:32.090862+0000', 'last_active': '2024-09-17T05:22:32.090862+0000', 'last_peered': '2024-09-17T05:22:32.090862+0000', 'last_clean': '2024-09-17T05:22:32.090862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:22:32.090862+0000', 'last_undegraded': '2024-09-17T05:22:32.090862+0000', 'last_fullsized': '2024-09-17T05:22:32.090862+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:22:36.771 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1a is not active+clean 2024-09-17T05:22:36.771 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:22:32.101721+0000', 'last_change': '2024-09-17T05:22:32.101721+0000', 'last_active': '2024-09-17T05:22:32.090862+0000', 'last_peered': '2024-09-17T05:22:32.090862+0000', 'last_clean': '2024-09-17T05:22:32.090862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:22:32.101721+0000', 'last_undegraded': '2024-09-17T05:22:32.101721+0000', 'last_fullsized': '2024-09-17T05:22:32.101721+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:22:36.771 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1b is not active+clean 2024-09-17T05:22:36.772 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:22:32.104951+0000', 'last_change': '2024-09-17T05:22:32.104951+0000', 'last_active': '2024-09-17T05:22:32.090862+0000', 'last_peered': '2024-09-17T05:22:32.090862+0000', 'last_clean': '2024-09-17T05:22:32.090862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:22:32.104951+0000', 'last_undegraded': '2024-09-17T05:22:32.104951+0000', 'last_fullsized': '2024-09-17T05:22:32.104951+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:22:36.772 INFO:tasks.ceph.ceph_manager.ceph:PG 5.18 is not active+clean 2024-09-17T05:22:36.772 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:22:32.098828+0000', 'last_change': '2024-09-17T05:22:32.098828+0000', 'last_active': '2024-09-17T05:22:32.090862+0000', 'last_peered': '2024-09-17T05:22:32.090862+0000', 'last_clean': '2024-09-17T05:22:32.090862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:22:32.098828+0000', 'last_undegraded': '2024-09-17T05:22:32.098828+0000', 'last_fullsized': '2024-09-17T05:22:32.098828+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:22:36.772 INFO:tasks.ceph.ceph_manager.ceph:PG 5.19 is not active+clean 2024-09-17T05:22:36.772 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:22:32.090862+0000', 'last_change': '2024-09-17T05:22:32.090862+0000', 'last_active': '2024-09-17T05:22:32.090862+0000', 'last_peered': '2024-09-17T05:22:32.090862+0000', 'last_clean': '2024-09-17T05:22:32.090862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:22:32.090862+0000', 'last_undegraded': '2024-09-17T05:22:32.090862+0000', 'last_fullsized': '2024-09-17T05:22:32.090862+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:22:36.772 INFO:tasks.ceph.ceph_manager.ceph:PG 5.16 is not active+clean 2024-09-17T05:22:36.772 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:22:32.104338+0000', 'last_change': '2024-09-17T05:22:32.104338+0000', 'last_active': '2024-09-17T05:22:32.090862+0000', 'last_peered': '2024-09-17T05:22:32.090862+0000', 'last_clean': '2024-09-17T05:22:32.090862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:22:32.104338+0000', 'last_undegraded': '2024-09-17T05:22:32.104338+0000', 'last_fullsized': '2024-09-17T05:22:32.104338+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:22:36.772 INFO:tasks.ceph.ceph_manager.ceph:PG 5.15 is not active+clean 2024-09-17T05:22:36.772 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:22:32.107714+0000', 'last_change': '2024-09-17T05:22:32.107714+0000', 'last_active': '2024-09-17T05:22:32.090862+0000', 'last_peered': '2024-09-17T05:22:32.090862+0000', 'last_clean': '2024-09-17T05:22:32.090862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:22:32.107714+0000', 'last_undegraded': '2024-09-17T05:22:32.107714+0000', 'last_fullsized': '2024-09-17T05:22:32.107714+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:22:36.773 INFO:tasks.ceph.ceph_manager.ceph:PG 5.12 is not active+clean 2024-09-17T05:22:36.773 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:22:32.090862+0000', 'last_change': '2024-09-17T05:22:32.090862+0000', 'last_active': '2024-09-17T05:22:32.090862+0000', 'last_peered': '2024-09-17T05:22:32.090862+0000', 'last_clean': '2024-09-17T05:22:32.090862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:22:32.090862+0000', 'last_undegraded': '2024-09-17T05:22:32.090862+0000', 'last_fullsized': '2024-09-17T05:22:32.090862+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:22:36.773 INFO:tasks.ceph.ceph_manager.ceph:PG 4.12 is not active+clean 2024-09-17T05:22:36.773 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:22:31.099354+0000', 'last_change': '2024-09-17T05:22:31.099354+0000', 'last_active': '2024-09-17T05:22:31.086017+0000', 'last_peered': '2024-09-17T05:22:31.086017+0000', 'last_clean': '2024-09-17T05:22:31.086017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:22:31.099354+0000', 'last_undegraded': '2024-09-17T05:22:31.099354+0000', 'last_fullsized': '2024-09-17T05:22:31.099354+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:22:31.086017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:22:31.086017+0000', 'last_clean_scrub_stamp': '2024-09-17T05:22:31.086017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:22:36.773 INFO:tasks.ceph.ceph_manager.ceph:PG 5.10 is not active+clean 2024-09-17T05:22:36.773 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:22:32.101750+0000', 'last_change': '2024-09-17T05:22:32.101750+0000', 'last_active': '2024-09-17T05:22:32.090862+0000', 'last_peered': '2024-09-17T05:22:32.090862+0000', 'last_clean': '2024-09-17T05:22:32.090862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:22:32.101750+0000', 'last_undegraded': '2024-09-17T05:22:32.101750+0000', 'last_fullsized': '2024-09-17T05:22:32.101750+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:22:36.773 INFO:tasks.ceph.ceph_manager.ceph:PG 5.11 is not active+clean 2024-09-17T05:22:36.773 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:22:32.101124+0000', 'last_change': '2024-09-17T05:22:32.101124+0000', 'last_active': '2024-09-17T05:22:32.090862+0000', 'last_peered': '2024-09-17T05:22:32.090862+0000', 'last_clean': '2024-09-17T05:22:32.090862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:22:32.101124+0000', 'last_undegraded': '2024-09-17T05:22:32.101124+0000', 'last_fullsized': '2024-09-17T05:22:32.101124+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:22:36.773 INFO:tasks.ceph.ceph_manager.ceph:PG 5.e is not active+clean 2024-09-17T05:22:36.773 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:22:32.099669+0000', 'last_change': '2024-09-17T05:22:32.099669+0000', 'last_active': '2024-09-17T05:22:32.090862+0000', 'last_peered': '2024-09-17T05:22:32.090862+0000', 'last_clean': '2024-09-17T05:22:32.090862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:22:32.099669+0000', 'last_undegraded': '2024-09-17T05:22:32.099669+0000', 'last_fullsized': '2024-09-17T05:22:32.099669+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:22:36.774 INFO:tasks.ceph.ceph_manager.ceph:PG 4.f is not active+clean 2024-09-17T05:22:36.774 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:22:31.099412+0000', 'last_change': '2024-09-17T05:22:31.099412+0000', 'last_active': '2024-09-17T05:22:31.086017+0000', 'last_peered': '2024-09-17T05:22:31.086017+0000', 'last_clean': '2024-09-17T05:22:31.086017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:22:31.099412+0000', 'last_undegraded': '2024-09-17T05:22:31.099412+0000', 'last_fullsized': '2024-09-17T05:22:31.099412+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:22:31.086017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:22:31.086017+0000', 'last_clean_scrub_stamp': '2024-09-17T05:22:31.086017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:22:36.774 INFO:tasks.ceph.ceph_manager.ceph:PG 5.f is not active+clean 2024-09-17T05:22:36.774 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:22:32.106749+0000', 'last_change': '2024-09-17T05:22:32.106749+0000', 'last_active': '2024-09-17T05:22:32.090862+0000', 'last_peered': '2024-09-17T05:22:32.090862+0000', 'last_clean': '2024-09-17T05:22:32.090862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:22:32.106749+0000', 'last_undegraded': '2024-09-17T05:22:32.106749+0000', 'last_fullsized': '2024-09-17T05:22:32.106749+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:22:36.774 INFO:tasks.ceph.ceph_manager.ceph:PG 5.c is not active+clean 2024-09-17T05:22:36.774 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:22:32.090862+0000', 'last_change': '2024-09-17T05:22:32.090862+0000', 'last_active': '2024-09-17T05:22:32.090862+0000', 'last_peered': '2024-09-17T05:22:32.090862+0000', 'last_clean': '2024-09-17T05:22:32.090862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:22:32.090862+0000', 'last_undegraded': '2024-09-17T05:22:32.090862+0000', 'last_fullsized': '2024-09-17T05:22:32.090862+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:22:36.774 INFO:tasks.ceph.ceph_manager.ceph:PG 5.9 is not active+clean 2024-09-17T05:22:36.774 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:22:32.101599+0000', 'last_change': '2024-09-17T05:22:32.101599+0000', 'last_active': '2024-09-17T05:22:32.090862+0000', 'last_peered': '2024-09-17T05:22:32.090862+0000', 'last_clean': '2024-09-17T05:22:32.090862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:22:32.101599+0000', 'last_undegraded': '2024-09-17T05:22:32.101599+0000', 'last_fullsized': '2024-09-17T05:22:32.101599+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:22:36.774 INFO:tasks.ceph.ceph_manager.ceph:PG 4.7 is not active+clean 2024-09-17T05:22:36.774 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:22:31.098954+0000', 'last_change': '2024-09-17T05:22:31.098954+0000', 'last_active': '2024-09-17T05:22:31.086017+0000', 'last_peered': '2024-09-17T05:22:31.086017+0000', 'last_clean': '2024-09-17T05:22:31.086017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:22:31.098954+0000', 'last_undegraded': '2024-09-17T05:22:31.098954+0000', 'last_fullsized': '2024-09-17T05:22:31.098954+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:22:31.086017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:22:31.086017+0000', 'last_clean_scrub_stamp': '2024-09-17T05:22:31.086017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:22:36.775 INFO:tasks.ceph.ceph_manager.ceph:PG 5.7 is not active+clean 2024-09-17T05:22:36.775 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:22:32.106313+0000', 'last_change': '2024-09-17T05:22:32.106313+0000', 'last_active': '2024-09-17T05:22:32.090862+0000', 'last_peered': '2024-09-17T05:22:32.090862+0000', 'last_clean': '2024-09-17T05:22:32.090862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:22:32.106313+0000', 'last_undegraded': '2024-09-17T05:22:32.106313+0000', 'last_fullsized': '2024-09-17T05:22:32.106313+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:22:36.775 INFO:tasks.ceph.ceph_manager.ceph:PG 4.4 is not active+clean 2024-09-17T05:22:36.775 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:22:31.099095+0000', 'last_change': '2024-09-17T05:22:31.099095+0000', 'last_active': '2024-09-17T05:22:31.086017+0000', 'last_peered': '2024-09-17T05:22:31.086017+0000', 'last_clean': '2024-09-17T05:22:31.086017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:22:31.099095+0000', 'last_undegraded': '2024-09-17T05:22:31.099095+0000', 'last_fullsized': '2024-09-17T05:22:31.099095+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:22:31.086017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:22:31.086017+0000', 'last_clean_scrub_stamp': '2024-09-17T05:22:31.086017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:22:36.775 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2 is not active+clean 2024-09-17T05:22:36.775 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:22:32.102446+0000', 'last_change': '2024-09-17T05:22:32.102446+0000', 'last_active': '2024-09-17T05:22:32.090862+0000', 'last_peered': '2024-09-17T05:22:32.090862+0000', 'last_clean': '2024-09-17T05:22:32.090862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:22:32.102446+0000', 'last_undegraded': '2024-09-17T05:22:32.102446+0000', 'last_fullsized': '2024-09-17T05:22:32.102446+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:22:36.775 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2 is not active+clean 2024-09-17T05:22:36.775 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:22:31.098914+0000', 'last_change': '2024-09-17T05:22:31.098914+0000', 'last_active': '2024-09-17T05:22:31.086017+0000', 'last_peered': '2024-09-17T05:22:31.086017+0000', 'last_clean': '2024-09-17T05:22:31.086017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:22:31.098914+0000', 'last_undegraded': '2024-09-17T05:22:31.098914+0000', 'last_fullsized': '2024-09-17T05:22:31.098914+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:22:31.086017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:22:31.086017+0000', 'last_clean_scrub_stamp': '2024-09-17T05:22:31.086017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:22:36.775 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1 is not active+clean 2024-09-17T05:22:36.775 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:22:32.099530+0000', 'last_change': '2024-09-17T05:22:32.099530+0000', 'last_active': '2024-09-17T05:22:32.090862+0000', 'last_peered': '2024-09-17T05:22:32.090862+0000', 'last_clean': '2024-09-17T05:22:32.090862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:22:32.099530+0000', 'last_undegraded': '2024-09-17T05:22:32.099530+0000', 'last_fullsized': '2024-09-17T05:22:32.099530+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:22:36.775 INFO:tasks.ceph.ceph_manager.ceph:PG 5.4 is not active+clean 2024-09-17T05:22:36.776 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:22:32.100898+0000', 'last_change': '2024-09-17T05:22:32.100898+0000', 'last_active': '2024-09-17T05:22:32.090862+0000', 'last_peered': '2024-09-17T05:22:32.090862+0000', 'last_clean': '2024-09-17T05:22:32.090862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:22:32.100898+0000', 'last_undegraded': '2024-09-17T05:22:32.100898+0000', 'last_fullsized': '2024-09-17T05:22:32.100898+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:22:32.090862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:22:36.776 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T05:22:36.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.902+0000 7efc1be0f640 1 -- 172.21.15.98:0/2914919840 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc140b2be0 msgr2=0x7efc140b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:36.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.902+0000 7efc1be0f640 1 --2- 172.21.15.98:0/2914919840 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc140b2be0 0x7efc140b3090 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7efc0c005fd0 tx=0x7efc0c02aa90 comp rx=0 tx=0).stop 2024-09-17T05:22:36.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.902+0000 7efc1be0f640 1 -- 172.21.15.98:0/2914919840 shutdown_connections 2024-09-17T05:22:36.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.902+0000 7efc1be0f640 1 --2- 172.21.15.98:0/2914919840 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc140b2be0 0x7efc140b3090 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:36.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.902+0000 7efc1be0f640 1 --2- 172.21.15.98:0/2914919840 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc1415b070 0x7efc140727c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:36.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.902+0000 7efc1be0f640 1 -- 172.21.15.98:0/2914919840 >> 172.21.15.98:0/2914919840 conn(0x7efc140b18e0 msgr2=0x7efc140b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:36.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.902+0000 7efc1be0f640 1 -- 172.21.15.98:0/2914919840 shutdown_connections 2024-09-17T05:22:36.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.902+0000 7efc1be0f640 1 -- 172.21.15.98:0/2914919840 wait complete. 2024-09-17T05:22:36.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.903+0000 7efc1be0f640 1 Processor -- start 2024-09-17T05:22:36.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.903+0000 7efc1be0f640 1 -- start start 2024-09-17T05:22:36.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.904+0000 7efc1be0f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc140b2be0 0x7efc14154950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:36.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.904+0000 7efc1be0f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc140b4b80 0x7efc141f3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:36.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.904+0000 7efc1be0f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc14154f70 0x7efc141e8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:36.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.904+0000 7efc1be0f640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7efc1406eb30 con 0x7efc140b2be0 2024-09-17T05:22:36.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.904+0000 7efc1be0f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7efc1406e9b0 con 0x7efc14154f70 2024-09-17T05:22:36.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.904+0000 7efc1be0f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7efc1406ecb0 con 0x7efc140b4b80 2024-09-17T05:22:36.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.904+0000 7efc19bab640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc140b2be0 0x7efc14154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:36.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.904+0000 7efc19bab640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc140b2be0 0x7efc14154950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46770/0 (socket says 172.21.15.98:46770) 2024-09-17T05:22:36.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.904+0000 7efc19bab640 1 -- 172.21.15.98:0/1802767415 learned_addr learned my addr 172.21.15.98:0/1802767415 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:36.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.904+0000 7efc1a3ac640 1 --2- 172.21.15.98:0/1802767415 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc14154f70 0x7efc141e8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:36.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.904+0000 7efc193aa640 1 --2- 172.21.15.98:0/1802767415 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc140b4b80 0x7efc141f3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:36.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.904+0000 7efc19bab640 1 -- 172.21.15.98:0/1802767415 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc140b4b80 msgr2=0x7efc141f3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:36.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.904+0000 7efc19bab640 1 --2- 172.21.15.98:0/1802767415 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc140b4b80 0x7efc141f3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:36.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.904+0000 7efc19bab640 1 -- 172.21.15.98:0/1802767415 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc14154f70 msgr2=0x7efc141e8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:36.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.904+0000 7efc19bab640 1 --2- 172.21.15.98:0/1802767415 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc14154f70 0x7efc141e8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:36.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.904+0000 7efc19bab640 1 -- 172.21.15.98:0/1802767415 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc141f4060 con 0x7efc140b2be0 2024-09-17T05:22:36.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.904+0000 7efc193aa640 1 --2- 172.21.15.98:0/1802767415 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc140b4b80 0x7efc141f3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:22:36.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.904+0000 7efc19bab640 1 --2- 172.21.15.98:0/1802767415 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc140b2be0 0x7efc14154950 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7efc1000c9a0 tx=0x7efc1000ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:36.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.904+0000 7efc0a7fc640 1 -- 172.21.15.98:0/1802767415 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc10007bb0 con 0x7efc140b2be0 2024-09-17T05:22:36.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.904+0000 7efc0a7fc640 1 -- 172.21.15.98:0/1802767415 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efc10007e40 con 0x7efc140b2be0 2024-09-17T05:22:36.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.904+0000 7efc1be0f640 1 -- 172.21.15.98:0/1802767415 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc141f3560 con 0x7efc140b2be0 2024-09-17T05:22:36.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.904+0000 7efc0a7fc640 1 -- 172.21.15.98:0/1802767415 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc1000f690 con 0x7efc140b2be0 2024-09-17T05:22:36.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.904+0000 7efc1be0f640 1 -- 172.21.15.98:0/1802767415 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc1409ac10 con 0x7efc140b2be0 2024-09-17T05:22:36.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.905+0000 7efc1be0f640 1 -- 172.21.15.98:0/1802767415 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc14069360 con 0x7efc140b2be0 2024-09-17T05:22:36.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.906+0000 7efc0a7fc640 1 -- 172.21.15.98:0/1802767415 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efc1000f830 con 0x7efc140b2be0 2024-09-17T05:22:36.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.907+0000 7efc0a7fc640 1 --2- 172.21.15.98:0/1802767415 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7efbf8078b90 0x7efbf807b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:36.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.907+0000 7efc0a7fc640 1 -- 172.21.15.98:0/1802767415 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7efc1009b420 con 0x7efc140b2be0 2024-09-17T05:22:36.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.907+0000 7efc193aa640 1 --2- 172.21.15.98:0/1802767415 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7efbf8078b90 0x7efbf807b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:36.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.907+0000 7efc193aa640 1 --2- 172.21.15.98:0/1802767415 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7efbf8078b90 0x7efbf807b050 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7efc141559c0 tx=0x7efc04009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:36.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:36.911+0000 7efc0a7fc640 1 -- 172.21.15.98:0/1802767415 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7efc10014030 con 0x7efc140b2be0 2024-09-17T05:22:37.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.157+0000 7efc1be0f640 1 -- 172.21.15.98:0/1802767415 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7efc140b40c0 con 0x7efc140b2be0 2024-09-17T05:22:37.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.158+0000 7efc0a7fc640 1 -- 172.21.15.98:0/1802767415 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+2828 (secure 0 0 0) 0x7efc140b40c0 con 0x7efc140b2be0 2024-09-17T05:22:37.159 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:22:37.159 INFO:teuthology.orchestra.run.smithi098.stdout:{"fsid":"fcbf5a43-b3d8-497c-b15d-3cc022477cf0","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":67,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":32,"num_osds":8,"num_up_osds":8,"osd_up_since":1726550502,"num_in_osds":8,"osd_in_since":1726550492,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":50},{"state_name":"creating+peering","count":39},{"state_name":"unknown","count":8}],"num_pgs":97,"num_pools":3,"num_objects":13,"data_bytes":591980,"bytes_used":229445632,"bytes_avail":772864667648,"bytes_total":773094113280,"unknown_pgs_ratio":0.082474224269390106,"inactive_pgs_ratio":0.40206184983253479,"write_bytes_sec":595,"read_op_per_sec":0,"write_op_per_sec":4},"fsmap":{"epoch":14,"btime":"2024-09-17T05:22:35:113505+0000","id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"b","status":"up:active","gid":4890}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-17T05:22:36.256660+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T05:22:37.161 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.160+0000 7efc1be0f640 1 -- 172.21.15.98:0/1802767415 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7efbf8078b90 msgr2=0x7efbf807b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:37.161 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.160+0000 7efc1be0f640 1 --2- 172.21.15.98:0/1802767415 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7efbf8078b90 0x7efbf807b050 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7efc141559c0 tx=0x7efc04009040 comp rx=0 tx=0).stop 2024-09-17T05:22:37.161 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.160+0000 7efc1be0f640 1 -- 172.21.15.98:0/1802767415 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc140b2be0 msgr2=0x7efc14154950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:37.161 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.160+0000 7efc1be0f640 1 --2- 172.21.15.98:0/1802767415 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc140b2be0 0x7efc14154950 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7efc1000c9a0 tx=0x7efc1000ce60 comp rx=0 tx=0).stop 2024-09-17T05:22:37.161 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.160+0000 7efc1be0f640 1 -- 172.21.15.98:0/1802767415 shutdown_connections 2024-09-17T05:22:37.161 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.160+0000 7efc1be0f640 1 --2- 172.21.15.98:0/1802767415 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7efbf8078b90 0x7efbf807b050 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:37.161 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.160+0000 7efc1be0f640 1 --2- 172.21.15.98:0/1802767415 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc14154f70 0x7efc141e8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:37.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.160+0000 7efc1be0f640 1 --2- 172.21.15.98:0/1802767415 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc140b4b80 0x7efc141f3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:37.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.160+0000 7efc1be0f640 1 --2- 172.21.15.98:0/1802767415 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc140b2be0 0x7efc14154950 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:37.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.160+0000 7efc1be0f640 1 -- 172.21.15.98:0/1802767415 >> 172.21.15.98:0/1802767415 conn(0x7efc140b18e0 msgr2=0x7efc1415a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:37.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.160+0000 7efc1be0f640 1 -- 172.21.15.98:0/1802767415 shutdown_connections 2024-09-17T05:22:37.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.160+0000 7efc1be0f640 1 -- 172.21.15.98:0/1802767415 wait complete. 2024-09-17T05:22:37.172 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T05:22:37.172 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:22:37.273 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.272+0000 7fa355945640 1 -- 172.21.15.98:0/2167305286 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3500d4ac0 msgr2=0x7fa3500b38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:37.273 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.272+0000 7fa355945640 1 --2- 172.21.15.98:0/2167305286 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3500d4ac0 0x7fa3500b38d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa3501619f0 tx=0x7fa34402a560 comp rx=0 tx=0).stop 2024-09-17T05:22:37.273 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.272+0000 7fa355945640 1 -- 172.21.15.98:0/2167305286 shutdown_connections 2024-09-17T05:22:37.273 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.272+0000 7fa355945640 1 --2- 172.21.15.98:0/2167305286 >> v2:172.21.15.167:3300/0 conn(0x7fa3500d0940 0x7fa3500d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:37.273 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.272+0000 7fa355945640 1 --2- 172.21.15.98:0/2167305286 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3500d4ac0 0x7fa3500b38d0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:37.273 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.272+0000 7fa355945640 1 --2- 172.21.15.98:0/2167305286 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa35015e090 0x7fa3500d23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:37.273 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.272+0000 7fa355945640 1 -- 172.21.15.98:0/2167305286 >> 172.21.15.98:0/2167305286 conn(0x7fa3500d3fa0 msgr2=0x7fa3500d43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:37.273 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.272+0000 7fa355945640 1 -- 172.21.15.98:0/2167305286 shutdown_connections 2024-09-17T05:22:37.273 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.272+0000 7fa355945640 1 -- 172.21.15.98:0/2167305286 wait complete. 2024-09-17T05:22:37.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.273+0000 7fa355945640 1 Processor -- start 2024-09-17T05:22:37.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.273+0000 7fa355945640 1 -- start start 2024-09-17T05:22:37.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.274+0000 7fa355945640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa3500d0940 0x7fa3501f7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:37.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.274+0000 7fa355945640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3500d4ac0 0x7fa3500b9580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:37.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.274+0000 7fa355945640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa35015e090 0x7fa3500cda50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:37.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.274+0000 7fa355945640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa3500cf700 con 0x7fa35015e090 2024-09-17T05:22:37.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.274+0000 7fa355945640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa3500ceca0 con 0x7fa3500d4ac0 2024-09-17T05:22:37.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.274+0000 7fa355945640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fa3500cf880 con 0x7fa3500d0940 2024-09-17T05:22:37.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.274+0000 7fa34f7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa35015e090 0x7fa3500cda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:37.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.274+0000 7fa34f7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa35015e090 0x7fa3500cda50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46782/0 (socket says 172.21.15.98:46782) 2024-09-17T05:22:37.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.274+0000 7fa34f7fe640 1 -- 172.21.15.98:0/788073707 learned_addr learned my addr 172.21.15.98:0/788073707 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:37.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.274+0000 7fa34effd640 1 --2- 172.21.15.98:0/788073707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa3500d0940 0x7fa3501f7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:37.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.274+0000 7fa34e7fc640 1 --2- 172.21.15.98:0/788073707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3500d4ac0 0x7fa3500b9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:37.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.274+0000 7fa34f7fe640 1 -- 172.21.15.98:0/788073707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa3500d0940 msgr2=0x7fa3501f7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:37.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.274+0000 7fa34f7fe640 1 --2- 172.21.15.98:0/788073707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa3500d0940 0x7fa3501f7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:37.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.274+0000 7fa34f7fe640 1 -- 172.21.15.98:0/788073707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3500d4ac0 msgr2=0x7fa3500b9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:37.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.274+0000 7fa34f7fe640 1 --2- 172.21.15.98:0/788073707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3500d4ac0 0x7fa3500b9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:37.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.275+0000 7fa34f7fe640 1 -- 172.21.15.98:0/788073707 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3501f48f0 con 0x7fa35015e090 2024-09-17T05:22:37.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.275+0000 7fa34f7fe640 1 --2- 172.21.15.98:0/788073707 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa35015e090 0x7fa3500cda50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa34800cb00 tx=0x7fa34800a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:37.278 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.275+0000 7fa337fff640 1 -- 172.21.15.98:0/788073707 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa348004b20 con 0x7fa35015e090 2024-09-17T05:22:37.278 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.275+0000 7fa337fff640 1 -- 172.21.15.98:0/788073707 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa348004db0 con 0x7fa35015e090 2024-09-17T05:22:37.278 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.275+0000 7fa355945640 1 -- 172.21.15.98:0/788073707 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3501f8460 con 0x7fa35015e090 2024-09-17T05:22:37.278 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.275+0000 7fa337fff640 1 -- 172.21.15.98:0/788073707 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa348005280 con 0x7fa35015e090 2024-09-17T05:22:37.278 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.275+0000 7fa355945640 1 -- 172.21.15.98:0/788073707 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3501f8a20 con 0x7fa35015e090 2024-09-17T05:22:37.279 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.276+0000 7fa355945640 1 -- 172.21.15.98:0/788073707 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3500b38d0 con 0x7fa35015e090 2024-09-17T05:22:37.279 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.276+0000 7fa337fff640 1 -- 172.21.15.98:0/788073707 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa348005420 con 0x7fa35015e090 2024-09-17T05:22:37.279 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.277+0000 7fa337fff640 1 --2- 172.21.15.98:0/788073707 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fa33c078b90 0x7fa33c07b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:37.279 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.277+0000 7fa337fff640 1 -- 172.21.15.98:0/788073707 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fa34809b3e0 con 0x7fa35015e090 2024-09-17T05:22:37.279 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.277+0000 7fa34effd640 1 --2- 172.21.15.98:0/788073707 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fa33c078b90 0x7fa33c07b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:37.279 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.278+0000 7fa34effd640 1 --2- 172.21.15.98:0/788073707 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fa33c078b90 0x7fa33c07b050 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa3400098e0 tx=0x7fa340009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:37.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.281+0000 7fa337fff640 1 -- 172.21.15.98:0/788073707 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fa348014030 con 0x7fa35015e090 2024-09-17T05:22:37.454 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.453+0000 7fa355945640 1 -- 172.21.15.98:0/788073707 --> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa3500b9ac0 con 0x7fa33c078b90 2024-09-17T05:22:37.458 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.458+0000 7fa337fff640 1 -- 172.21.15.98:0/788073707 <== mgr.4103 v2:172.21.15.167:6800/610796449 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247577 (secure 0 0 0) 0x7fa3500b9ac0 con 0x7fa33c078b90 2024-09-17T05:22:37.461 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:22:37.463 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-17T05:22:37.464 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.461+0000 7fa355945640 1 -- 172.21.15.98:0/788073707 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fa33c078b90 msgr2=0x7fa33c07b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:37.464 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.461+0000 7fa355945640 1 --2- 172.21.15.98:0/788073707 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fa33c078b90 0x7fa33c07b050 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa3400098e0 tx=0x7fa340009060 comp rx=0 tx=0).stop 2024-09-17T05:22:37.464 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.461+0000 7fa355945640 1 -- 172.21.15.98:0/788073707 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa35015e090 msgr2=0x7fa3500cda50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:37.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.461+0000 7fa355945640 1 --2- 172.21.15.98:0/788073707 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa35015e090 0x7fa3500cda50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa34800cb00 tx=0x7fa34800a250 comp rx=0 tx=0).stop 2024-09-17T05:22:37.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.461+0000 7fa355945640 1 -- 172.21.15.98:0/788073707 shutdown_connections 2024-09-17T05:22:37.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.461+0000 7fa355945640 1 --2- 172.21.15.98:0/788073707 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fa33c078b90 0x7fa33c07b050 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:37.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.461+0000 7fa355945640 1 --2- 172.21.15.98:0/788073707 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa35015e090 0x7fa3500cda50 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:37.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.461+0000 7fa355945640 1 --2- 172.21.15.98:0/788073707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3500d4ac0 0x7fa3500b9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:37.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.461+0000 7fa355945640 1 --2- 172.21.15.98:0/788073707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa3500d0940 0x7fa3501f7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:37.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.461+0000 7fa355945640 1 -- 172.21.15.98:0/788073707 >> 172.21.15.98:0/788073707 conn(0x7fa3500d3fa0 msgr2=0x7fa3500b60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:37.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.461+0000 7fa355945640 1 -- 172.21.15.98:0/788073707 shutdown_connections 2024-09-17T05:22:37.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:37.461+0000 7fa355945640 1 -- 172.21.15.98:0/788073707 wait complete. 2024-09-17T05:22:37.473 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2024-09-17T05:22:36.256613+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591980,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":126,"num_write_kb":1631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":93,"ondisk_log_size":93,"up":178,"acting":178,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":37,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224068,"kb_used_data":3672,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750652,"statfs":{"total":773094113280,"available":772864667648,"internally_reserved":0,"allocated":3760128,"data_stored":2143652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1612,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.158226"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.103573+0000","last_change":"2024-09-17T05:22:32.103573+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.103573+0000","last_undegraded":"2024-09-17T05:22:32.103573+0000","last_fullsized":"2024-09-17T05:22:32.103573+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.126491+0000","last_change":"2024-09-17T05:22:33.116777+0000","last_active":"2024-09-17T05:22:33.126491+0000","last_peered":"2024-09-17T05:22:33.126491+0000","last_clean":"2024-09-17T05:22:33.126491+0000","last_became_active":"2024-09-17T05:22:33.116516+0000","last_became_peered":"2024-09-17T05:22:33.116516+0000","last_unstale":"2024-09-17T05:22:33.126491+0000","last_undegraded":"2024-09-17T05:22:33.126491+0000","last_fullsized":"2024-09-17T05:22:33.126491+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:11:33.740686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.107279+0000","last_change":"2024-09-17T05:22:32.107279+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.107279+0000","last_undegraded":"2024-09-17T05:22:32.107279+0000","last_fullsized":"2024-09-17T05:22:32.107279+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:22:32.090862+0000","last_change":"2024-09-17T05:22:32.090862+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.090862+0000","last_undegraded":"2024-09-17T05:22:32.090862+0000","last_fullsized":"2024-09-17T05:22:32.090862+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.118319+0000","last_change":"2024-09-17T05:22:33.111841+0000","last_active":"2024-09-17T05:22:33.118319+0000","last_peered":"2024-09-17T05:22:33.118319+0000","last_clean":"2024-09-17T05:22:33.118319+0000","last_became_active":"2024-09-17T05:22:33.111527+0000","last_became_peered":"2024-09-17T05:22:33.111527+0000","last_unstale":"2024-09-17T05:22:33.118319+0000","last_undegraded":"2024-09-17T05:22:33.118319+0000","last_fullsized":"2024-09-17T05:22:33.118319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:08.676086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.134538+0000","last_change":"2024-09-17T05:22:33.129531+0000","last_active":"2024-09-17T05:22:33.134538+0000","last_peered":"2024-09-17T05:22:33.134538+0000","last_clean":"2024-09-17T05:22:33.134538+0000","last_became_active":"2024-09-17T05:22:33.129298+0000","last_became_peered":"2024-09-17T05:22:33.129298+0000","last_unstale":"2024-09-17T05:22:33.134538+0000","last_undegraded":"2024-09-17T05:22:33.134538+0000","last_fullsized":"2024-09-17T05:22:33.134538+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:24:49.441913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.104413+0000","last_change":"2024-09-17T05:22:32.104413+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.104413+0000","last_undegraded":"2024-09-17T05:22:32.104413+0000","last_fullsized":"2024-09-17T05:22:32.104413+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.103975+0000","last_change":"2024-09-17T05:22:32.103975+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.103975+0000","last_undegraded":"2024-09-17T05:22:32.103975+0000","last_fullsized":"2024-09-17T05:22:32.103975+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.100213+0000","last_change":"2024-09-17T05:22:32.100213+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.100213+0000","last_undegraded":"2024-09-17T05:22:32.100213+0000","last_fullsized":"2024-09-17T05:22:32.100213+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:22:32.090862+0000","last_change":"2024-09-17T05:22:32.090862+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.090862+0000","last_undegraded":"2024-09-17T05:22:32.090862+0000","last_fullsized":"2024-09-17T05:22:32.090862+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.102694+0000","last_change":"2024-09-17T05:22:32.102694+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.102694+0000","last_undegraded":"2024-09-17T05:22:32.102694+0000","last_fullsized":"2024-09-17T05:22:32.102694+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.103820+0000","last_change":"2024-09-17T05:22:32.103820+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.103820+0000","last_undegraded":"2024-09-17T05:22:32.103820+0000","last_fullsized":"2024-09-17T05:22:32.103820+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.126132+0000","last_change":"2024-09-17T05:22:33.122187+0000","last_active":"2024-09-17T05:22:33.126132+0000","last_peered":"2024-09-17T05:22:33.126132+0000","last_clean":"2024-09-17T05:22:33.126132+0000","last_became_active":"2024-09-17T05:22:33.121907+0000","last_became_peered":"2024-09-17T05:22:33.121907+0000","last_unstale":"2024-09-17T05:22:33.126132+0000","last_undegraded":"2024-09-17T05:22:33.126132+0000","last_fullsized":"2024-09-17T05:22:33.126132+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:00:38.010787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.126610+0000","last_change":"2024-09-17T05:22:33.119051+0000","last_active":"2024-09-17T05:22:33.126610+0000","last_peered":"2024-09-17T05:22:33.126610+0000","last_clean":"2024-09-17T05:22:33.126610+0000","last_became_active":"2024-09-17T05:22:33.118758+0000","last_became_peered":"2024-09-17T05:22:33.118758+0000","last_unstale":"2024-09-17T05:22:33.126610+0000","last_undegraded":"2024-09-17T05:22:33.126610+0000","last_fullsized":"2024-09-17T05:22:33.126610+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:16:18.864713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.105887+0000","last_change":"2024-09-17T05:22:32.105887+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.105887+0000","last_undegraded":"2024-09-17T05:22:32.105887+0000","last_fullsized":"2024-09-17T05:22:32.105887+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.103203+0000","last_change":"2024-09-17T05:22:32.103203+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.103203+0000","last_undegraded":"2024-09-17T05:22:32.103203+0000","last_fullsized":"2024-09-17T05:22:32.103203+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.104894+0000","last_change":"2024-09-17T05:22:32.104894+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.104894+0000","last_undegraded":"2024-09-17T05:22:32.104894+0000","last_fullsized":"2024-09-17T05:22:32.104894+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.134490+0000","last_change":"2024-09-17T05:22:33.126595+0000","last_active":"2024-09-17T05:22:33.134490+0000","last_peered":"2024-09-17T05:22:33.134490+0000","last_clean":"2024-09-17T05:22:33.134490+0000","last_became_active":"2024-09-17T05:22:33.126328+0000","last_became_peered":"2024-09-17T05:22:33.126328+0000","last_unstale":"2024-09-17T05:22:33.134490+0000","last_undegraded":"2024-09-17T05:22:33.134490+0000","last_fullsized":"2024-09-17T05:22:33.134490+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:34:26.391003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.131795+0000","last_change":"2024-09-17T05:22:33.124786+0000","last_active":"2024-09-17T05:22:33.131795+0000","last_peered":"2024-09-17T05:22:33.131795+0000","last_clean":"2024-09-17T05:22:33.131795+0000","last_became_active":"2024-09-17T05:22:33.124527+0000","last_became_peered":"2024-09-17T05:22:33.124527+0000","last_unstale":"2024-09-17T05:22:33.131795+0000","last_undegraded":"2024-09-17T05:22:33.131795+0000","last_fullsized":"2024-09-17T05:22:33.131795+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:54:51.462172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.134408+0000","last_change":"2024-09-17T05:22:33.129657+0000","last_active":"2024-09-17T05:22:33.134408+0000","last_peered":"2024-09-17T05:22:33.134408+0000","last_clean":"2024-09-17T05:22:33.134408+0000","last_became_active":"2024-09-17T05:22:33.129360+0000","last_became_peered":"2024-09-17T05:22:33.129360+0000","last_unstale":"2024-09-17T05:22:33.134408+0000","last_undegraded":"2024-09-17T05:22:33.134408+0000","last_fullsized":"2024-09-17T05:22:33.134408+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:20.372997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.100812+0000","last_change":"2024-09-17T05:22:32.100812+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.100812+0000","last_undegraded":"2024-09-17T05:22:32.100812+0000","last_fullsized":"2024-09-17T05:22:32.100812+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.100516+0000","last_change":"2024-09-17T05:22:32.100516+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.100516+0000","last_undegraded":"2024-09-17T05:22:32.100516+0000","last_fullsized":"2024-09-17T05:22:32.100516+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.116601+0000","last_change":"2024-09-17T05:22:33.114614+0000","last_active":"2024-09-17T05:22:33.116601+0000","last_peered":"2024-09-17T05:22:33.116601+0000","last_clean":"2024-09-17T05:22:33.116601+0000","last_became_active":"2024-09-17T05:22:33.114367+0000","last_became_peered":"2024-09-17T05:22:33.114367+0000","last_unstale":"2024-09-17T05:22:33.116601+0000","last_undegraded":"2024-09-17T05:22:33.116601+0000","last_fullsized":"2024-09-17T05:22:33.116601+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:55:40.665695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.105440+0000","last_change":"2024-09-17T05:22:32.105440+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.105440+0000","last_undegraded":"2024-09-17T05:22:32.105440+0000","last_fullsized":"2024-09-17T05:22:32.105440+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:22:32.090862+0000","last_change":"2024-09-17T05:22:32.090862+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.090862+0000","last_undegraded":"2024-09-17T05:22:32.090862+0000","last_fullsized":"2024-09-17T05:22:32.090862+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.126512+0000","last_change":"2024-09-17T05:22:33.117947+0000","last_active":"2024-09-17T05:22:33.126512+0000","last_peered":"2024-09-17T05:22:33.126512+0000","last_clean":"2024-09-17T05:22:33.126512+0000","last_became_active":"2024-09-17T05:22:33.117035+0000","last_became_peered":"2024-09-17T05:22:33.117035+0000","last_unstale":"2024-09-17T05:22:33.126512+0000","last_undegraded":"2024-09-17T05:22:33.126512+0000","last_fullsized":"2024-09-17T05:22:33.126512+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:03:01.527461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:22:32.090862+0000","last_change":"2024-09-17T05:22:32.090862+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.090862+0000","last_undegraded":"2024-09-17T05:22:32.090862+0000","last_fullsized":"2024-09-17T05:22:32.090862+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.103312+0000","last_change":"2024-09-17T05:22:32.103312+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.103312+0000","last_undegraded":"2024-09-17T05:22:32.103312+0000","last_fullsized":"2024-09-17T05:22:32.103312+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.100364+0000","last_change":"2024-09-17T05:22:32.100364+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.100364+0000","last_undegraded":"2024-09-17T05:22:32.100364+0000","last_fullsized":"2024-09-17T05:22:32.100364+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.102243+0000","last_change":"2024-09-17T05:22:32.102243+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.102243+0000","last_undegraded":"2024-09-17T05:22:32.102243+0000","last_fullsized":"2024-09-17T05:22:32.102243+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.101675+0000","last_change":"2024-09-17T05:22:32.101675+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.101675+0000","last_undegraded":"2024-09-17T05:22:32.101675+0000","last_fullsized":"2024-09-17T05:22:32.101675+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.102712+0000","last_change":"2024-09-17T05:22:32.102712+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.102712+0000","last_undegraded":"2024-09-17T05:22:32.102712+0000","last_fullsized":"2024-09-17T05:22:32.102712+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.116637+0000","last_change":"2024-09-17T05:22:33.113816+0000","last_active":"2024-09-17T05:22:33.116637+0000","last_peered":"2024-09-17T05:22:33.116637+0000","last_clean":"2024-09-17T05:22:33.116637+0000","last_became_active":"2024-09-17T05:22:33.113489+0000","last_became_peered":"2024-09-17T05:22:33.113489+0000","last_unstale":"2024-09-17T05:22:33.116637+0000","last_undegraded":"2024-09-17T05:22:33.116637+0000","last_fullsized":"2024-09-17T05:22:33.116637+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:24:12.851750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:22:32.115027+0000","last_change":"2024-09-17T05:22:32.113612+0000","last_active":"2024-09-17T05:22:32.115027+0000","last_peered":"2024-09-17T05:22:32.115027+0000","last_clean":"2024-09-17T05:22:32.115027+0000","last_became_active":"2024-09-17T05:22:32.113283+0000","last_became_peered":"2024-09-17T05:22:32.113283+0000","last_unstale":"2024-09-17T05:22:32.115027+0000","last_undegraded":"2024-09-17T05:22:32.115027+0000","last_fullsized":"2024-09-17T05:22:32.115027+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:34:14.594010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.102140+0000","last_change":"2024-09-17T05:22:32.102140+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.102140+0000","last_undegraded":"2024-09-17T05:22:32.102140+0000","last_fullsized":"2024-09-17T05:22:32.102140+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.131245+0000","last_change":"2024-09-17T05:22:32.110226+0000","last_active":"2024-09-17T05:22:33.131245+0000","last_peered":"2024-09-17T05:22:33.131245+0000","last_clean":"2024-09-17T05:22:33.131245+0000","last_became_active":"2024-09-17T05:22:32.109954+0000","last_became_peered":"2024-09-17T05:22:32.109954+0000","last_unstale":"2024-09-17T05:22:33.131245+0000","last_undegraded":"2024-09-17T05:22:33.131245+0000","last_fullsized":"2024-09-17T05:22:33.131245+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:40.467869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.100405+0000","last_change":"2024-09-17T05:22:32.100405+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.100405+0000","last_undegraded":"2024-09-17T05:22:32.100405+0000","last_fullsized":"2024-09-17T05:22:32.100405+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.127957+0000","last_change":"2024-09-17T05:22:32.114627+0000","last_active":"2024-09-17T05:22:33.127957+0000","last_peered":"2024-09-17T05:22:33.127957+0000","last_clean":"2024-09-17T05:22:33.127957+0000","last_became_active":"2024-09-17T05:22:32.114380+0000","last_became_peered":"2024-09-17T05:22:32.114380+0000","last_unstale":"2024-09-17T05:22:33.127957+0000","last_undegraded":"2024-09-17T05:22:33.127957+0000","last_fullsized":"2024-09-17T05:22:33.127957+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:50:22.991581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:22:32.090862+0000","last_change":"2024-09-17T05:22:32.090862+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.090862+0000","last_undegraded":"2024-09-17T05:22:32.090862+0000","last_fullsized":"2024-09-17T05:22:32.090862+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.126216+0000","last_change":"2024-09-17T05:22:32.112558+0000","last_active":"2024-09-17T05:22:33.126216+0000","last_peered":"2024-09-17T05:22:33.126216+0000","last_clean":"2024-09-17T05:22:33.126216+0000","last_became_active":"2024-09-17T05:22:32.112226+0000","last_became_peered":"2024-09-17T05:22:32.112226+0000","last_unstale":"2024-09-17T05:22:33.126216+0000","last_undegraded":"2024-09-17T05:22:33.126216+0000","last_fullsized":"2024-09-17T05:22:33.126216+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:44.503659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.101721+0000","last_change":"2024-09-17T05:22:32.101721+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.101721+0000","last_undegraded":"2024-09-17T05:22:32.101721+0000","last_fullsized":"2024-09-17T05:22:32.101721+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:22:32.115807+0000","last_change":"2024-09-17T05:22:32.114701+0000","last_active":"2024-09-17T05:22:32.115807+0000","last_peered":"2024-09-17T05:22:32.115807+0000","last_clean":"2024-09-17T05:22:32.115807+0000","last_became_active":"2024-09-17T05:22:32.114418+0000","last_became_peered":"2024-09-17T05:22:32.114418+0000","last_unstale":"2024-09-17T05:22:32.115807+0000","last_undegraded":"2024-09-17T05:22:32.115807+0000","last_fullsized":"2024-09-17T05:22:32.115807+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:00:37.005942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.104951+0000","last_change":"2024-09-17T05:22:32.104951+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.104951+0000","last_undegraded":"2024-09-17T05:22:32.104951+0000","last_fullsized":"2024-09-17T05:22:32.104951+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:22:32.113826+0000","last_change":"2024-09-17T05:22:32.111748+0000","last_active":"2024-09-17T05:22:32.113826+0000","last_peered":"2024-09-17T05:22:32.113826+0000","last_clean":"2024-09-17T05:22:32.113826+0000","last_became_active":"2024-09-17T05:22:32.111430+0000","last_became_peered":"2024-09-17T05:22:32.111430+0000","last_unstale":"2024-09-17T05:22:32.113826+0000","last_undegraded":"2024-09-17T05:22:32.113826+0000","last_fullsized":"2024-09-17T05:22:32.113826+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:31.538467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.098828+0000","last_change":"2024-09-17T05:22:32.098828+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.098828+0000","last_undegraded":"2024-09-17T05:22:32.098828+0000","last_fullsized":"2024-09-17T05:22:32.098828+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.113493+0000","last_change":"2024-09-17T05:22:32.112680+0000","last_active":"2024-09-17T05:22:33.113493+0000","last_peered":"2024-09-17T05:22:33.113493+0000","last_clean":"2024-09-17T05:22:33.113493+0000","last_became_active":"2024-09-17T05:22:32.111854+0000","last_became_peered":"2024-09-17T05:22:32.111854+0000","last_unstale":"2024-09-17T05:22:33.113493+0000","last_undegraded":"2024-09-17T05:22:33.113493+0000","last_fullsized":"2024-09-17T05:22:33.113493+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:04:44.102722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:22:32.090862+0000","last_change":"2024-09-17T05:22:32.090862+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.090862+0000","last_undegraded":"2024-09-17T05:22:32.090862+0000","last_fullsized":"2024-09-17T05:22:32.090862+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:22:32.110438+0000","last_change":"2024-09-17T05:22:32.107007+0000","last_active":"2024-09-17T05:22:32.110438+0000","last_peered":"2024-09-17T05:22:32.110438+0000","last_clean":"2024-09-17T05:22:32.110438+0000","last_became_active":"2024-09-17T05:22:32.106728+0000","last_became_peered":"2024-09-17T05:22:32.106728+0000","last_unstale":"2024-09-17T05:22:32.110438+0000","last_undegraded":"2024-09-17T05:22:32.110438+0000","last_fullsized":"2024-09-17T05:22:32.110438+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:37.928289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.104338+0000","last_change":"2024-09-17T05:22:32.104338+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.104338+0000","last_undegraded":"2024-09-17T05:22:32.104338+0000","last_fullsized":"2024-09-17T05:22:32.104338+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.109645+0000","last_change":"2024-09-17T05:22:32.110685+0000","last_active":"2024-09-17T05:22:33.109645+0000","last_peered":"2024-09-17T05:22:33.109645+0000","last_clean":"2024-09-17T05:22:33.109645+0000","last_became_active":"2024-09-17T05:22:32.110434+0000","last_became_peered":"2024-09-17T05:22:32.110434+0000","last_unstale":"2024-09-17T05:22:33.109645+0000","last_undegraded":"2024-09-17T05:22:33.109645+0000","last_fullsized":"2024-09-17T05:22:33.109645+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:07:17.711718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.131828+0000","last_change":"2024-09-17T05:22:33.125565+0000","last_active":"2024-09-17T05:22:33.131828+0000","last_peered":"2024-09-17T05:22:33.131828+0000","last_clean":"2024-09-17T05:22:33.131828+0000","last_became_active":"2024-09-17T05:22:33.125307+0000","last_became_peered":"2024-09-17T05:22:33.125307+0000","last_unstale":"2024-09-17T05:22:33.131828+0000","last_undegraded":"2024-09-17T05:22:33.131828+0000","last_fullsized":"2024-09-17T05:22:33.131828+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:00:20.640357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.102748+0000","last_change":"2024-09-17T05:22:32.113885+0000","last_active":"2024-09-17T05:22:33.102748+0000","last_peered":"2024-09-17T05:22:33.102748+0000","last_clean":"2024-09-17T05:22:33.102748+0000","last_became_active":"2024-09-17T05:22:32.113348+0000","last_became_peered":"2024-09-17T05:22:32.113348+0000","last_unstale":"2024-09-17T05:22:33.102748+0000","last_undegraded":"2024-09-17T05:22:33.102748+0000","last_fullsized":"2024-09-17T05:22:33.102748+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:02:41.167223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.131890+0000","last_change":"2024-09-17T05:22:33.126125+0000","last_active":"2024-09-17T05:22:33.131890+0000","last_peered":"2024-09-17T05:22:33.131890+0000","last_clean":"2024-09-17T05:22:33.131890+0000","last_became_active":"2024-09-17T05:22:33.125624+0000","last_became_peered":"2024-09-17T05:22:33.125624+0000","last_unstale":"2024-09-17T05:22:33.131890+0000","last_undegraded":"2024-09-17T05:22:33.131890+0000","last_fullsized":"2024-09-17T05:22:33.131890+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:20:43.253271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:22:32.113210+0000","last_change":"2024-09-17T05:22:32.112204+0000","last_active":"2024-09-17T05:22:32.113210+0000","last_peered":"2024-09-17T05:22:32.113210+0000","last_clean":"2024-09-17T05:22:32.113210+0000","last_became_active":"2024-09-17T05:22:32.111922+0000","last_became_peered":"2024-09-17T05:22:32.111922+0000","last_unstale":"2024-09-17T05:22:32.113210+0000","last_undegraded":"2024-09-17T05:22:32.113210+0000","last_fullsized":"2024-09-17T05:22:32.113210+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:30:54.900213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.107714+0000","last_change":"2024-09-17T05:22:32.107714+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.107714+0000","last_undegraded":"2024-09-17T05:22:32.107714+0000","last_fullsized":"2024-09-17T05:22:32.107714+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.136195+0000","last_change":"2024-09-17T05:22:32.116128+0000","last_active":"2024-09-17T05:22:33.136195+0000","last_peered":"2024-09-17T05:22:33.136195+0000","last_clean":"2024-09-17T05:22:33.136195+0000","last_became_active":"2024-09-17T05:22:32.115820+0000","last_became_peered":"2024-09-17T05:22:32.115820+0000","last_unstale":"2024-09-17T05:22:33.136195+0000","last_undegraded":"2024-09-17T05:22:33.136195+0000","last_fullsized":"2024-09-17T05:22:33.136195+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:45:31.962824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:22:32.090862+0000","last_change":"2024-09-17T05:22:32.090862+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.090862+0000","last_undegraded":"2024-09-17T05:22:32.090862+0000","last_fullsized":"2024-09-17T05:22:32.090862+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:22:32.111457+0000","last_change":"2024-09-17T05:22:32.105639+0000","last_active":"2024-09-17T05:22:32.111457+0000","last_peered":"2024-09-17T05:22:32.111457+0000","last_clean":"2024-09-17T05:22:32.111457+0000","last_became_active":"2024-09-17T05:22:32.105366+0000","last_became_peered":"2024-09-17T05:22:32.105366+0000","last_unstale":"2024-09-17T05:22:32.111457+0000","last_undegraded":"2024-09-17T05:22:32.111457+0000","last_fullsized":"2024-09-17T05:22:32.111457+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:04.098750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.116301+0000","last_change":"2024-09-17T05:22:33.111017+0000","last_active":"2024-09-17T05:22:33.116301+0000","last_peered":"2024-09-17T05:22:33.116301+0000","last_clean":"2024-09-17T05:22:33.116301+0000","last_became_active":"2024-09-17T05:22:33.110671+0000","last_became_peered":"2024-09-17T05:22:33.110671+0000","last_unstale":"2024-09-17T05:22:33.116301+0000","last_undegraded":"2024-09-17T05:22:33.116301+0000","last_fullsized":"2024-09-17T05:22:33.116301+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:04:59.112204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-17T05:22:31.099354+0000","last_change":"2024-09-17T05:22:31.099354+0000","last_active":"2024-09-17T05:22:31.086017+0000","last_peered":"2024-09-17T05:22:31.086017+0000","last_clean":"2024-09-17T05:22:31.086017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:31.099354+0000","last_undegraded":"2024-09-17T05:22:31.099354+0000","last_fullsized":"2024-09-17T05:22:31.099354+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.101750+0000","last_change":"2024-09-17T05:22:32.101750+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.101750+0000","last_undegraded":"2024-09-17T05:22:32.101750+0000","last_fullsized":"2024-09-17T05:22:32.101750+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.115995+0000","last_change":"2024-09-17T05:22:32.111645+0000","last_active":"2024-09-17T05:22:33.115995+0000","last_peered":"2024-09-17T05:22:33.115995+0000","last_clean":"2024-09-17T05:22:33.115995+0000","last_became_active":"2024-09-17T05:22:32.111343+0000","last_became_peered":"2024-09-17T05:22:32.111343+0000","last_unstale":"2024-09-17T05:22:33.115995+0000","last_undegraded":"2024-09-17T05:22:33.115995+0000","last_fullsized":"2024-09-17T05:22:33.115995+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:44:35.681368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.101124+0000","last_change":"2024-09-17T05:22:32.101124+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.101124+0000","last_undegraded":"2024-09-17T05:22:32.101124+0000","last_fullsized":"2024-09-17T05:22:32.101124+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.132127+0000","last_change":"2024-09-17T05:22:32.112489+0000","last_active":"2024-09-17T05:22:33.132127+0000","last_peered":"2024-09-17T05:22:33.132127+0000","last_clean":"2024-09-17T05:22:33.132127+0000","last_became_active":"2024-09-17T05:22:32.112221+0000","last_became_peered":"2024-09-17T05:22:32.112221+0000","last_unstale":"2024-09-17T05:22:33.132127+0000","last_undegraded":"2024-09-17T05:22:33.132127+0000","last_fullsized":"2024-09-17T05:22:33.132127+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:14:17.389902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.099669+0000","last_change":"2024-09-17T05:22:32.099669+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.099669+0000","last_undegraded":"2024-09-17T05:22:32.099669+0000","last_fullsized":"2024-09-17T05:22:32.099669+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-17T05:22:31.099412+0000","last_change":"2024-09-17T05:22:31.099412+0000","last_active":"2024-09-17T05:22:31.086017+0000","last_peered":"2024-09-17T05:22:31.086017+0000","last_clean":"2024-09-17T05:22:31.086017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:31.099412+0000","last_undegraded":"2024-09-17T05:22:31.099412+0000","last_fullsized":"2024-09-17T05:22:31.099412+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.106749+0000","last_change":"2024-09-17T05:22:32.106749+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.106749+0000","last_undegraded":"2024-09-17T05:22:32.106749+0000","last_fullsized":"2024-09-17T05:22:32.106749+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:22:32.110402+0000","last_change":"2024-09-17T05:22:32.105623+0000","last_active":"2024-09-17T05:22:32.110402+0000","last_peered":"2024-09-17T05:22:32.110402+0000","last_clean":"2024-09-17T05:22:32.110402+0000","last_became_active":"2024-09-17T05:22:32.105328+0000","last_became_peered":"2024-09-17T05:22:32.105328+0000","last_unstale":"2024-09-17T05:22:32.110402+0000","last_undegraded":"2024-09-17T05:22:32.110402+0000","last_fullsized":"2024-09-17T05:22:32.110402+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:10.346686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:22:32.090862+0000","last_change":"2024-09-17T05:22:32.090862+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.090862+0000","last_undegraded":"2024-09-17T05:22:32.090862+0000","last_fullsized":"2024-09-17T05:22:32.090862+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:22:32.111111+0000","last_change":"2024-09-17T05:22:32.109272+0000","last_active":"2024-09-17T05:22:32.111111+0000","last_peered":"2024-09-17T05:22:32.111111+0000","last_clean":"2024-09-17T05:22:32.111111+0000","last_became_active":"2024-09-17T05:22:32.109013+0000","last_became_peered":"2024-09-17T05:22:32.109013+0000","last_unstale":"2024-09-17T05:22:32.111111+0000","last_undegraded":"2024-09-17T05:22:32.111111+0000","last_fullsized":"2024-09-17T05:22:32.111111+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:48.542813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.118374+0000","last_change":"2024-09-17T05:22:33.113978+0000","last_active":"2024-09-17T05:22:33.118374+0000","last_peered":"2024-09-17T05:22:33.118374+0000","last_clean":"2024-09-17T05:22:33.118374+0000","last_became_active":"2024-09-17T05:22:33.113492+0000","last_became_peered":"2024-09-17T05:22:33.113492+0000","last_unstale":"2024-09-17T05:22:33.118374+0000","last_undegraded":"2024-09-17T05:22:33.118374+0000","last_fullsized":"2024-09-17T05:22:33.118374+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:45:33.140357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:22:32.116497+0000","last_change":"2024-09-17T05:22:32.115027+0000","last_active":"2024-09-17T05:22:32.116497+0000","last_peered":"2024-09-17T05:22:32.116497+0000","last_clean":"2024-09-17T05:22:32.116497+0000","last_became_active":"2024-09-17T05:22:32.114435+0000","last_became_peered":"2024-09-17T05:22:32.114435+0000","last_unstale":"2024-09-17T05:22:32.116497+0000","last_undegraded":"2024-09-17T05:22:32.116497+0000","last_fullsized":"2024-09-17T05:22:32.116497+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:54:48.890240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.118065+0000","last_change":"2024-09-17T05:22:33.110478+0000","last_active":"2024-09-17T05:22:33.118065+0000","last_peered":"2024-09-17T05:22:33.118065+0000","last_clean":"2024-09-17T05:22:33.118065+0000","last_became_active":"2024-09-17T05:22:33.110196+0000","last_became_peered":"2024-09-17T05:22:33.110196+0000","last_unstale":"2024-09-17T05:22:33.118065+0000","last_undegraded":"2024-09-17T05:22:33.118065+0000","last_fullsized":"2024-09-17T05:22:33.118065+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:49.547658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.124641+0000","last_change":"2024-09-17T05:22:32.113308+0000","last_active":"2024-09-17T05:22:33.124641+0000","last_peered":"2024-09-17T05:22:33.124641+0000","last_clean":"2024-09-17T05:22:33.124641+0000","last_became_active":"2024-09-17T05:22:32.113050+0000","last_became_peered":"2024-09-17T05:22:32.113050+0000","last_unstale":"2024-09-17T05:22:33.124641+0000","last_undegraded":"2024-09-17T05:22:33.124641+0000","last_fullsized":"2024-09-17T05:22:33.124641+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:29:10.172995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.118345+0000","last_change":"2024-09-17T05:22:33.112503+0000","last_active":"2024-09-17T05:22:33.118345+0000","last_peered":"2024-09-17T05:22:33.118345+0000","last_clean":"2024-09-17T05:22:33.118345+0000","last_became_active":"2024-09-17T05:22:33.112236+0000","last_became_peered":"2024-09-17T05:22:33.112236+0000","last_unstale":"2024-09-17T05:22:33.118345+0000","last_undegraded":"2024-09-17T05:22:33.118345+0000","last_fullsized":"2024-09-17T05:22:33.118345+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:32.543311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:22:32.114344+0000","last_change":"2024-09-17T05:22:32.112694+0000","last_active":"2024-09-17T05:22:32.114344+0000","last_peered":"2024-09-17T05:22:32.114344+0000","last_clean":"2024-09-17T05:22:32.114344+0000","last_became_active":"2024-09-17T05:22:32.112438+0000","last_became_peered":"2024-09-17T05:22:32.112438+0000","last_unstale":"2024-09-17T05:22:32.114344+0000","last_undegraded":"2024-09-17T05:22:32.114344+0000","last_fullsized":"2024-09-17T05:22:32.114344+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:09:03.522949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.118145+0000","last_change":"2024-09-17T05:22:33.109656+0000","last_active":"2024-09-17T05:22:33.118145+0000","last_peered":"2024-09-17T05:22:33.118145+0000","last_clean":"2024-09-17T05:22:33.118145+0000","last_became_active":"2024-09-17T05:22:33.109356+0000","last_became_peered":"2024-09-17T05:22:33.109356+0000","last_unstale":"2024-09-17T05:22:33.118145+0000","last_undegraded":"2024-09-17T05:22:33.118145+0000","last_fullsized":"2024-09-17T05:22:33.118145+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:38.933134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:22:32.111144+0000","last_change":"2024-09-17T05:22:32.109644+0000","last_active":"2024-09-17T05:22:32.111144+0000","last_peered":"2024-09-17T05:22:32.111144+0000","last_clean":"2024-09-17T05:22:32.111144+0000","last_became_active":"2024-09-17T05:22:32.108599+0000","last_became_peered":"2024-09-17T05:22:32.108599+0000","last_unstale":"2024-09-17T05:22:32.111144+0000","last_undegraded":"2024-09-17T05:22:32.111144+0000","last_fullsized":"2024-09-17T05:22:32.111144+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:07.671241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.101599+0000","last_change":"2024-09-17T05:22:32.101599+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.101599+0000","last_undegraded":"2024-09-17T05:22:32.101599+0000","last_fullsized":"2024-09-17T05:22:32.101599+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:22:32.113819+0000","last_change":"2024-09-17T05:22:32.113056+0000","last_active":"2024-09-17T05:22:32.113819+0000","last_peered":"2024-09-17T05:22:32.113819+0000","last_clean":"2024-09-17T05:22:32.113819+0000","last_became_active":"2024-09-17T05:22:32.112769+0000","last_became_peered":"2024-09-17T05:22:32.112769+0000","last_unstale":"2024-09-17T05:22:32.113819+0000","last_undegraded":"2024-09-17T05:22:32.113819+0000","last_fullsized":"2024-09-17T05:22:32.113819+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:02:19.357061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.128853+0000","last_change":"2024-09-17T05:22:33.127577+0000","last_active":"2024-09-17T05:22:33.128853+0000","last_peered":"2024-09-17T05:22:33.128853+0000","last_clean":"2024-09-17T05:22:33.128853+0000","last_became_active":"2024-09-17T05:22:33.127321+0000","last_became_peered":"2024-09-17T05:22:33.127321+0000","last_unstale":"2024-09-17T05:22:33.128853+0000","last_undegraded":"2024-09-17T05:22:33.128853+0000","last_fullsized":"2024-09-17T05:22:33.128853+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:54:49.895084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-17T05:22:31.098954+0000","last_change":"2024-09-17T05:22:31.098954+0000","last_active":"2024-09-17T05:22:31.086017+0000","last_peered":"2024-09-17T05:22:31.086017+0000","last_clean":"2024-09-17T05:22:31.086017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:31.098954+0000","last_undegraded":"2024-09-17T05:22:31.098954+0000","last_fullsized":"2024-09-17T05:22:31.098954+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.106313+0000","last_change":"2024-09-17T05:22:32.106313+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.106313+0000","last_undegraded":"2024-09-17T05:22:32.106313+0000","last_fullsized":"2024-09-17T05:22:32.106313+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.102870+0000","last_change":"2024-09-17T05:22:32.113614+0000","last_active":"2024-09-17T05:22:33.102870+0000","last_peered":"2024-09-17T05:22:33.102870+0000","last_clean":"2024-09-17T05:22:33.102870+0000","last_became_active":"2024-09-17T05:22:32.113005+0000","last_became_peered":"2024-09-17T05:22:32.113005+0000","last_unstale":"2024-09-17T05:22:33.102870+0000","last_undegraded":"2024-09-17T05:22:33.102870+0000","last_fullsized":"2024-09-17T05:22:33.102870+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:35.883658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.126536+0000","last_change":"2024-09-17T05:22:33.123577+0000","last_active":"2024-09-17T05:22:33.126536+0000","last_peered":"2024-09-17T05:22:33.126536+0000","last_clean":"2024-09-17T05:22:33.126536+0000","last_became_active":"2024-09-17T05:22:33.123017+0000","last_became_peered":"2024-09-17T05:22:33.123017+0000","last_unstale":"2024-09-17T05:22:33.126536+0000","last_undegraded":"2024-09-17T05:22:33.126536+0000","last_fullsized":"2024-09-17T05:22:33.126536+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:32.109566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-17T05:22:31.099095+0000","last_change":"2024-09-17T05:22:31.099095+0000","last_active":"2024-09-17T05:22:31.086017+0000","last_peered":"2024-09-17T05:22:31.086017+0000","last_clean":"2024-09-17T05:22:31.086017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:31.099095+0000","last_undegraded":"2024-09-17T05:22:31.099095+0000","last_fullsized":"2024-09-17T05:22:31.099095+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.102446+0000","last_change":"2024-09-17T05:22:32.102446+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.102446+0000","last_undegraded":"2024-09-17T05:22:32.102446+0000","last_fullsized":"2024-09-17T05:22:32.102446+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.102793+0000","last_change":"2024-09-17T05:22:32.114729+0000","last_active":"2024-09-17T05:22:33.102793+0000","last_peered":"2024-09-17T05:22:33.102793+0000","last_clean":"2024-09-17T05:22:33.102793+0000","last_became_active":"2024-09-17T05:22:32.113768+0000","last_became_peered":"2024-09-17T05:22:32.113768+0000","last_unstale":"2024-09-17T05:22:33.102793+0000","last_undegraded":"2024-09-17T05:22:33.102793+0000","last_fullsized":"2024-09-17T05:22:33.102793+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:26.320381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.115791+0000","last_change":"2024-09-17T05:22:33.110012+0000","last_active":"2024-09-17T05:22:33.115791+0000","last_peered":"2024-09-17T05:22:33.115791+0000","last_clean":"2024-09-17T05:22:33.115791+0000","last_became_active":"2024-09-17T05:22:33.109695+0000","last_became_peered":"2024-09-17T05:22:33.109695+0000","last_unstale":"2024-09-17T05:22:33.115791+0000","last_undegraded":"2024-09-17T05:22:33.115791+0000","last_fullsized":"2024-09-17T05:22:33.115791+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:29.107242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-17T05:22:31.098914+0000","last_change":"2024-09-17T05:22:31.098914+0000","last_active":"2024-09-17T05:22:31.086017+0000","last_peered":"2024-09-17T05:22:31.086017+0000","last_clean":"2024-09-17T05:22:31.086017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:31.098914+0000","last_undegraded":"2024-09-17T05:22:31.098914+0000","last_fullsized":"2024-09-17T05:22:31.098914+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.132164+0000","last_change":"2024-09-17T05:22:33.125596+0000","last_active":"2024-09-17T05:22:33.132164+0000","last_peered":"2024-09-17T05:22:33.132164+0000","last_clean":"2024-09-17T05:22:33.132164+0000","last_became_active":"2024-09-17T05:22:33.125320+0000","last_became_peered":"2024-09-17T05:22:33.125320+0000","last_unstale":"2024-09-17T05:22:33.132164+0000","last_undegraded":"2024-09-17T05:22:33.132164+0000","last_fullsized":"2024-09-17T05:22:33.132164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:14:03.413516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:22:32.113967+0000","last_change":"2024-09-17T05:22:32.112210+0000","last_active":"2024-09-17T05:22:32.113967+0000","last_peered":"2024-09-17T05:22:32.113967+0000","last_clean":"2024-09-17T05:22:32.113967+0000","last_became_active":"2024-09-17T05:22:32.111748+0000","last_became_peered":"2024-09-17T05:22:32.111748+0000","last_unstale":"2024-09-17T05:22:32.113967+0000","last_undegraded":"2024-09-17T05:22:32.113967+0000","last_fullsized":"2024-09-17T05:22:32.113967+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:45:32.135513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.099530+0000","last_change":"2024-09-17T05:22:32.099530+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.099530+0000","last_undegraded":"2024-09-17T05:22:32.099530+0000","last_fullsized":"2024-09-17T05:22:32.099530+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:22:33.112366+0000","last_change":"2024-09-17T05:22:32.111929+0000","last_active":"2024-09-17T05:22:33.112366+0000","last_peered":"2024-09-17T05:22:33.112366+0000","last_clean":"2024-09-17T05:22:33.112366+0000","last_became_active":"2024-09-17T05:22:32.111570+0000","last_became_peered":"2024-09-17T05:22:32.111570+0000","last_unstale":"2024-09-17T05:22:33.112366+0000","last_undegraded":"2024-09-17T05:22:33.112366+0000","last_fullsized":"2024-09-17T05:22:33.112366+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:07:58.877603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-17T05:22:32.100898+0000","last_change":"2024-09-17T05:22:32.100898+0000","last_active":"2024-09-17T05:22:32.090862+0000","last_peered":"2024-09-17T05:22:32.090862+0000","last_clean":"2024-09-17T05:22:32.090862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:32.100898+0000","last_undegraded":"2024-09-17T05:22:32.100898+0000","last_fullsized":"2024-09-17T05:22:32.100898+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:22:32.113694+0000","last_change":"2024-09-17T05:22:32.112360+0000","last_active":"2024-09-17T05:22:32.113694+0000","last_peered":"2024-09-17T05:22:32.113694+0000","last_clean":"2024-09-17T05:22:32.113694+0000","last_became_active":"2024-09-17T05:22:32.112001+0000","last_became_peered":"2024-09-17T05:22:32.112001+0000","last_unstale":"2024-09-17T05:22:32.113694+0000","last_undegraded":"2024-09-17T05:22:32.113694+0000","last_fullsized":"2024-09-17T05:22:32.113694+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:53:37.577343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":127,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T05:22:32.097806+0000","last_change":"2024-09-17T05:21:44.086098+0000","last_active":"2024-09-17T05:22:32.097806+0000","last_peered":"2024-09-17T05:22:32.097806+0000","last_clean":"2024-09-17T05:22:32.097806+0000","last_became_active":"2024-09-17T05:21:44.083477+0000","last_became_peered":"2024-09-17T05:21:44.083477+0000","last_unstale":"2024-09-17T05:22:32.097806+0000","last_undegraded":"2024-09-17T05:22:32.097806+0000","last_fullsized":"2024-09-17T05:22:32.097806+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:42.925756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:42.925756+0000","last_clean_scrub_stamp":"2024-09-17T05:21:42.925756+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:11.410250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":112,"acting":112,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1612,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21,"ondisk_log_size":21,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":327680,"data_stored":123498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509455,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":327680,"data_stored":123498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509455,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":921600,"data_stored":713866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542157,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":909312,"data_stored":707599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542157,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":327680,"data_stored":123498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542158,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":315392,"data_stored":117231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542158,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":315392,"data_stored":117231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":315392,"data_stored":117231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:22:37.966 INFO:tasks.ceph.mds.b.smithi167.stderr:2024-09-17T05:22:37.965+0000 7f07c1d6e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:22:40.477 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:22:40.591 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.590+0000 7f53e6b3d640 1 -- 172.21.15.98:0/1393819418 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f53e00d2050 msgr2=0x7f53e00d0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:40.592 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.590+0000 7f53e6b3d640 1 --2- 172.21.15.98:0/1393819418 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f53e00d2050 0x7f53e00d0f00 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f53e008e550 tx=0x7f53c802a560 comp rx=0 tx=0).stop 2024-09-17T05:22:40.592 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.590+0000 7f53e6b3d640 1 -- 172.21.15.98:0/1393819418 shutdown_connections 2024-09-17T05:22:40.592 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.590+0000 7f53e6b3d640 1 --2- 172.21.15.98:0/1393819418 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53e00d1440 0x7f53e015e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:40.592 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.590+0000 7f53e6b3d640 1 --2- 172.21.15.98:0/1393819418 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f53e00d2050 0x7f53e00d0f00 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:40.592 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.590+0000 7f53e6b3d640 1 --2- 172.21.15.98:0/1393819418 >> v2:172.21.15.167:3300/0 conn(0x7f53e015e0d0 0x7f53e00d09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:40.592 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.590+0000 7f53e6b3d640 1 -- 172.21.15.98:0/1393819418 >> 172.21.15.98:0/1393819418 conn(0x7f53e00d3fe0 msgr2=0x7f53e00d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:40.592 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.590+0000 7f53e6b3d640 1 -- 172.21.15.98:0/1393819418 shutdown_connections 2024-09-17T05:22:40.592 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.590+0000 7f53e6b3d640 1 -- 172.21.15.98:0/1393819418 wait complete. 2024-09-17T05:22:40.595 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.592+0000 7f53e6b3d640 1 Processor -- start 2024-09-17T05:22:40.595 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.592+0000 7f53e6b3d640 1 -- start start 2024-09-17T05:22:40.595 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.593+0000 7f53e6b3d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53e00d1440 0x7f53e01f4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:40.595 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.593+0000 7f53e6b3d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f53e00d2050 0x7f53e01f72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:40.595 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.593+0000 7f53e6b3d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53e015e0d0 0x7f53e01f77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:40.595 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.593+0000 7f53e6b3d640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f53e015ed80 con 0x7f53e00d2050 2024-09-17T05:22:40.595 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.593+0000 7f53e6b3d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f53e015ec00 con 0x7f53e00d1440 2024-09-17T05:22:40.595 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.593+0000 7f53e6b3d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f53e015ef00 con 0x7f53e015e0d0 2024-09-17T05:22:40.595 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.593+0000 7f53dffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f53e00d2050 0x7f53e01f72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:40.595 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.593+0000 7f53dffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f53e00d2050 0x7f53e01f72b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46792/0 (socket says 172.21.15.98:46792) 2024-09-17T05:22:40.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.593+0000 7f53dffff640 1 -- 172.21.15.98:0/1281434647 learned_addr learned my addr 172.21.15.98:0/1281434647 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:40.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.593+0000 7f53e50da640 1 --2- 172.21.15.98:0/1281434647 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53e015e0d0 0x7f53e01f77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:40.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.593+0000 7f53e48d9640 1 --2- 172.21.15.98:0/1281434647 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53e00d1440 0x7f53e01f4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:40.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.593+0000 7f53dffff640 1 -- 172.21.15.98:0/1281434647 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53e015e0d0 msgr2=0x7f53e01f77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:40.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.593+0000 7f53dffff640 1 --2- 172.21.15.98:0/1281434647 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53e015e0d0 0x7f53e01f77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:40.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.593+0000 7f53dffff640 1 -- 172.21.15.98:0/1281434647 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53e00d1440 msgr2=0x7f53e01f4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:40.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.593+0000 7f53dffff640 1 --2- 172.21.15.98:0/1281434647 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53e00d1440 0x7f53e01f4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:40.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.593+0000 7f53dffff640 1 -- 172.21.15.98:0/1281434647 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53e00c9380 con 0x7f53e00d2050 2024-09-17T05:22:40.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.593+0000 7f53dffff640 1 --2- 172.21.15.98:0/1281434647 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f53e00d2050 0x7f53e01f72b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f53c8000c00 tx=0x7f53c8003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:40.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.593+0000 7f53dd7fa640 1 -- 172.21.15.98:0/1281434647 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c803f070 con 0x7f53e00d2050 2024-09-17T05:22:40.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.593+0000 7f53dd7fa640 1 -- 172.21.15.98:0/1281434647 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f53c80047a0 con 0x7f53e00d2050 2024-09-17T05:22:40.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.593+0000 7f53e6b3d640 1 -- 172.21.15.98:0/1281434647 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53e00c9660 con 0x7f53e00d2050 2024-09-17T05:22:40.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.593+0000 7f53dd7fa640 1 -- 172.21.15.98:0/1281434647 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c8035030 con 0x7f53e00d2050 2024-09-17T05:22:40.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.593+0000 7f53e6b3d640 1 -- 172.21.15.98:0/1281434647 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53e00c9c20 con 0x7f53e00d2050 2024-09-17T05:22:40.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.594+0000 7f53e6b3d640 1 -- 172.21.15.98:0/1281434647 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53e015f3d0 con 0x7f53e00d2050 2024-09-17T05:22:40.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.595+0000 7f53dd7fa640 1 -- 172.21.15.98:0/1281434647 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f53c8042070 con 0x7f53e00d2050 2024-09-17T05:22:40.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.596+0000 7f53dd7fa640 1 --2- 172.21.15.98:0/1281434647 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f53c0078b90 0x7f53c007b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:40.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.596+0000 7f53dd7fa640 1 -- 172.21.15.98:0/1281434647 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f53c80bba20 con 0x7f53e00d2050 2024-09-17T05:22:40.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.596+0000 7f53e48d9640 1 --2- 172.21.15.98:0/1281434647 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f53c0078b90 0x7f53c007b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:40.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.596+0000 7f53e48d9640 1 --2- 172.21.15.98:0/1281434647 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f53c0078b90 0x7f53c007b050 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f53d0005fd0 tx=0x7f53d00095e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:40.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.600+0000 7f53dd7fa640 1 -- 172.21.15.98:0/1281434647 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f53c8083930 con 0x7f53e00d2050 2024-09-17T05:22:40.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.774+0000 7f53e6b3d640 1 -- 172.21.15.98:0/1281434647 --> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f53e00761d0 con 0x7f53c0078b90 2024-09-17T05:22:40.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.779+0000 7f53dd7fa640 1 -- 172.21.15.98:0/1281434647 <== mgr.4103 v2:172.21.15.167:6800/610796449 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251904 (secure 0 0 0) 0x7f53e00761d0 con 0x7f53c0078b90 2024-09-17T05:22:40.782 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:22:40.784 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-17T05:22:40.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.782+0000 7f53e6b3d640 1 -- 172.21.15.98:0/1281434647 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f53c0078b90 msgr2=0x7f53c007b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:40.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.782+0000 7f53e6b3d640 1 --2- 172.21.15.98:0/1281434647 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f53c0078b90 0x7f53c007b050 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f53d0005fd0 tx=0x7f53d00095e0 comp rx=0 tx=0).stop 2024-09-17T05:22:40.787 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.782+0000 7f53e6b3d640 1 -- 172.21.15.98:0/1281434647 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f53e00d2050 msgr2=0x7f53e01f72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:40.787 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.782+0000 7f53e6b3d640 1 --2- 172.21.15.98:0/1281434647 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f53e00d2050 0x7f53e01f72b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f53c8000c00 tx=0x7f53c8003910 comp rx=0 tx=0).stop 2024-09-17T05:22:40.787 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.782+0000 7f53e6b3d640 1 -- 172.21.15.98:0/1281434647 shutdown_connections 2024-09-17T05:22:40.787 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.782+0000 7f53e6b3d640 1 --2- 172.21.15.98:0/1281434647 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f53c0078b90 0x7f53c007b050 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:40.787 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.782+0000 7f53e6b3d640 1 --2- 172.21.15.98:0/1281434647 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53e015e0d0 0x7f53e01f77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:40.787 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.782+0000 7f53e6b3d640 1 --2- 172.21.15.98:0/1281434647 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f53e00d2050 0x7f53e01f72b0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:40.787 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.782+0000 7f53e6b3d640 1 --2- 172.21.15.98:0/1281434647 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53e00d1440 0x7f53e01f4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:40.787 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.782+0000 7f53e6b3d640 1 -- 172.21.15.98:0/1281434647 >> 172.21.15.98:0/1281434647 conn(0x7f53e00d3fe0 msgr2=0x7f53e00cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:40.787 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.782+0000 7f53e6b3d640 1 -- 172.21.15.98:0/1281434647 shutdown_connections 2024-09-17T05:22:40.787 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.782+0000 7f53e6b3d640 1 -- 172.21.15.98:0/1281434647 wait complete. 2024-09-17T05:22:40.799 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2024-09-17T05:22:40.257658+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224396,"kb_used_data":3976,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750324,"statfs":{"total":773094113280,"available":772864331776,"internally_reserved":0,"allocated":4071424,"data_stored":2278140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001778"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.490852+0000","last_change":"2024-09-17T05:22:33.129231+0000","last_active":"2024-09-17T05:22:34.490852+0000","last_peered":"2024-09-17T05:22:34.490852+0000","last_clean":"2024-09-17T05:22:34.490852+0000","last_became_active":"2024-09-17T05:22:33.128960+0000","last_became_peered":"2024-09-17T05:22:33.128960+0000","last_unstale":"2024-09-17T05:22:34.490852+0000","last_undegraded":"2024-09-17T05:22:34.490852+0000","last_fullsized":"2024-09-17T05:22:34.490852+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:20:55.635104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.115152+0000","last_change":"2024-09-17T05:22:33.116777+0000","last_active":"2024-09-17T05:22:34.115152+0000","last_peered":"2024-09-17T05:22:34.115152+0000","last_clean":"2024-09-17T05:22:34.115152+0000","last_became_active":"2024-09-17T05:22:33.116516+0000","last_became_peered":"2024-09-17T05:22:33.116516+0000","last_unstale":"2024-09-17T05:22:34.115152+0000","last_undegraded":"2024-09-17T05:22:34.115152+0000","last_fullsized":"2024-09-17T05:22:34.115152+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:00:00.067398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.121011+0000","last_change":"2024-09-17T05:22:33.126903+0000","last_active":"2024-09-17T05:22:34.121011+0000","last_peered":"2024-09-17T05:22:34.121011+0000","last_clean":"2024-09-17T05:22:34.121011+0000","last_became_active":"2024-09-17T05:22:33.126596+0000","last_became_peered":"2024-09-17T05:22:33.126596+0000","last_unstale":"2024-09-17T05:22:34.121011+0000","last_undegraded":"2024-09-17T05:22:34.121011+0000","last_fullsized":"2024-09-17T05:22:34.121011+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:37:34.302364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.119458+0000","last_change":"2024-09-17T05:22:33.122930+0000","last_active":"2024-09-17T05:22:34.119458+0000","last_peered":"2024-09-17T05:22:34.119458+0000","last_clean":"2024-09-17T05:22:34.119458+0000","last_became_active":"2024-09-17T05:22:33.122408+0000","last_became_peered":"2024-09-17T05:22:33.122408+0000","last_unstale":"2024-09-17T05:22:34.119458+0000","last_undegraded":"2024-09-17T05:22:34.119458+0000","last_fullsized":"2024-09-17T05:22:34.119458+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:42.769233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.489201+0000","last_change":"2024-09-17T05:22:33.111841+0000","last_active":"2024-09-17T05:22:34.489201+0000","last_peered":"2024-09-17T05:22:34.489201+0000","last_clean":"2024-09-17T05:22:34.489201+0000","last_became_active":"2024-09-17T05:22:33.111527+0000","last_became_peered":"2024-09-17T05:22:33.111527+0000","last_unstale":"2024-09-17T05:22:34.489201+0000","last_undegraded":"2024-09-17T05:22:34.489201+0000","last_fullsized":"2024-09-17T05:22:34.489201+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:07.584242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.114647+0000","last_change":"2024-09-17T05:22:33.129531+0000","last_active":"2024-09-17T05:22:34.114647+0000","last_peered":"2024-09-17T05:22:34.114647+0000","last_clean":"2024-09-17T05:22:34.114647+0000","last_became_active":"2024-09-17T05:22:33.129298+0000","last_became_peered":"2024-09-17T05:22:33.129298+0000","last_unstale":"2024-09-17T05:22:34.114647+0000","last_undegraded":"2024-09-17T05:22:34.114647+0000","last_fullsized":"2024-09-17T05:22:34.114647+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:43.733648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.490236+0000","last_change":"2024-09-17T05:22:33.117903+0000","last_active":"2024-09-17T05:22:34.490236+0000","last_peered":"2024-09-17T05:22:34.490236+0000","last_clean":"2024-09-17T05:22:34.490236+0000","last_became_active":"2024-09-17T05:22:33.117651+0000","last_became_peered":"2024-09-17T05:22:33.117651+0000","last_unstale":"2024-09-17T05:22:34.490236+0000","last_undegraded":"2024-09-17T05:22:34.490236+0000","last_fullsized":"2024-09-17T05:22:34.490236+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:34:02.284805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.490068+0000","last_change":"2024-09-17T05:22:33.121828+0000","last_active":"2024-09-17T05:22:34.490068+0000","last_peered":"2024-09-17T05:22:34.490068+0000","last_clean":"2024-09-17T05:22:34.490068+0000","last_became_active":"2024-09-17T05:22:33.121475+0000","last_became_peered":"2024-09-17T05:22:33.121475+0000","last_unstale":"2024-09-17T05:22:34.490068+0000","last_undegraded":"2024-09-17T05:22:34.490068+0000","last_fullsized":"2024-09-17T05:22:34.490068+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:02.679503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.121941+0000","last_change":"2024-09-17T05:22:33.117551+0000","last_active":"2024-09-17T05:22:34.121941+0000","last_peered":"2024-09-17T05:22:34.121941+0000","last_clean":"2024-09-17T05:22:34.121941+0000","last_became_active":"2024-09-17T05:22:33.117270+0000","last_became_peered":"2024-09-17T05:22:33.117270+0000","last_unstale":"2024-09-17T05:22:34.121941+0000","last_undegraded":"2024-09-17T05:22:34.121941+0000","last_fullsized":"2024-09-17T05:22:34.121941+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:11:33.740686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.119480+0000","last_change":"2024-09-17T05:22:33.121518+0000","last_active":"2024-09-17T05:22:34.119480+0000","last_peered":"2024-09-17T05:22:34.119480+0000","last_clean":"2024-09-17T05:22:34.119480+0000","last_became_active":"2024-09-17T05:22:33.121227+0000","last_became_peered":"2024-09-17T05:22:33.121227+0000","last_unstale":"2024-09-17T05:22:34.119480+0000","last_undegraded":"2024-09-17T05:22:34.119480+0000","last_fullsized":"2024-09-17T05:22:34.119480+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:26:38.903329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.490207+0000","last_change":"2024-09-17T05:22:33.125180+0000","last_active":"2024-09-17T05:22:34.490207+0000","last_peered":"2024-09-17T05:22:34.490207+0000","last_clean":"2024-09-17T05:22:34.490207+0000","last_became_active":"2024-09-17T05:22:33.124854+0000","last_became_peered":"2024-09-17T05:22:33.124854+0000","last_unstale":"2024-09-17T05:22:34.490207+0000","last_undegraded":"2024-09-17T05:22:34.490207+0000","last_fullsized":"2024-09-17T05:22:34.490207+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:24:35.627846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.120827+0000","last_change":"2024-09-17T05:22:33.127895+0000","last_active":"2024-09-17T05:22:34.120827+0000","last_peered":"2024-09-17T05:22:34.120827+0000","last_clean":"2024-09-17T05:22:34.120827+0000","last_became_active":"2024-09-17T05:22:33.127088+0000","last_became_peered":"2024-09-17T05:22:33.127088+0000","last_unstale":"2024-09-17T05:22:34.120827+0000","last_undegraded":"2024-09-17T05:22:34.120827+0000","last_fullsized":"2024-09-17T05:22:34.120827+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:06:32.808123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.489253+0000","last_change":"2024-09-17T05:22:33.122187+0000","last_active":"2024-09-17T05:22:34.489253+0000","last_peered":"2024-09-17T05:22:34.489253+0000","last_clean":"2024-09-17T05:22:34.489253+0000","last_became_active":"2024-09-17T05:22:33.121907+0000","last_became_peered":"2024-09-17T05:22:33.121907+0000","last_unstale":"2024-09-17T05:22:34.489253+0000","last_undegraded":"2024-09-17T05:22:34.489253+0000","last_fullsized":"2024-09-17T05:22:34.489253+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:54.758318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.114871+0000","last_change":"2024-09-17T05:22:33.119051+0000","last_active":"2024-09-17T05:22:34.114871+0000","last_peered":"2024-09-17T05:22:34.114871+0000","last_clean":"2024-09-17T05:22:34.114871+0000","last_became_active":"2024-09-17T05:22:33.118758+0000","last_became_peered":"2024-09-17T05:22:33.118758+0000","last_unstale":"2024-09-17T05:22:34.114871+0000","last_undegraded":"2024-09-17T05:22:34.114871+0000","last_fullsized":"2024-09-17T05:22:34.114871+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:59:57.284361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.120122+0000","last_change":"2024-09-17T05:22:33.127471+0000","last_active":"2024-09-17T05:22:34.120122+0000","last_peered":"2024-09-17T05:22:34.120122+0000","last_clean":"2024-09-17T05:22:34.120122+0000","last_became_active":"2024-09-17T05:22:33.126669+0000","last_became_peered":"2024-09-17T05:22:33.126669+0000","last_unstale":"2024-09-17T05:22:34.120122+0000","last_undegraded":"2024-09-17T05:22:34.120122+0000","last_fullsized":"2024-09-17T05:22:34.120122+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:02.679503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.490512+0000","last_change":"2024-09-17T05:22:33.119551+0000","last_active":"2024-09-17T05:22:34.490512+0000","last_peered":"2024-09-17T05:22:34.490512+0000","last_clean":"2024-09-17T05:22:34.490512+0000","last_became_active":"2024-09-17T05:22:33.119273+0000","last_became_peered":"2024-09-17T05:22:33.119273+0000","last_unstale":"2024-09-17T05:22:34.490512+0000","last_undegraded":"2024-09-17T05:22:34.490512+0000","last_fullsized":"2024-09-17T05:22:34.490512+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:23:53.754806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.490927+0000","last_change":"2024-09-17T05:22:33.118919+0000","last_active":"2024-09-17T05:22:34.490927+0000","last_peered":"2024-09-17T05:22:34.490927+0000","last_clean":"2024-09-17T05:22:34.490927+0000","last_became_active":"2024-09-17T05:22:33.118672+0000","last_became_peered":"2024-09-17T05:22:33.118672+0000","last_unstale":"2024-09-17T05:22:34.490927+0000","last_undegraded":"2024-09-17T05:22:34.490927+0000","last_fullsized":"2024-09-17T05:22:34.490927+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:50:17.279149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.115168+0000","last_change":"2024-09-17T05:22:33.126595+0000","last_active":"2024-09-17T05:22:34.115168+0000","last_peered":"2024-09-17T05:22:34.115168+0000","last_clean":"2024-09-17T05:22:34.115168+0000","last_became_active":"2024-09-17T05:22:33.126328+0000","last_became_peered":"2024-09-17T05:22:33.126328+0000","last_unstale":"2024-09-17T05:22:34.115168+0000","last_undegraded":"2024-09-17T05:22:34.115168+0000","last_fullsized":"2024-09-17T05:22:34.115168+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:43:34.888241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.114745+0000","last_change":"2024-09-17T05:22:33.124786+0000","last_active":"2024-09-17T05:22:34.114745+0000","last_peered":"2024-09-17T05:22:34.114745+0000","last_clean":"2024-09-17T05:22:34.114745+0000","last_became_active":"2024-09-17T05:22:33.124527+0000","last_became_peered":"2024-09-17T05:22:33.124527+0000","last_unstale":"2024-09-17T05:22:34.114745+0000","last_undegraded":"2024-09-17T05:22:34.114745+0000","last_fullsized":"2024-09-17T05:22:34.114745+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:46:13.862941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.489342+0000","last_change":"2024-09-17T05:22:33.129657+0000","last_active":"2024-09-17T05:22:34.489342+0000","last_peered":"2024-09-17T05:22:34.489342+0000","last_clean":"2024-09-17T05:22:34.489342+0000","last_became_active":"2024-09-17T05:22:33.129360+0000","last_became_peered":"2024-09-17T05:22:33.129360+0000","last_unstale":"2024-09-17T05:22:34.489342+0000","last_undegraded":"2024-09-17T05:22:34.489342+0000","last_fullsized":"2024-09-17T05:22:34.489342+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:53:38.582188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.120808+0000","last_change":"2024-09-17T05:22:33.113357+0000","last_active":"2024-09-17T05:22:34.120808+0000","last_peered":"2024-09-17T05:22:34.120808+0000","last_clean":"2024-09-17T05:22:34.120808+0000","last_became_active":"2024-09-17T05:22:33.113039+0000","last_became_peered":"2024-09-17T05:22:33.113039+0000","last_unstale":"2024-09-17T05:22:34.120808+0000","last_undegraded":"2024-09-17T05:22:34.120808+0000","last_fullsized":"2024-09-17T05:22:34.120808+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:45:32.967668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.120636+0000","last_change":"2024-09-17T05:22:33.117308+0000","last_active":"2024-09-17T05:22:34.120636+0000","last_peered":"2024-09-17T05:22:34.120636+0000","last_clean":"2024-09-17T05:22:34.120636+0000","last_became_active":"2024-09-17T05:22:33.116987+0000","last_became_peered":"2024-09-17T05:22:33.116987+0000","last_unstale":"2024-09-17T05:22:34.120636+0000","last_undegraded":"2024-09-17T05:22:34.120636+0000","last_fullsized":"2024-09-17T05:22:34.120636+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:44:36.686213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.117151+0000","last_change":"2024-09-17T05:22:33.114614+0000","last_active":"2024-09-17T05:22:34.117151+0000","last_peered":"2024-09-17T05:22:34.117151+0000","last_clean":"2024-09-17T05:22:34.117151+0000","last_became_active":"2024-09-17T05:22:33.114367+0000","last_became_peered":"2024-09-17T05:22:33.114367+0000","last_unstale":"2024-09-17T05:22:34.117151+0000","last_undegraded":"2024-09-17T05:22:34.117151+0000","last_fullsized":"2024-09-17T05:22:34.117151+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:36:05.603509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.120336+0000","last_change":"2024-09-17T05:22:33.127194+0000","last_active":"2024-09-17T05:22:34.120336+0000","last_peered":"2024-09-17T05:22:34.120336+0000","last_clean":"2024-09-17T05:22:34.120336+0000","last_became_active":"2024-09-17T05:22:33.126597+0000","last_became_peered":"2024-09-17T05:22:33.126597+0000","last_unstale":"2024-09-17T05:22:34.120336+0000","last_undegraded":"2024-09-17T05:22:34.120336+0000","last_fullsized":"2024-09-17T05:22:34.120336+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:34:02.284805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.119630+0000","last_change":"2024-09-17T05:22:33.126110+0000","last_active":"2024-09-17T05:22:34.119630+0000","last_peered":"2024-09-17T05:22:34.119630+0000","last_clean":"2024-09-17T05:22:34.119630+0000","last_became_active":"2024-09-17T05:22:33.125800+0000","last_became_peered":"2024-09-17T05:22:33.125800+0000","last_unstale":"2024-09-17T05:22:34.119630+0000","last_undegraded":"2024-09-17T05:22:34.119630+0000","last_fullsized":"2024-09-17T05:22:34.119630+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:00:44.992647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.115260+0000","last_change":"2024-09-17T05:22:33.117947+0000","last_active":"2024-09-17T05:22:34.115260+0000","last_peered":"2024-09-17T05:22:34.115260+0000","last_clean":"2024-09-17T05:22:34.115260+0000","last_became_active":"2024-09-17T05:22:33.117035+0000","last_became_peered":"2024-09-17T05:22:33.117035+0000","last_unstale":"2024-09-17T05:22:34.115260+0000","last_undegraded":"2024-09-17T05:22:34.115260+0000","last_fullsized":"2024-09-17T05:22:34.115260+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:47:17.687474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.119685+0000","last_change":"2024-09-17T05:22:33.121666+0000","last_active":"2024-09-17T05:22:34.119685+0000","last_peered":"2024-09-17T05:22:34.119685+0000","last_clean":"2024-09-17T05:22:34.119685+0000","last_became_active":"2024-09-17T05:22:33.121399+0000","last_became_peered":"2024-09-17T05:22:33.121399+0000","last_unstale":"2024-09-17T05:22:34.119685+0000","last_undegraded":"2024-09-17T05:22:34.119685+0000","last_fullsized":"2024-09-17T05:22:34.119685+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:01:14.981172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.120888+0000","last_change":"2024-09-17T05:22:33.128792+0000","last_active":"2024-09-17T05:22:34.120888+0000","last_peered":"2024-09-17T05:22:34.120888+0000","last_clean":"2024-09-17T05:22:34.120888+0000","last_became_active":"2024-09-17T05:22:33.127573+0000","last_became_peered":"2024-09-17T05:22:33.127573+0000","last_unstale":"2024-09-17T05:22:34.120888+0000","last_undegraded":"2024-09-17T05:22:34.120888+0000","last_fullsized":"2024-09-17T05:22:34.120888+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:23:53.754806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.120995+0000","last_change":"2024-09-17T05:22:33.116857+0000","last_active":"2024-09-17T05:22:34.120995+0000","last_peered":"2024-09-17T05:22:34.120995+0000","last_clean":"2024-09-17T05:22:34.120995+0000","last_became_active":"2024-09-17T05:22:33.116428+0000","last_became_peered":"2024-09-17T05:22:33.116428+0000","last_unstale":"2024-09-17T05:22:34.120995+0000","last_undegraded":"2024-09-17T05:22:34.120995+0000","last_fullsized":"2024-09-17T05:22:34.120995+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:04:59.112204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.490728+0000","last_change":"2024-09-17T05:22:33.117664+0000","last_active":"2024-09-17T05:22:34.490728+0000","last_peered":"2024-09-17T05:22:34.490728+0000","last_clean":"2024-09-17T05:22:34.490728+0000","last_became_active":"2024-09-17T05:22:33.117360+0000","last_became_peered":"2024-09-17T05:22:33.117360+0000","last_unstale":"2024-09-17T05:22:34.490728+0000","last_undegraded":"2024-09-17T05:22:34.490728+0000","last_fullsized":"2024-09-17T05:22:34.490728+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:13:28.707700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.490232+0000","last_change":"2024-09-17T05:22:33.112972+0000","last_active":"2024-09-17T05:22:34.490232+0000","last_peered":"2024-09-17T05:22:34.490232+0000","last_clean":"2024-09-17T05:22:34.490232+0000","last_became_active":"2024-09-17T05:22:33.112126+0000","last_became_peered":"2024-09-17T05:22:33.112126+0000","last_unstale":"2024-09-17T05:22:34.490232+0000","last_undegraded":"2024-09-17T05:22:34.490232+0000","last_fullsized":"2024-09-17T05:22:34.490232+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:24:12.851750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.490305+0000","last_change":"2024-09-17T05:22:33.125687+0000","last_active":"2024-09-17T05:22:34.490305+0000","last_peered":"2024-09-17T05:22:34.490305+0000","last_clean":"2024-09-17T05:22:34.490305+0000","last_became_active":"2024-09-17T05:22:33.125238+0000","last_became_peered":"2024-09-17T05:22:33.125238+0000","last_unstale":"2024-09-17T05:22:34.490305+0000","last_undegraded":"2024-09-17T05:22:34.490305+0000","last_fullsized":"2024-09-17T05:22:34.490305+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:22:24.697962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.117340+0000","last_change":"2024-09-17T05:22:33.113816+0000","last_active":"2024-09-17T05:22:34.117340+0000","last_peered":"2024-09-17T05:22:34.117340+0000","last_clean":"2024-09-17T05:22:34.117340+0000","last_became_active":"2024-09-17T05:22:33.113489+0000","last_became_peered":"2024-09-17T05:22:33.113489+0000","last_unstale":"2024-09-17T05:22:34.117340+0000","last_undegraded":"2024-09-17T05:22:34.117340+0000","last_fullsized":"2024-09-17T05:22:34.117340+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:19:43.390441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.491013+0000","last_change":"2024-09-17T05:22:32.113612+0000","last_active":"2024-09-17T05:22:34.491013+0000","last_peered":"2024-09-17T05:22:34.491013+0000","last_clean":"2024-09-17T05:22:34.491013+0000","last_became_active":"2024-09-17T05:22:32.113283+0000","last_became_peered":"2024-09-17T05:22:32.113283+0000","last_unstale":"2024-09-17T05:22:34.491013+0000","last_undegraded":"2024-09-17T05:22:34.491013+0000","last_fullsized":"2024-09-17T05:22:34.491013+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:59:09.720546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.490987+0000","last_change":"2024-09-17T05:22:33.119307+0000","last_active":"2024-09-17T05:22:34.490987+0000","last_peered":"2024-09-17T05:22:34.490987+0000","last_clean":"2024-09-17T05:22:34.490987+0000","last_became_active":"2024-09-17T05:22:33.119041+0000","last_became_peered":"2024-09-17T05:22:33.119041+0000","last_unstale":"2024-09-17T05:22:34.490987+0000","last_undegraded":"2024-09-17T05:22:34.490987+0000","last_fullsized":"2024-09-17T05:22:34.490987+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:36:05.603509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.117282+0000","last_change":"2024-09-17T05:22:32.110226+0000","last_active":"2024-09-17T05:22:34.117282+0000","last_peered":"2024-09-17T05:22:34.117282+0000","last_clean":"2024-09-17T05:22:34.117282+0000","last_became_active":"2024-09-17T05:22:32.109954+0000","last_became_peered":"2024-09-17T05:22:32.109954+0000","last_unstale":"2024-09-17T05:22:34.117282+0000","last_undegraded":"2024-09-17T05:22:34.117282+0000","last_fullsized":"2024-09-17T05:22:34.117282+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:40.467869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.121523+0000","last_change":"2024-09-17T05:22:33.116535+0000","last_active":"2024-09-17T05:22:34.121523+0000","last_peered":"2024-09-17T05:22:34.121523+0000","last_clean":"2024-09-17T05:22:34.121523+0000","last_became_active":"2024-09-17T05:22:33.116228+0000","last_became_peered":"2024-09-17T05:22:33.116228+0000","last_unstale":"2024-09-17T05:22:34.121523+0000","last_undegraded":"2024-09-17T05:22:34.121523+0000","last_fullsized":"2024-09-17T05:22:34.121523+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:07:59.882448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.114792+0000","last_change":"2024-09-17T05:22:32.114627+0000","last_active":"2024-09-17T05:22:34.114792+0000","last_peered":"2024-09-17T05:22:34.114792+0000","last_clean":"2024-09-17T05:22:34.114792+0000","last_became_active":"2024-09-17T05:22:32.114380+0000","last_became_peered":"2024-09-17T05:22:32.114380+0000","last_unstale":"2024-09-17T05:22:34.114792+0000","last_undegraded":"2024-09-17T05:22:34.114792+0000","last_fullsized":"2024-09-17T05:22:34.114792+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:50:22.991581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.119773+0000","last_change":"2024-09-17T05:22:33.121623+0000","last_active":"2024-09-17T05:22:34.119773+0000","last_peered":"2024-09-17T05:22:34.119773+0000","last_clean":"2024-09-17T05:22:34.119773+0000","last_became_active":"2024-09-17T05:22:33.121349+0000","last_became_peered":"2024-09-17T05:22:33.121349+0000","last_unstale":"2024-09-17T05:22:34.119773+0000","last_undegraded":"2024-09-17T05:22:34.119773+0000","last_fullsized":"2024-09-17T05:22:34.119773+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:38:23.149095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.489336+0000","last_change":"2024-09-17T05:22:32.112558+0000","last_active":"2024-09-17T05:22:34.489336+0000","last_peered":"2024-09-17T05:22:34.489336+0000","last_clean":"2024-09-17T05:22:34.489336+0000","last_became_active":"2024-09-17T05:22:32.112226+0000","last_became_peered":"2024-09-17T05:22:32.112226+0000","last_unstale":"2024-09-17T05:22:34.489336+0000","last_undegraded":"2024-09-17T05:22:34.489336+0000","last_fullsized":"2024-09-17T05:22:34.489336+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:44.503659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.490719+0000","last_change":"2024-09-17T05:22:33.122971+0000","last_active":"2024-09-17T05:22:34.490719+0000","last_peered":"2024-09-17T05:22:34.490719+0000","last_clean":"2024-09-17T05:22:34.490719+0000","last_became_active":"2024-09-17T05:22:33.122685+0000","last_became_peered":"2024-09-17T05:22:33.122685+0000","last_unstale":"2024-09-17T05:22:34.490719+0000","last_undegraded":"2024-09-17T05:22:34.490719+0000","last_fullsized":"2024-09-17T05:22:34.490719+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:37:34.302364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.121145+0000","last_change":"2024-09-17T05:22:32.114701+0000","last_active":"2024-09-17T05:22:34.121145+0000","last_peered":"2024-09-17T05:22:34.121145+0000","last_clean":"2024-09-17T05:22:34.121145+0000","last_became_active":"2024-09-17T05:22:32.114418+0000","last_became_peered":"2024-09-17T05:22:32.114418+0000","last_unstale":"2024-09-17T05:22:34.121145+0000","last_undegraded":"2024-09-17T05:22:34.121145+0000","last_fullsized":"2024-09-17T05:22:34.121145+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:31:49.532526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.120676+0000","last_change":"2024-09-17T05:22:33.127891+0000","last_active":"2024-09-17T05:22:34.120676+0000","last_peered":"2024-09-17T05:22:34.120676+0000","last_clean":"2024-09-17T05:22:34.120676+0000","last_became_active":"2024-09-17T05:22:33.127029+0000","last_became_peered":"2024-09-17T05:22:33.127029+0000","last_unstale":"2024-09-17T05:22:34.120676+0000","last_undegraded":"2024-09-17T05:22:34.120676+0000","last_fullsized":"2024-09-17T05:22:34.120676+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:17:47.885034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.120709+0000","last_change":"2024-09-17T05:22:32.111748+0000","last_active":"2024-09-17T05:22:34.120709+0000","last_peered":"2024-09-17T05:22:34.120709+0000","last_clean":"2024-09-17T05:22:34.120709+0000","last_became_active":"2024-09-17T05:22:32.111430+0000","last_became_peered":"2024-09-17T05:22:32.111430+0000","last_unstale":"2024-09-17T05:22:34.120709+0000","last_undegraded":"2024-09-17T05:22:34.120709+0000","last_fullsized":"2024-09-17T05:22:34.120709+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:44.479040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.120229+0000","last_change":"2024-09-17T05:22:33.108096+0000","last_active":"2024-09-17T05:22:34.120229+0000","last_peered":"2024-09-17T05:22:34.120229+0000","last_clean":"2024-09-17T05:22:34.120229+0000","last_became_active":"2024-09-17T05:22:33.107767+0000","last_became_peered":"2024-09-17T05:22:33.107767+0000","last_unstale":"2024-09-17T05:22:34.120229+0000","last_undegraded":"2024-09-17T05:22:34.120229+0000","last_fullsized":"2024-09-17T05:22:34.120229+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:07:18.716563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.114448+0000","last_change":"2024-09-17T05:22:32.112680+0000","last_active":"2024-09-17T05:22:34.114448+0000","last_peered":"2024-09-17T05:22:34.114448+0000","last_clean":"2024-09-17T05:22:34.114448+0000","last_became_active":"2024-09-17T05:22:32.111854+0000","last_became_peered":"2024-09-17T05:22:32.111854+0000","last_unstale":"2024-09-17T05:22:34.114448+0000","last_undegraded":"2024-09-17T05:22:34.114448+0000","last_fullsized":"2024-09-17T05:22:34.114448+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:04:44.102722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.119222+0000","last_change":"2024-09-17T05:22:33.127582+0000","last_active":"2024-09-17T05:22:34.119222+0000","last_peered":"2024-09-17T05:22:34.119222+0000","last_clean":"2024-09-17T05:22:34.119222+0000","last_became_active":"2024-09-17T05:22:33.127345+0000","last_became_peered":"2024-09-17T05:22:33.127345+0000","last_unstale":"2024-09-17T05:22:34.119222+0000","last_undegraded":"2024-09-17T05:22:34.119222+0000","last_fullsized":"2024-09-17T05:22:34.119222+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:38:01.369466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.120352+0000","last_change":"2024-09-17T05:22:32.107007+0000","last_active":"2024-09-17T05:22:34.120352+0000","last_peered":"2024-09-17T05:22:34.120352+0000","last_clean":"2024-09-17T05:22:34.120352+0000","last_became_active":"2024-09-17T05:22:32.106728+0000","last_became_peered":"2024-09-17T05:22:32.106728+0000","last_unstale":"2024-09-17T05:22:34.120352+0000","last_undegraded":"2024-09-17T05:22:34.120352+0000","last_fullsized":"2024-09-17T05:22:34.120352+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:19.368152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.120337+0000","last_change":"2024-09-17T05:22:33.120882+0000","last_active":"2024-09-17T05:22:34.120337+0000","last_peered":"2024-09-17T05:22:34.120337+0000","last_clean":"2024-09-17T05:22:34.120337+0000","last_became_active":"2024-09-17T05:22:33.120618+0000","last_became_peered":"2024-09-17T05:22:33.120618+0000","last_unstale":"2024-09-17T05:22:34.120337+0000","last_undegraded":"2024-09-17T05:22:34.120337+0000","last_fullsized":"2024-09-17T05:22:34.120337+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:26.493699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.115005+0000","last_change":"2024-09-17T05:22:32.110685+0000","last_active":"2024-09-17T05:22:34.115005+0000","last_peered":"2024-09-17T05:22:34.115005+0000","last_clean":"2024-09-17T05:22:34.115005+0000","last_became_active":"2024-09-17T05:22:32.110434+0000","last_became_peered":"2024-09-17T05:22:32.110434+0000","last_unstale":"2024-09-17T05:22:34.115005+0000","last_undegraded":"2024-09-17T05:22:34.115005+0000","last_fullsized":"2024-09-17T05:22:34.115005+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:07:17.711718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.114867+0000","last_change":"2024-09-17T05:22:33.125565+0000","last_active":"2024-09-17T05:22:34.114867+0000","last_peered":"2024-09-17T05:22:34.114867+0000","last_clean":"2024-09-17T05:22:34.114867+0000","last_became_active":"2024-09-17T05:22:33.125307+0000","last_became_peered":"2024-09-17T05:22:33.125307+0000","last_unstale":"2024-09-17T05:22:34.114867+0000","last_undegraded":"2024-09-17T05:22:34.114867+0000","last_fullsized":"2024-09-17T05:22:34.114867+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:47:18.080049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.117385+0000","last_change":"2024-09-17T05:22:32.113885+0000","last_active":"2024-09-17T05:22:34.117385+0000","last_peered":"2024-09-17T05:22:34.117385+0000","last_clean":"2024-09-17T05:22:34.117385+0000","last_became_active":"2024-09-17T05:22:32.113348+0000","last_became_peered":"2024-09-17T05:22:32.113348+0000","last_unstale":"2024-09-17T05:22:34.117385+0000","last_undegraded":"2024-09-17T05:22:34.117385+0000","last_fullsized":"2024-09-17T05:22:34.117385+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:02:41.167223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.114825+0000","last_change":"2024-09-17T05:22:33.126125+0000","last_active":"2024-09-17T05:22:34.114825+0000","last_peered":"2024-09-17T05:22:34.114825+0000","last_clean":"2024-09-17T05:22:34.114825+0000","last_became_active":"2024-09-17T05:22:33.125624+0000","last_became_peered":"2024-09-17T05:22:33.125624+0000","last_unstale":"2024-09-17T05:22:34.114825+0000","last_undegraded":"2024-09-17T05:22:34.114825+0000","last_fullsized":"2024-09-17T05:22:34.114825+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:44.267636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.121090+0000","last_change":"2024-09-17T05:22:32.112204+0000","last_active":"2024-09-17T05:22:34.121090+0000","last_peered":"2024-09-17T05:22:34.121090+0000","last_clean":"2024-09-17T05:22:34.121090+0000","last_became_active":"2024-09-17T05:22:32.111922+0000","last_became_peered":"2024-09-17T05:22:32.111922+0000","last_unstale":"2024-09-17T05:22:34.121090+0000","last_undegraded":"2024-09-17T05:22:34.121090+0000","last_fullsized":"2024-09-17T05:22:34.121090+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:45.239346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.120913+0000","last_change":"2024-09-17T05:22:33.128277+0000","last_active":"2024-09-17T05:22:34.120913+0000","last_peered":"2024-09-17T05:22:34.120913+0000","last_clean":"2024-09-17T05:22:34.120913+0000","last_became_active":"2024-09-17T05:22:33.127303+0000","last_became_peered":"2024-09-17T05:22:33.127303+0000","last_unstale":"2024-09-17T05:22:34.120913+0000","last_undegraded":"2024-09-17T05:22:34.120913+0000","last_fullsized":"2024-09-17T05:22:34.120913+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:16:54.702202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.114987+0000","last_change":"2024-09-17T05:22:32.116128+0000","last_active":"2024-09-17T05:22:34.114987+0000","last_peered":"2024-09-17T05:22:34.114987+0000","last_clean":"2024-09-17T05:22:34.114987+0000","last_became_active":"2024-09-17T05:22:32.115820+0000","last_became_peered":"2024-09-17T05:22:32.115820+0000","last_unstale":"2024-09-17T05:22:34.114987+0000","last_undegraded":"2024-09-17T05:22:34.114987+0000","last_fullsized":"2024-09-17T05:22:34.114987+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:45:31.962824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.119453+0000","last_change":"2024-09-17T05:22:33.127534+0000","last_active":"2024-09-17T05:22:34.119453+0000","last_peered":"2024-09-17T05:22:34.119453+0000","last_clean":"2024-09-17T05:22:34.119453+0000","last_became_active":"2024-09-17T05:22:33.127289+0000","last_became_peered":"2024-09-17T05:22:33.127289+0000","last_unstale":"2024-09-17T05:22:34.119453+0000","last_undegraded":"2024-09-17T05:22:34.119453+0000","last_fullsized":"2024-09-17T05:22:34.119453+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:03.554819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.121244+0000","last_change":"2024-09-17T05:22:32.105639+0000","last_active":"2024-09-17T05:22:34.121244+0000","last_peered":"2024-09-17T05:22:34.121244+0000","last_clean":"2024-09-17T05:22:34.121244+0000","last_became_active":"2024-09-17T05:22:32.105366+0000","last_became_peered":"2024-09-17T05:22:32.105366+0000","last_unstale":"2024-09-17T05:22:34.121244+0000","last_undegraded":"2024-09-17T05:22:34.121244+0000","last_fullsized":"2024-09-17T05:22:34.121244+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:53:37.577343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.114671+0000","last_change":"2024-09-17T05:22:33.111017+0000","last_active":"2024-09-17T05:22:34.114671+0000","last_peered":"2024-09-17T05:22:34.114671+0000","last_clean":"2024-09-17T05:22:34.114671+0000","last_became_active":"2024-09-17T05:22:33.110671+0000","last_became_peered":"2024-09-17T05:22:33.110671+0000","last_unstale":"2024-09-17T05:22:34.114671+0000","last_undegraded":"2024-09-17T05:22:34.114671+0000","last_fullsized":"2024-09-17T05:22:34.114671+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:17:13.035388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.119226+0000","last_change":"2024-09-17T05:22:32.109199+0000","last_active":"2024-09-17T05:22:34.119226+0000","last_peered":"2024-09-17T05:22:34.119226+0000","last_clean":"2024-09-17T05:22:34.119226+0000","last_became_active":"2024-09-17T05:22:32.108900+0000","last_became_peered":"2024-09-17T05:22:32.108900+0000","last_unstale":"2024-09-17T05:22:34.119226+0000","last_undegraded":"2024-09-17T05:22:34.119226+0000","last_fullsized":"2024-09-17T05:22:34.119226+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:35:27.220113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.490479+0000","last_change":"2024-09-17T05:22:33.126051+0000","last_active":"2024-09-17T05:22:34.490479+0000","last_peered":"2024-09-17T05:22:34.490479+0000","last_clean":"2024-09-17T05:22:34.490479+0000","last_became_active":"2024-09-17T05:22:33.125748+0000","last_became_peered":"2024-09-17T05:22:33.125748+0000","last_unstale":"2024-09-17T05:22:34.490479+0000","last_undegraded":"2024-09-17T05:22:34.490479+0000","last_fullsized":"2024-09-17T05:22:34.490479+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:06:32.808123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.114539+0000","last_change":"2024-09-17T05:22:32.111645+0000","last_active":"2024-09-17T05:22:34.114539+0000","last_peered":"2024-09-17T05:22:34.114539+0000","last_clean":"2024-09-17T05:22:34.114539+0000","last_became_active":"2024-09-17T05:22:32.111343+0000","last_became_peered":"2024-09-17T05:22:32.111343+0000","last_unstale":"2024-09-17T05:22:34.114539+0000","last_undegraded":"2024-09-17T05:22:34.114539+0000","last_fullsized":"2024-09-17T05:22:34.114539+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:44:35.681368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.490446+0000","last_change":"2024-09-17T05:22:33.120235+0000","last_active":"2024-09-17T05:22:34.490446+0000","last_peered":"2024-09-17T05:22:34.490446+0000","last_clean":"2024-09-17T05:22:34.490446+0000","last_became_active":"2024-09-17T05:22:33.119972+0000","last_became_peered":"2024-09-17T05:22:33.119972+0000","last_unstale":"2024-09-17T05:22:34.490446+0000","last_undegraded":"2024-09-17T05:22:34.490446+0000","last_fullsized":"2024-09-17T05:22:34.490446+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:32.109566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.114479+0000","last_change":"2024-09-17T05:22:32.112489+0000","last_active":"2024-09-17T05:22:34.114479+0000","last_peered":"2024-09-17T05:22:34.114479+0000","last_clean":"2024-09-17T05:22:34.114479+0000","last_became_active":"2024-09-17T05:22:32.112221+0000","last_became_peered":"2024-09-17T05:22:32.112221+0000","last_unstale":"2024-09-17T05:22:34.114479+0000","last_undegraded":"2024-09-17T05:22:34.114479+0000","last_fullsized":"2024-09-17T05:22:34.114479+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:14:17.389902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.121043+0000","last_change":"2024-09-17T05:22:33.129538+0000","last_active":"2024-09-17T05:22:34.121043+0000","last_peered":"2024-09-17T05:22:34.121043+0000","last_clean":"2024-09-17T05:22:34.121043+0000","last_became_active":"2024-09-17T05:22:33.129084+0000","last_became_peered":"2024-09-17T05:22:33.129084+0000","last_unstale":"2024-09-17T05:22:34.121043+0000","last_undegraded":"2024-09-17T05:22:34.121043+0000","last_fullsized":"2024-09-17T05:22:34.121043+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:14:18.394747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.119605+0000","last_change":"2024-09-17T05:22:32.112584+0000","last_active":"2024-09-17T05:22:34.119605+0000","last_peered":"2024-09-17T05:22:34.119605+0000","last_clean":"2024-09-17T05:22:34.119605+0000","last_became_active":"2024-09-17T05:22:32.112318+0000","last_became_peered":"2024-09-17T05:22:32.112318+0000","last_unstale":"2024-09-17T05:22:34.119605+0000","last_undegraded":"2024-09-17T05:22:34.119605+0000","last_fullsized":"2024-09-17T05:22:34.119605+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:54:41.251880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.121276+0000","last_change":"2024-09-17T05:22:33.128464+0000","last_active":"2024-09-17T05:22:34.121276+0000","last_peered":"2024-09-17T05:22:34.121276+0000","last_clean":"2024-09-17T05:22:34.121276+0000","last_became_active":"2024-09-17T05:22:33.128049+0000","last_became_peered":"2024-09-17T05:22:33.128049+0000","last_unstale":"2024-09-17T05:22:34.121276+0000","last_undegraded":"2024-09-17T05:22:34.121276+0000","last_fullsized":"2024-09-17T05:22:34.121276+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:24:35.627846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.121196+0000","last_change":"2024-09-17T05:22:32.105623+0000","last_active":"2024-09-17T05:22:34.121196+0000","last_peered":"2024-09-17T05:22:34.121196+0000","last_clean":"2024-09-17T05:22:34.121196+0000","last_became_active":"2024-09-17T05:22:32.105328+0000","last_became_peered":"2024-09-17T05:22:32.105328+0000","last_unstale":"2024-09-17T05:22:34.121196+0000","last_undegraded":"2024-09-17T05:22:34.121196+0000","last_fullsized":"2024-09-17T05:22:34.121196+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:27:47.755307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.119589+0000","last_change":"2024-09-17T05:22:33.122665+0000","last_active":"2024-09-17T05:22:34.119589+0000","last_peered":"2024-09-17T05:22:34.119589+0000","last_clean":"2024-09-17T05:22:34.119589+0000","last_became_active":"2024-09-17T05:22:33.122012+0000","last_became_peered":"2024-09-17T05:22:33.122012+0000","last_unstale":"2024-09-17T05:22:34.119589+0000","last_undegraded":"2024-09-17T05:22:34.119589+0000","last_fullsized":"2024-09-17T05:22:34.119589+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:16:37.360824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.121595+0000","last_change":"2024-09-17T05:22:32.109272+0000","last_active":"2024-09-17T05:22:34.121595+0000","last_peered":"2024-09-17T05:22:34.121595+0000","last_clean":"2024-09-17T05:22:34.121595+0000","last_became_active":"2024-09-17T05:22:32.109013+0000","last_became_peered":"2024-09-17T05:22:32.109013+0000","last_unstale":"2024-09-17T05:22:34.121595+0000","last_undegraded":"2024-09-17T05:22:34.121595+0000","last_fullsized":"2024-09-17T05:22:34.121595+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:06.579397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.489457+0000","last_change":"2024-09-17T05:22:33.113978+0000","last_active":"2024-09-17T05:22:34.489457+0000","last_peered":"2024-09-17T05:22:34.489457+0000","last_clean":"2024-09-17T05:22:34.489457+0000","last_became_active":"2024-09-17T05:22:33.113492+0000","last_became_peered":"2024-09-17T05:22:33.113492+0000","last_unstale":"2024-09-17T05:22:34.489457+0000","last_undegraded":"2024-09-17T05:22:34.489457+0000","last_fullsized":"2024-09-17T05:22:34.489457+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:49:31.572421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.121668+0000","last_change":"2024-09-17T05:22:32.115027+0000","last_active":"2024-09-17T05:22:34.121668+0000","last_peered":"2024-09-17T05:22:34.121668+0000","last_clean":"2024-09-17T05:22:34.121668+0000","last_became_active":"2024-09-17T05:22:32.114435+0000","last_became_peered":"2024-09-17T05:22:32.114435+0000","last_unstale":"2024-09-17T05:22:34.121668+0000","last_undegraded":"2024-09-17T05:22:34.121668+0000","last_fullsized":"2024-09-17T05:22:34.121668+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:09:03.522949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.489220+0000","last_change":"2024-09-17T05:22:33.110478+0000","last_active":"2024-09-17T05:22:34.489220+0000","last_peered":"2024-09-17T05:22:34.489220+0000","last_clean":"2024-09-17T05:22:34.489220+0000","last_became_active":"2024-09-17T05:22:33.110196+0000","last_became_peered":"2024-09-17T05:22:33.110196+0000","last_unstale":"2024-09-17T05:22:34.489220+0000","last_undegraded":"2024-09-17T05:22:34.489220+0000","last_fullsized":"2024-09-17T05:22:34.489220+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:27:48.760152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.117370+0000","last_change":"2024-09-17T05:22:32.113308+0000","last_active":"2024-09-17T05:22:34.117370+0000","last_peered":"2024-09-17T05:22:34.117370+0000","last_clean":"2024-09-17T05:22:34.117370+0000","last_became_active":"2024-09-17T05:22:32.113050+0000","last_became_peered":"2024-09-17T05:22:32.113050+0000","last_unstale":"2024-09-17T05:22:34.117370+0000","last_undegraded":"2024-09-17T05:22:34.117370+0000","last_fullsized":"2024-09-17T05:22:34.117370+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:29:10.172995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.489412+0000","last_change":"2024-09-17T05:22:33.112503+0000","last_active":"2024-09-17T05:22:34.489412+0000","last_peered":"2024-09-17T05:22:34.489412+0000","last_clean":"2024-09-17T05:22:34.489412+0000","last_became_active":"2024-09-17T05:22:33.112236+0000","last_became_peered":"2024-09-17T05:22:33.112236+0000","last_unstale":"2024-09-17T05:22:34.489412+0000","last_undegraded":"2024-09-17T05:22:34.489412+0000","last_fullsized":"2024-09-17T05:22:34.489412+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:09:04.527794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.490552+0000","last_change":"2024-09-17T05:22:32.112694+0000","last_active":"2024-09-17T05:22:34.490552+0000","last_peered":"2024-09-17T05:22:34.490552+0000","last_clean":"2024-09-17T05:22:34.490552+0000","last_became_active":"2024-09-17T05:22:32.112438+0000","last_became_peered":"2024-09-17T05:22:32.112438+0000","last_unstale":"2024-09-17T05:22:34.490552+0000","last_undegraded":"2024-09-17T05:22:34.490552+0000","last_fullsized":"2024-09-17T05:22:34.490552+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:51:03.882666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.489204+0000","last_change":"2024-09-17T05:22:33.109656+0000","last_active":"2024-09-17T05:22:34.489204+0000","last_peered":"2024-09-17T05:22:34.489204+0000","last_clean":"2024-09-17T05:22:34.489204+0000","last_became_active":"2024-09-17T05:22:33.109356+0000","last_became_peered":"2024-09-17T05:22:33.109356+0000","last_unstale":"2024-09-17T05:22:34.489204+0000","last_undegraded":"2024-09-17T05:22:34.489204+0000","last_fullsized":"2024-09-17T05:22:34.489204+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:28:21.700183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.120350+0000","last_change":"2024-09-17T05:22:32.109644+0000","last_active":"2024-09-17T05:22:34.120350+0000","last_peered":"2024-09-17T05:22:34.120350+0000","last_clean":"2024-09-17T05:22:34.120350+0000","last_became_active":"2024-09-17T05:22:32.108599+0000","last_became_peered":"2024-09-17T05:22:32.108599+0000","last_unstale":"2024-09-17T05:22:34.120350+0000","last_undegraded":"2024-09-17T05:22:34.120350+0000","last_fullsized":"2024-09-17T05:22:34.120350+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:34:14.594010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.490359+0000","last_change":"2024-09-17T05:22:33.118198+0000","last_active":"2024-09-17T05:22:34.490359+0000","last_peered":"2024-09-17T05:22:34.490359+0000","last_clean":"2024-09-17T05:22:34.490359+0000","last_became_active":"2024-09-17T05:22:33.117912+0000","last_became_peered":"2024-09-17T05:22:33.117912+0000","last_unstale":"2024-09-17T05:22:34.490359+0000","last_undegraded":"2024-09-17T05:22:34.490359+0000","last_fullsized":"2024-09-17T05:22:34.490359+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:17:47.885034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.120063+0000","last_change":"2024-09-17T05:22:32.113056+0000","last_active":"2024-09-17T05:22:34.120063+0000","last_peered":"2024-09-17T05:22:34.120063+0000","last_clean":"2024-09-17T05:22:34.120063+0000","last_became_active":"2024-09-17T05:22:32.112769+0000","last_became_peered":"2024-09-17T05:22:32.112769+0000","last_unstale":"2024-09-17T05:22:34.120063+0000","last_undegraded":"2024-09-17T05:22:34.120063+0000","last_fullsized":"2024-09-17T05:22:34.120063+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:23.340855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.489457+0000","last_change":"2024-09-17T05:22:33.127577+0000","last_active":"2024-09-17T05:22:34.489457+0000","last_peered":"2024-09-17T05:22:34.489457+0000","last_clean":"2024-09-17T05:22:34.489457+0000","last_became_active":"2024-09-17T05:22:33.127321+0000","last_became_peered":"2024-09-17T05:22:33.127321+0000","last_unstale":"2024-09-17T05:22:34.489457+0000","last_undegraded":"2024-09-17T05:22:34.489457+0000","last_fullsized":"2024-09-17T05:22:34.489457+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:34:15.598855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.119686+0000","last_change":"2024-09-17T05:22:32.113687+0000","last_active":"2024-09-17T05:22:34.119686+0000","last_peered":"2024-09-17T05:22:34.119686+0000","last_clean":"2024-09-17T05:22:34.119686+0000","last_became_active":"2024-09-17T05:22:32.113418+0000","last_became_peered":"2024-09-17T05:22:32.113418+0000","last_unstale":"2024-09-17T05:22:34.119686+0000","last_undegraded":"2024-09-17T05:22:34.119686+0000","last_fullsized":"2024-09-17T05:22:34.119686+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:35:05.947616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.121329+0000","last_change":"2024-09-17T05:22:33.128188+0000","last_active":"2024-09-17T05:22:34.121329+0000","last_peered":"2024-09-17T05:22:34.121329+0000","last_clean":"2024-09-17T05:22:34.121329+0000","last_became_active":"2024-09-17T05:22:33.127244+0000","last_became_peered":"2024-09-17T05:22:33.127244+0000","last_unstale":"2024-09-17T05:22:34.121329+0000","last_undegraded":"2024-09-17T05:22:34.121329+0000","last_fullsized":"2024-09-17T05:22:34.121329+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:25.551045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.117496+0000","last_change":"2024-09-17T05:22:32.113614+0000","last_active":"2024-09-17T05:22:34.117496+0000","last_peered":"2024-09-17T05:22:34.117496+0000","last_clean":"2024-09-17T05:22:34.117496+0000","last_became_active":"2024-09-17T05:22:32.113005+0000","last_became_peered":"2024-09-17T05:22:32.113005+0000","last_unstale":"2024-09-17T05:22:34.117496+0000","last_undegraded":"2024-09-17T05:22:34.117496+0000","last_fullsized":"2024-09-17T05:22:34.117496+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:35.883658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.117245+0000","last_change":"2024-09-17T05:22:33.123577+0000","last_active":"2024-09-17T05:22:34.117245+0000","last_peered":"2024-09-17T05:22:34.117245+0000","last_clean":"2024-09-17T05:22:34.117245+0000","last_became_active":"2024-09-17T05:22:33.123017+0000","last_became_peered":"2024-09-17T05:22:33.123017+0000","last_unstale":"2024-09-17T05:22:34.117245+0000","last_undegraded":"2024-09-17T05:22:34.117245+0000","last_fullsized":"2024-09-17T05:22:34.117245+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:00:50.831659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.119574+0000","last_change":"2024-09-17T05:22:32.111317+0000","last_active":"2024-09-17T05:22:34.119574+0000","last_peered":"2024-09-17T05:22:34.119574+0000","last_clean":"2024-09-17T05:22:34.119574+0000","last_became_active":"2024-09-17T05:22:32.111040+0000","last_became_peered":"2024-09-17T05:22:32.111040+0000","last_unstale":"2024-09-17T05:22:34.119574+0000","last_undegraded":"2024-09-17T05:22:34.119574+0000","last_fullsized":"2024-09-17T05:22:34.119574+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:19:10.624330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.490410+0000","last_change":"2024-09-17T05:22:33.110995+0000","last_active":"2024-09-17T05:22:34.490410+0000","last_peered":"2024-09-17T05:22:34.490410+0000","last_clean":"2024-09-17T05:22:34.490410+0000","last_became_active":"2024-09-17T05:22:33.110725+0000","last_became_peered":"2024-09-17T05:22:33.110725+0000","last_unstale":"2024-09-17T05:22:34.490410+0000","last_undegraded":"2024-09-17T05:22:34.490410+0000","last_fullsized":"2024-09-17T05:22:34.490410+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:55:40.665695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.117472+0000","last_change":"2024-09-17T05:22:32.114729+0000","last_active":"2024-09-17T05:22:34.117472+0000","last_peered":"2024-09-17T05:22:34.117472+0000","last_clean":"2024-09-17T05:22:34.117472+0000","last_became_active":"2024-09-17T05:22:32.113768+0000","last_became_peered":"2024-09-17T05:22:32.113768+0000","last_unstale":"2024-09-17T05:22:34.117472+0000","last_undegraded":"2024-09-17T05:22:34.117472+0000","last_fullsized":"2024-09-17T05:22:34.117472+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:26.320381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.117373+0000","last_change":"2024-09-17T05:22:33.110012+0000","last_active":"2024-09-17T05:22:34.117373+0000","last_peered":"2024-09-17T05:22:34.117373+0000","last_clean":"2024-09-17T05:22:34.117373+0000","last_became_active":"2024-09-17T05:22:33.109695+0000","last_became_peered":"2024-09-17T05:22:33.109695+0000","last_unstale":"2024-09-17T05:22:34.117373+0000","last_undegraded":"2024-09-17T05:22:34.117373+0000","last_fullsized":"2024-09-17T05:22:34.117373+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:44.589106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.119333+0000","last_change":"2024-09-17T05:22:32.113054+0000","last_active":"2024-09-17T05:22:34.119333+0000","last_peered":"2024-09-17T05:22:34.119333+0000","last_clean":"2024-09-17T05:22:34.119333+0000","last_became_active":"2024-09-17T05:22:32.112779+0000","last_became_peered":"2024-09-17T05:22:32.112779+0000","last_unstale":"2024-09-17T05:22:34.119333+0000","last_undegraded":"2024-09-17T05:22:34.119333+0000","last_fullsized":"2024-09-17T05:22:34.119333+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:25.252150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.114463+0000","last_change":"2024-09-17T05:22:33.125596+0000","last_active":"2024-09-17T05:22:34.114463+0000","last_peered":"2024-09-17T05:22:34.114463+0000","last_clean":"2024-09-17T05:22:34.114463+0000","last_became_active":"2024-09-17T05:22:33.125320+0000","last_became_peered":"2024-09-17T05:22:33.125320+0000","last_unstale":"2024-09-17T05:22:34.114463+0000","last_undegraded":"2024-09-17T05:22:34.114463+0000","last_fullsized":"2024-09-17T05:22:34.114463+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:09.782585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.120468+0000","last_change":"2024-09-17T05:22:32.112210+0000","last_active":"2024-09-17T05:22:34.120468+0000","last_peered":"2024-09-17T05:22:34.120468+0000","last_clean":"2024-09-17T05:22:34.120468+0000","last_became_active":"2024-09-17T05:22:32.111748+0000","last_became_peered":"2024-09-17T05:22:32.111748+0000","last_unstale":"2024-09-17T05:22:34.120468+0000","last_undegraded":"2024-09-17T05:22:34.120468+0000","last_fullsized":"2024-09-17T05:22:34.120468+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:49:30.567576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.120272+0000","last_change":"2024-09-17T05:22:33.118028+0000","last_active":"2024-09-17T05:22:34.120272+0000","last_peered":"2024-09-17T05:22:34.120272+0000","last_clean":"2024-09-17T05:22:34.120272+0000","last_became_active":"2024-09-17T05:22:33.117777+0000","last_became_peered":"2024-09-17T05:22:33.117777+0000","last_unstale":"2024-09-17T05:22:34.120272+0000","last_undegraded":"2024-09-17T05:22:34.120272+0000","last_fullsized":"2024-09-17T05:22:34.120272+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:04:45.107567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.114570+0000","last_change":"2024-09-17T05:22:32.111929+0000","last_active":"2024-09-17T05:22:34.114570+0000","last_peered":"2024-09-17T05:22:34.114570+0000","last_clean":"2024-09-17T05:22:34.114570+0000","last_became_active":"2024-09-17T05:22:32.111570+0000","last_became_peered":"2024-09-17T05:22:32.111570+0000","last_unstale":"2024-09-17T05:22:34.114570+0000","last_undegraded":"2024-09-17T05:22:34.114570+0000","last_fullsized":"2024-09-17T05:22:34.114570+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:07:58.877603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.490279+0000","last_change":"2024-09-17T05:22:33.121040+0000","last_active":"2024-09-17T05:22:34.490279+0000","last_peered":"2024-09-17T05:22:34.490279+0000","last_clean":"2024-09-17T05:22:34.490279+0000","last_became_active":"2024-09-17T05:22:33.120790+0000","last_became_peered":"2024-09-17T05:22:33.120790+0000","last_unstale":"2024-09-17T05:22:34.490279+0000","last_undegraded":"2024-09-17T05:22:34.490279+0000","last_fullsized":"2024-09-17T05:22:34.490279+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:32.090862+0000","last_clean_scrub_stamp":"2024-09-17T05:22:32.090862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:16:54.702202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.490020+0000","last_change":"2024-09-17T05:22:32.112360+0000","last_active":"2024-09-17T05:22:34.490020+0000","last_peered":"2024-09-17T05:22:34.490020+0000","last_clean":"2024-09-17T05:22:34.490020+0000","last_became_active":"2024-09-17T05:22:32.112001+0000","last_became_peered":"2024-09-17T05:22:32.112001+0000","last_unstale":"2024-09-17T05:22:34.490020+0000","last_undegraded":"2024-09-17T05:22:34.490020+0000","last_fullsized":"2024-09-17T05:22:34.490020+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:31.086017+0000","last_clean_scrub_stamp":"2024-09-17T05:22:31.086017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:49:30.567576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":131,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:22:34.490641+0000","last_change":"2024-09-17T05:21:44.086098+0000","last_active":"2024-09-17T05:22:34.490641+0000","last_peered":"2024-09-17T05:22:34.490641+0000","last_clean":"2024-09-17T05:22:34.490641+0000","last_became_active":"2024-09-17T05:21:44.083477+0000","last_became_peered":"2024-09-17T05:21:44.083477+0000","last_unstale":"2024-09-17T05:22:34.490641+0000","last_undegraded":"2024-09-17T05:22:34.490641+0000","last_fullsized":"2024-09-17T05:22:34.490641+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:42.925756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:42.925756+0000","last_clean_scrub_stamp":"2024-09-17T05:21:42.925756+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:11.410250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":368640,"data_stored":138207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":356352,"data_stored":136643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509456,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":946176,"data_stored":726941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542158,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":950272,"data_stored":727031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542158,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":360448,"data_stored":137189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542159,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":360448,"data_stored":137245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542159,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":360448,"data_stored":136677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31556,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340284,"statfs":{"total":96636764160,"available":96604450816,"internally_reserved":0,"allocated":368640,"data_stored":138207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:22:40.802 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T05:22:40.803 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T05:22:40.949 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.947+0000 7fb94c808640 1 -- 172.21.15.98:0/700469743 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb934004d40 msgr2=0x7fb9340051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:40.949 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.947+0000 7fb94c808640 1 --2- 172.21.15.98:0/700469743 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb934004d40 0x7fb9340051c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb940009b50 tx=0x7fb934005830 comp rx=0 tx=0).stop 2024-09-17T05:22:40.949 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.947+0000 7fb946d9d640 1 -- 172.21.15.98:0/700469743 reap_dead start 2024-09-17T05:22:40.949 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.947+0000 7fb94c808640 1 -- 172.21.15.98:0/700469743 shutdown_connections 2024-09-17T05:22:40.949 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.947+0000 7fb94c808640 1 -- 172.21.15.98:0/700469743 >> 172.21.15.98:0/700469743 conn(0x7fb9480b1840 msgr2=0x7fb9480b1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:40.949 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.947+0000 7fb94c808640 1 -- 172.21.15.98:0/700469743 shutdown_connections 2024-09-17T05:22:40.949 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.947+0000 7fb94c808640 1 -- 172.21.15.98:0/700469743 wait complete. 2024-09-17T05:22:40.952 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.949+0000 7fb94c808640 1 Processor -- start 2024-09-17T05:22:40.952 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.949+0000 7fb94c808640 1 -- start start 2024-09-17T05:22:40.952 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.949+0000 7fb94c808640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb934004d40 0x7fb9480ae3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:40.952 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.949+0000 7fb94c808640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9481ef4a0 0x7fb9481ef920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:40.952 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.950+0000 7fb94c808640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9481f27c0 0x7fb9481f2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:40.952 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.950+0000 7fb94c808640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb9480737d0 con 0x7fb9481f27c0 2024-09-17T05:22:40.952 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.950+0000 7fb94c808640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb948073650 con 0x7fb9481ef4a0 2024-09-17T05:22:40.952 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.950+0000 7fb94c808640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fb9480ce0f0 con 0x7fb934004d40 2024-09-17T05:22:40.952 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.950+0000 7fb946d9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9481f27c0 0x7fb9481f2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:40.953 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.950+0000 7fb946d9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9481f27c0 0x7fb9481f2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46800/0 (socket says 172.21.15.98:46800) 2024-09-17T05:22:40.953 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.950+0000 7fb946d9d640 1 -- 172.21.15.98:0/2587902430 learned_addr learned my addr 172.21.15.98:0/2587902430 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:40.953 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.950+0000 7fb94659c640 1 --2- 172.21.15.98:0/2587902430 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb934004d40 0x7fb9480ae3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:40.953 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.950+0000 7fb945d9b640 1 --2- 172.21.15.98:0/2587902430 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9481ef4a0 0x7fb9481ef920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:40.953 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.950+0000 7fb946d9d640 1 -- 172.21.15.98:0/2587902430 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb934004d40 msgr2=0x7fb9480ae3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:40.953 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.950+0000 7fb946d9d640 1 --2- 172.21.15.98:0/2587902430 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb934004d40 0x7fb9480ae3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:40.953 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.950+0000 7fb946d9d640 1 -- 172.21.15.98:0/2587902430 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9481ef4a0 msgr2=0x7fb9481ef920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:40.953 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.950+0000 7fb946d9d640 1 --2- 172.21.15.98:0/2587902430 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9481ef4a0 0x7fb9481ef920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:40.953 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.950+0000 7fb946d9d640 1 -- 172.21.15.98:0/2587902430 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb948140ae0 con 0x7fb9481f27c0 2024-09-17T05:22:40.953 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.950+0000 7fb946d9d640 1 --2- 172.21.15.98:0/2587902430 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9481f27c0 0x7fb9481f2c70 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb94002b4f0 tx=0x7fb940033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:40.954 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.950+0000 7fb93effd640 1 -- 172.21.15.98:0/2587902430 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb940038040 con 0x7fb9481f27c0 2024-09-17T05:22:40.954 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.950+0000 7fb93effd640 1 -- 172.21.15.98:0/2587902430 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb940004110 con 0x7fb9481f27c0 2024-09-17T05:22:40.954 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.950+0000 7fb94c808640 1 -- 172.21.15.98:0/2587902430 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9481efe60 con 0x7fb9481f27c0 2024-09-17T05:22:40.954 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.950+0000 7fb93effd640 1 -- 172.21.15.98:0/2587902430 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9400336e0 con 0x7fb9481f27c0 2024-09-17T05:22:40.954 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.950+0000 7fb94c808640 1 -- 172.21.15.98:0/2587902430 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb948152870 con 0x7fb9481f27c0 2024-09-17T05:22:40.955 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.951+0000 7fb94c808640 1 -- 172.21.15.98:0/2587902430 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9480cdbb0 con 0x7fb9481f27c0 2024-09-17T05:22:40.955 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.952+0000 7fb93effd640 1 -- 172.21.15.98:0/2587902430 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb940044020 con 0x7fb9481f27c0 2024-09-17T05:22:40.955 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.952+0000 7fb93effd640 1 --2- 172.21.15.98:0/2587902430 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fb928078bf0 0x7fb92807b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:40.955 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.953+0000 7fb93effd640 1 -- 172.21.15.98:0/2587902430 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fb9400ba900 con 0x7fb9481f27c0 2024-09-17T05:22:40.955 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.953+0000 7fb94659c640 1 --2- 172.21.15.98:0/2587902430 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fb928078bf0 0x7fb92807b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:40.955 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.953+0000 7fb94659c640 1 --2- 172.21.15.98:0/2587902430 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fb928078bf0 0x7fb92807b0b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb938006fd0 tx=0x7fb938006b20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:40.959 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:40.957+0000 7fb93effd640 1 -- 172.21.15.98:0/2587902430 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fb9481efe60 con 0x7fb9481f27c0 2024-09-17T05:22:41.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.202+0000 7fb94c808640 1 -- 172.21.15.98:0/2587902430 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fb9481435b0 con 0x7fb9481f27c0 2024-09-17T05:22:41.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.204+0000 7fb93effd640 1 -- 172.21.15.98:0/2587902430 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) ==== 190+0+147 (secure 0 0 0) 0x7fb940082780 con 0x7fb9481f27c0 2024-09-17T05:22:41.209 INFO:teuthology.orchestra.run.smithi098.stdout:[client.0] 2024-09-17T05:22:41.209 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQC2EelmTC1KKBAAXutxPyhWEuBL6NvHRzTrpg== 2024-09-17T05:22:41.209 INFO:teuthology.orchestra.run.smithi098.stdout: caps mds = "allow" 2024-09-17T05:22:41.209 INFO:teuthology.orchestra.run.smithi098.stdout: caps mon = "allow r" 2024-09-17T05:22:41.209 INFO:teuthology.orchestra.run.smithi098.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T05:22:41.210 INFO:teuthology.orchestra.run.smithi098.stderr:updated caps for client.0 2024-09-17T05:22:41.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.207+0000 7fb94c808640 1 -- 172.21.15.98:0/2587902430 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fb928078bf0 msgr2=0x7fb92807b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:41.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.207+0000 7fb94c808640 1 --2- 172.21.15.98:0/2587902430 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fb928078bf0 0x7fb92807b0b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb938006fd0 tx=0x7fb938006b20 comp rx=0 tx=0).stop 2024-09-17T05:22:41.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.207+0000 7fb94c808640 1 -- 172.21.15.98:0/2587902430 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9481f27c0 msgr2=0x7fb9481f2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:41.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.207+0000 7fb94c808640 1 --2- 172.21.15.98:0/2587902430 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9481f27c0 0x7fb9481f2c70 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb94002b4f0 tx=0x7fb940033670 comp rx=0 tx=0).stop 2024-09-17T05:22:41.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.207+0000 7fb94c808640 1 -- 172.21.15.98:0/2587902430 shutdown_connections 2024-09-17T05:22:41.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.207+0000 7fb94c808640 1 --2- 172.21.15.98:0/2587902430 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fb928078bf0 0x7fb92807b0b0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:41.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.207+0000 7fb94c808640 1 --2- 172.21.15.98:0/2587902430 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9481f27c0 0x7fb9481f2c70 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:41.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.207+0000 7fb94c808640 1 --2- 172.21.15.98:0/2587902430 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9481ef4a0 0x7fb9481ef920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:41.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.207+0000 7fb94c808640 1 --2- 172.21.15.98:0/2587902430 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb934004d40 0x7fb9480ae3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:41.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.208+0000 7fb94c808640 1 -- 172.21.15.98:0/2587902430 >> 172.21.15.98:0/2587902430 conn(0x7fb9480b1840 msgr2=0x7fb94806f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:41.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.208+0000 7fb94c808640 1 -- 172.21.15.98:0/2587902430 shutdown_connections 2024-09-17T05:22:41.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.208+0000 7fb94c808640 1 -- 172.21.15.98:0/2587902430 wait complete. 2024-09-17T05:22:41.219 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:22:41.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.319+0000 7fbfb1d89640 1 -- 172.21.15.98:0/1977427294 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbfac0c6d10 msgr2=0x7fbfac0c71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:41.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.319+0000 7fbfb1d89640 1 --2- 172.21.15.98:0/1977427294 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbfac0c6d10 0x7fbfac0c71a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c009830 tx=0x7fbf9c02a480 comp rx=0 tx=0).stop 2024-09-17T05:22:41.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.319+0000 7fbfb1d89640 1 -- 172.21.15.98:0/1977427294 shutdown_connections 2024-09-17T05:22:41.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.319+0000 7fbfb1d89640 1 --2- 172.21.15.98:0/1977427294 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbfac0c6d10 0x7fbfac0c71a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:41.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.319+0000 7fbfb1d89640 1 --2- 172.21.15.98:0/1977427294 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbfac15f3d0 0x7fbfac0d28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:41.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.319+0000 7fbfb1d89640 1 -- 172.21.15.98:0/1977427294 >> 172.21.15.98:0/1977427294 conn(0x7fbfac0d1d80 msgr2=0x7fbfac0d2190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:41.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.319+0000 7fbfb1d89640 1 -- 172.21.15.98:0/1977427294 shutdown_connections 2024-09-17T05:22:41.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.319+0000 7fbfb1d89640 1 -- 172.21.15.98:0/1977427294 wait complete. 2024-09-17T05:22:41.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.321+0000 7fbfb1d89640 1 Processor -- start 2024-09-17T05:22:41.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.321+0000 7fbfb1d89640 1 -- start start 2024-09-17T05:22:41.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.322+0000 7fbfb1d89640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbfac0c6d10 0x7fbfac14bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:41.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.322+0000 7fbfb1d89640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbfac0cc870 0x7fbfac0c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:41.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.322+0000 7fbfb1d89640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbfac15f3d0 0x7fbfac1f5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:41.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.322+0000 7fbfb1d89640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fbfac0c76e0 con 0x7fbfac0c6d10 2024-09-17T05:22:41.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.322+0000 7fbfb1d89640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbfac0d0c30 con 0x7fbfac0cc870 2024-09-17T05:22:41.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.322+0000 7fbfb1d89640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fbfac0c7860 con 0x7fbfac15f3d0 2024-09-17T05:22:41.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.322+0000 7fbfab7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbfac0c6d10 0x7fbfac14bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:41.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.322+0000 7fbfab7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbfac0c6d10 0x7fbfac14bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46806/0 (socket says 172.21.15.98:46806) 2024-09-17T05:22:41.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.322+0000 7fbfab7fe640 1 -- 172.21.15.98:0/2718806345 learned_addr learned my addr 172.21.15.98:0/2718806345 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:41.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.322+0000 7fbfabfff640 1 --2- 172.21.15.98:0/2718806345 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbfac15f3d0 0x7fbfac1f5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:41.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.322+0000 7fbfab7fe640 1 -- 172.21.15.98:0/2718806345 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbfac15f3d0 msgr2=0x7fbfac1f5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:41.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.322+0000 7fbfaaffd640 1 --2- 172.21.15.98:0/2718806345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbfac0cc870 0x7fbfac0c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:41.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.322+0000 7fbfab7fe640 1 --2- 172.21.15.98:0/2718806345 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbfac15f3d0 0x7fbfac1f5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:41.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.322+0000 7fbfab7fe640 1 -- 172.21.15.98:0/2718806345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbfac0cc870 msgr2=0x7fbfac0c9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:41.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.322+0000 7fbfab7fe640 1 --2- 172.21.15.98:0/2718806345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbfac0cc870 0x7fbfac0c9e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:41.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.322+0000 7fbfab7fe640 1 -- 172.21.15.98:0/2718806345 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfac14c080 con 0x7fbfac0c6d10 2024-09-17T05:22:41.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.322+0000 7fbfab7fe640 1 --2- 172.21.15.98:0/2718806345 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbfac0c6d10 0x7fbfac14bb40 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fbfa400ecb0 tx=0x7fbfa400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:41.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.322+0000 7fbfa3fff640 1 -- 172.21.15.98:0/2718806345 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa4003b70 con 0x7fbfac0c6d10 2024-09-17T05:22:41.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.322+0000 7fbfa3fff640 1 -- 172.21.15.98:0/2718806345 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbfa4003d10 con 0x7fbfac0c6d10 2024-09-17T05:22:41.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.322+0000 7fbfb1d89640 1 -- 172.21.15.98:0/2718806345 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfac0ca7d0 con 0x7fbfac0c6d10 2024-09-17T05:22:41.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.322+0000 7fbfa3fff640 1 -- 172.21.15.98:0/2718806345 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa4004280 con 0x7fbfac0c6d10 2024-09-17T05:22:41.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.322+0000 7fbfb1d89640 1 -- 172.21.15.98:0/2718806345 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfac0cad90 con 0x7fbfac0c6d10 2024-09-17T05:22:41.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.323+0000 7fbfb1d89640 1 -- 172.21.15.98:0/2718806345 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfac0c7dc0 con 0x7fbfac0c6d10 2024-09-17T05:22:41.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.324+0000 7fbfa3fff640 1 -- 172.21.15.98:0/2718806345 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbfa4004420 con 0x7fbfac0c6d10 2024-09-17T05:22:41.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.325+0000 7fbfa3fff640 1 --2- 172.21.15.98:0/2718806345 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fbf8c078b90 0x7fbf8c07b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:41.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.325+0000 7fbfa3fff640 1 -- 172.21.15.98:0/2718806345 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fbfa409b9a0 con 0x7fbfac0c6d10 2024-09-17T05:22:41.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.325+0000 7fbfaaffd640 1 --2- 172.21.15.98:0/2718806345 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fbf8c078b90 0x7fbf8c07b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:41.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.325+0000 7fbfaaffd640 1 --2- 172.21.15.98:0/2718806345 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fbf8c078b90 0x7fbf8c07b050 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbfac09fc30 tx=0x7fbf94009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:41.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.329+0000 7fbfa3fff640 1 -- 172.21.15.98:0/2718806345 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fbfa4063e70 con 0x7fbfac0c6d10 2024-09-17T05:22:41.539 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.538+0000 7fbfb1d89640 1 -- 172.21.15.98:0/2718806345 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbfac15e9b0 con 0x7fbfac0c6d10 2024-09-17T05:22:41.539 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.539+0000 7fbfa3fff640 1 -- 172.21.15.98:0/2718806345 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5226 (secure 0 0 0) 0x7fbfa4063770 con 0x7fbfac0c6d10 2024-09-17T05:22:41.540 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:22:41.540 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":14,"btime":"2024-09-17T05:22:35:113505+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4771,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/387934311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":387934311},{"type":"v1","addr":"172.21.15.167:6836","nonce":387934311}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4878,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6834/2571517660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2571517660},{"type":"v1","addr":"172.21.15.98:6834","nonce":2571517660}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4881,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/1837285444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6833","nonce":1837285444},{"type":"v1","addr":"172.21.15.98:6835","nonce":1837285444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:22:32.448852+0000","modified":"2024-09-17T05:22:34.449535+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4890},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4890":{"gid":4890,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6837/3889162905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":3889162905},{"type":"v1","addr":"172.21.15.167:6837","nonce":3889162905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4890,"qdb_cluster":[4890]},"id":2}]} 2024-09-17T05:22:41.540 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 14 2024-09-17T05:22:41.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.541+0000 7fbfb1d89640 1 -- 172.21.15.98:0/2718806345 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fbf8c078b90 msgr2=0x7fbf8c07b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:41.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.541+0000 7fbfb1d89640 1 --2- 172.21.15.98:0/2718806345 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fbf8c078b90 0x7fbf8c07b050 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbfac09fc30 tx=0x7fbf94009040 comp rx=0 tx=0).stop 2024-09-17T05:22:41.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.541+0000 7fbfb1d89640 1 -- 172.21.15.98:0/2718806345 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbfac0c6d10 msgr2=0x7fbfac14bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:41.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.541+0000 7fbfb1d89640 1 --2- 172.21.15.98:0/2718806345 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbfac0c6d10 0x7fbfac14bb40 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fbfa400ecb0 tx=0x7fbfa400c6a0 comp rx=0 tx=0).stop 2024-09-17T05:22:41.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.541+0000 7fbfb1d89640 1 -- 172.21.15.98:0/2718806345 shutdown_connections 2024-09-17T05:22:41.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.541+0000 7fbfb1d89640 1 --2- 172.21.15.98:0/2718806345 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fbf8c078b90 0x7fbf8c07b050 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:41.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.541+0000 7fbfb1d89640 1 --2- 172.21.15.98:0/2718806345 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbfac15f3d0 0x7fbfac1f5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:41.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.541+0000 7fbfb1d89640 1 --2- 172.21.15.98:0/2718806345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbfac0cc870 0x7fbfac0c9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:41.543 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.541+0000 7fbfb1d89640 1 --2- 172.21.15.98:0/2718806345 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbfac0c6d10 0x7fbfac14bb40 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:41.543 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.541+0000 7fbfb1d89640 1 -- 172.21.15.98:0/2718806345 >> 172.21.15.98:0/2718806345 conn(0x7fbfac0d1d80 msgr2=0x7fbfac070910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:41.543 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.541+0000 7fbfb1d89640 1 -- 172.21.15.98:0/2718806345 shutdown_connections 2024-09-17T05:22:41.543 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:41.541+0000 7fbfb1d89640 1 -- 172.21.15.98:0/2718806345 wait complete. 2024-09-17T05:22:41.956 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:22:32.448852+0000', 'modified': '2024-09-17T05:22:34.449535+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4890}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4890': {'gid': 4890, 'name': 'b', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.167:6837/3889162905', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6835', 'nonce': 3889162905}, {'type': 'v1', 'addr': '172.21.15.167:6837', 'nonce': 3889162905}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4890, 'qdb_cluster': [4890]} 2024-09-17T05:22:41.956 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T05:22:41.956 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-17T05:22:42.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.061+0000 7f0c169e2640 1 -- 172.21.15.98:0/883549149 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0bf8003c60 msgr2=0x7f0bf8004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:42.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.061+0000 7f0c169e2640 1 --2- 172.21.15.98:0/883549149 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0bf8003c60 0x7f0bf8004060 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f0c00001830 tx=0x7f0bf8005830 comp rx=0 tx=0).stop 2024-09-17T05:22:42.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.061+0000 7f0c14f7f640 1 -- 172.21.15.98:0/883549149 reap_dead start 2024-09-17T05:22:42.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.061+0000 7f0c169e2640 1 -- 172.21.15.98:0/883549149 shutdown_connections 2024-09-17T05:22:42.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.061+0000 7f0c169e2640 1 -- 172.21.15.98:0/883549149 >> 172.21.15.98:0/883549149 conn(0x7f0c100d3fe0 msgr2=0x7f0c100d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:42.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.061+0000 7f0c169e2640 1 -- 172.21.15.98:0/883549149 shutdown_connections 2024-09-17T05:22:42.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.061+0000 7f0c169e2640 1 -- 172.21.15.98:0/883549149 wait complete. 2024-09-17T05:22:42.063 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.062+0000 7f0c169e2640 1 Processor -- start 2024-09-17T05:22:42.063 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.062+0000 7f0c169e2640 1 -- start start 2024-09-17T05:22:42.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.063+0000 7f0c169e2640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0bf8003c60 0x7f0c100ca3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:42.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.063+0000 7f0c169e2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c100c97f0 0x7f0c101566e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:42.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.063+0000 7f0c169e2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c10160e80 0x7f0c101f5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:42.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.063+0000 7f0c169e2640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0c10166e70 con 0x7f0c100c97f0 2024-09-17T05:22:42.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.063+0000 7f0c169e2640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0c10166cf0 con 0x7f0c10160e80 2024-09-17T05:22:42.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.063+0000 7f0c169e2640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f0c10166ff0 con 0x7f0bf8003c60 2024-09-17T05:22:42.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.063+0000 7f0c0f7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c100c97f0 0x7f0c101566e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:42.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.063+0000 7f0c0f7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c100c97f0 0x7f0c101566e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46820/0 (socket says 172.21.15.98:46820) 2024-09-17T05:22:42.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.063+0000 7f0c0f7fe640 1 -- 172.21.15.98:0/1871876652 learned_addr learned my addr 172.21.15.98:0/1871876652 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:42.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.063+0000 7f0c0ffff640 1 --2- 172.21.15.98:0/1871876652 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0bf8003c60 0x7f0c100ca3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:42.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.063+0000 7f0c14f7f640 1 --2- 172.21.15.98:0/1871876652 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c10160e80 0x7f0c101f5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:42.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.063+0000 7f0c0f7fe640 1 -- 172.21.15.98:0/1871876652 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0bf8003c60 msgr2=0x7f0c100ca3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:42.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.063+0000 7f0c0f7fe640 1 --2- 172.21.15.98:0/1871876652 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0bf8003c60 0x7f0c100ca3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:42.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.063+0000 7f0c0f7fe640 1 -- 172.21.15.98:0/1871876652 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c10160e80 msgr2=0x7f0c101f5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:42.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.063+0000 7f0c0f7fe640 1 --2- 172.21.15.98:0/1871876652 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c10160e80 0x7f0c101f5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:42.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.063+0000 7f0c0f7fe640 1 -- 172.21.15.98:0/1871876652 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c10161360 con 0x7f0c100c97f0 2024-09-17T05:22:42.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.063+0000 7f0c0f7fe640 1 --2- 172.21.15.98:0/1871876652 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c100c97f0 0x7f0c101566e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0c0400e540 tx=0x7f0c0400ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:42.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.064+0000 7f0c0cff9640 1 -- 172.21.15.98:0/1871876652 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c04015070 con 0x7f0c100c97f0 2024-09-17T05:22:42.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.064+0000 7f0c0cff9640 1 -- 172.21.15.98:0/1871876652 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0c0400c9e0 con 0x7f0c100c97f0 2024-09-17T05:22:42.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.064+0000 7f0c169e2640 1 -- 172.21.15.98:0/1871876652 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c10158240 con 0x7f0c100c97f0 2024-09-17T05:22:42.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.064+0000 7f0c0cff9640 1 -- 172.21.15.98:0/1871876652 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c0400ce30 con 0x7f0c100c97f0 2024-09-17T05:22:42.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.064+0000 7f0c169e2640 1 -- 172.21.15.98:0/1871876652 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c10156c20 con 0x7f0c100c97f0 2024-09-17T05:22:42.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.065+0000 7f0c0cff9640 1 -- 172.21.15.98:0/1871876652 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0c04018070 con 0x7f0c100c97f0 2024-09-17T05:22:42.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.066+0000 7f0c0cff9640 1 --2- 172.21.15.98:0/1871876652 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f0bfc078b90 0x7f0bfc07b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:42.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.066+0000 7f0c0cff9640 1 -- 172.21.15.98:0/1871876652 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f0c0409b0f0 con 0x7f0c100c97f0 2024-09-17T05:22:42.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.066+0000 7f0c0ffff640 1 --2- 172.21.15.98:0/1871876652 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f0bfc078b90 0x7f0bfc07b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:42.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.067+0000 7f0c0ffff640 1 --2- 172.21.15.98:0/1871876652 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f0bfc078b90 0x7f0bfc07b050 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0c00032000 tx=0x7f0c00001360 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:42.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.067+0000 7f0c1988a740 1 Processor -- start 2024-09-17T05:22:42.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.067+0000 7f0c1988a740 1 -- start start 2024-09-17T05:22:42.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.068+0000 7f0c1988a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562ccf3b01b0 0x562ccf387b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:42.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.068+0000 7f0c1988a740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ccf3cfdf0 0x562ccf3d01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:42.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.068+0000 7f0c1988a740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562ccf3855f0 0x562ccf385a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:42.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.068+0000 7f0c1988a740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562ccf2fc820 con 0x562ccf3cfdf0 2024-09-17T05:22:42.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.068+0000 7f0c1988a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x562ccf2ebc50 con 0x562ccf3b01b0 2024-09-17T05:22:42.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.068+0000 7f0c1988a740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x562ccf2efa60 con 0x562ccf3855f0 2024-09-17T05:22:42.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.068+0000 7f0c0f7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ccf3cfdf0 0x562ccf3d01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:42.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.068+0000 7f0c0f7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ccf3cfdf0 0x562ccf3d01f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46830/0 (socket says 172.21.15.98:46830) 2024-09-17T05:22:42.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.068+0000 7f0c0f7fe640 1 -- 172.21.15.98:0/4078199215 learned_addr learned my addr 172.21.15.98:0/4078199215 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:42.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.068+0000 7f0c0ffff640 1 --2- 172.21.15.98:0/4078199215 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562ccf3b01b0 0x562ccf387b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:42.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.068+0000 7f0c14f7f640 1 --2- 172.21.15.98:0/4078199215 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562ccf3855f0 0x562ccf385a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:42.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.068+0000 7f0c0f7fe640 1 -- 172.21.15.98:0/4078199215 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562ccf3855f0 msgr2=0x562ccf385a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:22:42.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.068+0000 7f0c0f7fe640 1 --2- 172.21.15.98:0/4078199215 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562ccf3855f0 0x562ccf385a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:42.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.068+0000 7f0c0f7fe640 1 -- 172.21.15.98:0/4078199215 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562ccf3b01b0 msgr2=0x562ccf387b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:22:42.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.068+0000 7f0c0f7fe640 1 --2- 172.21.15.98:0/4078199215 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562ccf3b01b0 0x562ccf387b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:42.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.068+0000 7f0c0f7fe640 1 -- 172.21.15.98:0/4078199215 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ccf04d850 con 0x562ccf3cfdf0 2024-09-17T05:22:42.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.068+0000 7f0c0f7fe640 1 --2- 172.21.15.98:0/4078199215 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ccf3cfdf0 0x562ccf3d01f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0c04060130 tx=0x7f0c04062760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30b97ef08194784c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:42.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.068+0000 7f0bf5ffb640 1 -- 172.21.15.98:0/4078199215 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c0401f040 con 0x562ccf3cfdf0 2024-09-17T05:22:42.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.068+0000 7f0bf5ffb640 1 -- 172.21.15.98:0/4078199215 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0c040679a0 con 0x562ccf3cfdf0 2024-09-17T05:22:42.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.068+0000 7f0bf5ffb640 1 -- 172.21.15.98:0/4078199215 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c0406c850 con 0x562ccf3cfdf0 2024-09-17T05:22:42.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.069+0000 7f0c1988a740 1 -- 172.21.15.98:0/4078199215 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ccf3cfdf0 msgr2=0x562ccf3d01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:42.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.069+0000 7f0c1988a740 1 --2- 172.21.15.98:0/4078199215 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ccf3cfdf0 0x562ccf3d01f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0c04060130 tx=0x7f0c04062760 comp rx=0 tx=0).stop 2024-09-17T05:22:42.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.069+0000 7f0c1988a740 1 -- 172.21.15.98:0/4078199215 shutdown_connections 2024-09-17T05:22:42.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.069+0000 7f0c1988a740 1 --2- 172.21.15.98:0/4078199215 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562ccf3855f0 0x562ccf385a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:42.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.069+0000 7f0c1988a740 1 --2- 172.21.15.98:0/4078199215 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ccf3cfdf0 0x562ccf3d01f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:42.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.069+0000 7f0c1988a740 1 --2- 172.21.15.98:0/4078199215 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562ccf3b01b0 0x562ccf387b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:42.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.069+0000 7f0c1988a740 1 -- 172.21.15.98:0/4078199215 >> 172.21.15.98:0/4078199215 conn(0x562ccf3866a0 msgr2=0x562ccf38a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:42.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.069+0000 7f0c1988a740 1 -- 172.21.15.98:0/4078199215 shutdown_connections 2024-09-17T05:22:42.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.069+0000 7f0c1988a740 1 -- 172.21.15.98:0/4078199215 wait complete. 2024-09-17T05:22:42.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.069+0000 7f0c1988a740 1 -- start start 2024-09-17T05:22:42.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.070+0000 7f0c1988a740 1 Processor -- start 2024-09-17T05:22:42.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.070+0000 7f0c1988a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562ccf3b01b0 0x562ccf3df350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:42.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.070+0000 7f0c1988a740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562ccf3cfdf0 0x562ccf3c85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:42.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.070+0000 7f0c1988a740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ccf3e1e30 0x562ccf388b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:42.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.070+0000 7f0c1988a740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562ccf05c620 con 0x562ccf3e1e30 2024-09-17T05:22:42.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.070+0000 7f0c1988a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x562ccf2915f0 con 0x562ccf3b01b0 2024-09-17T05:22:42.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.070+0000 7f0c1988a740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x562ccf384b30 con 0x562ccf3cfdf0 2024-09-17T05:22:42.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.070+0000 7f0c1988a740 10 client.0 _ll_register_callbacks cb 0x562ccf2950a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:22:42.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.071+0000 7f0c14f7f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ccf3e1e30 0x562ccf388b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:42.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.071+0000 7f0c14f7f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ccf3e1e30 0x562ccf388b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46836/0 (socket says 172.21.15.98:46836) 2024-09-17T05:22:42.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.071+0000 7f0c14f7f640 1 -- 172.21.15.98:0/3776012247 learned_addr learned my addr 172.21.15.98:0/3776012247 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:42.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.071+0000 7f0c0f7fe640 1 --2- 172.21.15.98:0/3776012247 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562ccf3cfdf0 0x562ccf3c85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:42.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.071+0000 7f0c0ffff640 1 --2- 172.21.15.98:0/3776012247 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562ccf3b01b0 0x562ccf3df350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:42.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.071+0000 7f0c14f7f640 1 -- 172.21.15.98:0/3776012247 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562ccf3cfdf0 msgr2=0x562ccf3c85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:22:42.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.071+0000 7f0c14f7f640 1 --2- 172.21.15.98:0/3776012247 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562ccf3cfdf0 0x562ccf3c85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:42.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.071+0000 7f0c14f7f640 1 -- 172.21.15.98:0/3776012247 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562ccf3b01b0 msgr2=0x562ccf3df350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:22:42.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.071+0000 7f0c14f7f640 1 --2- 172.21.15.98:0/3776012247 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562ccf3b01b0 0x562ccf3df350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:42.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.071+0000 7f0c14f7f640 1 -- 172.21.15.98:0/3776012247 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ccf0c46b0 con 0x562ccf3e1e30 2024-09-17T05:22:42.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.071+0000 7f0c14f7f640 1 --2- 172.21.15.98:0/3776012247 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ccf3e1e30 0x562ccf388b70 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0c08009fd0 tx=0x7f0c08004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f06a54df682eafd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:42.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.071+0000 7f0beeffd640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-17T05:22:42.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.071+0000 7f0beeffd640 1 -- 172.21.15.98:0/3776012247 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c08020060 con 0x562ccf3e1e30 2024-09-17T05:22:42.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.071+0000 7f0c1988a740 1 -- 172.21.15.98:0/3776012247 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c040679a0 con 0x562ccf3e1e30 2024-09-17T05:22:42.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.071+0000 7f0beeffd640 1 -- 172.21.15.98:0/3776012247 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f0c08012720 con 0x562ccf3e1e30 2024-09-17T05:22:42.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.071+0000 7f0beeffd640 1 -- 172.21.15.98:0/3776012247 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f0c08026050 con 0x562ccf3e1e30 2024-09-17T05:22:42.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.071+0000 7f0c1988a740 10 client.5076 fetch_fsmap learned FSMap version 14 2024-09-17T05:22:42.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.071+0000 7f0c1988a740 1 -- 172.21.15.98:0/3776012247 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x562ccf3dfbe0 con 0x562ccf3e1e30 2024-09-17T05:22:42.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.071+0000 7f0beeffd640 1 -- 172.21.15.98:0/3776012247 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0c040679a0 con 0x562ccf3e1e30 2024-09-17T05:22:42.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.072+0000 7f0beeffd640 1 -- 172.21.15.98:0/3776012247 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 14) ==== 3502+0+0 (secure 0 0 0) 0x7f0c08029020 con 0x562ccf3e1e30 2024-09-17T05:22:42.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.072+0000 7f0c1988a740 10 client.5076 fetch_fsmap finished waiting for FSMap version 14 2024-09-17T05:22:42.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.072+0000 7f0c1988a740 10 client.5076 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-17T05:22:42.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.072+0000 7f0c1988a740 20 client.5076 populate_metadata read hostname 'smithi098' 2024-09-17T05:22:42.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.072+0000 7f0c1988a740 1 --2- 172.21.15.98:0/3776012247 >> [v2:172.21.15.167:6835/3889162905,v1:172.21.15.167:6837/3889162905] conn(0x562ccf3c93f0 0x562ccf3e0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:42.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.072+0000 7f0c1988a740 4 client.5076 mds_command: new command op to 4890 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:22:42.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.072+0000 7f0c1988a740 1 -- 172.21.15.98:0/3776012247 --> [v2:172.21.15.167:6835/3889162905,v1:172.21.15.167:6837/3889162905] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562ccf2fe770 con 0x562ccf3c93f0 2024-09-17T05:22:42.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.072+0000 7f0c0ffff640 1 --2- 172.21.15.98:0/3776012247 >> [v2:172.21.15.167:6835/3889162905,v1:172.21.15.167:6837/3889162905] conn(0x562ccf3c93f0 0x562ccf3e0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:42.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.072+0000 7f0beeffd640 10 client.5076 ms_handle_connect on v2:172.21.15.167:6835/3889162905 2024-09-17T05:22:42.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.072+0000 7f0c0ffff640 1 --2- 172.21.15.98:0/3776012247 >> [v2:172.21.15.167:6835/3889162905,v1:172.21.15.167:6837/3889162905] conn(0x562ccf3c93f0 0x562ccf3e0430 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38bb4f7bbfd22b56 server_cookie=9f4bc626524f6992 in_seq=0 out_seq=0 2024-09-17T05:22:42.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.073+0000 7f0beeffd640 1 -- 172.21.15.98:0/3776012247 <== mds.0 v2:172.21.15.167:6835/3889162905 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562ccf2fe770 con 0x562ccf3c93f0 2024-09-17T05:22:42.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.073+0000 7f0beeffd640 10 client.5076 handle_command_reply: tid=0 2024-09-17T05:22:42.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.073+0000 7f0c1988a740 1 client.5076 shutdown 2024-09-17T05:22:42.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.073+0000 7f0c1988a740 1 -- 172.21.15.98:0/3776012247 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ccf3e1e30 msgr2=0x562ccf388b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:42.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.073+0000 7f0c1988a740 1 --2- 172.21.15.98:0/3776012247 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ccf3e1e30 0x562ccf388b70 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0c08009fd0 tx=0x7f0c08004410 comp rx=0 tx=0).stop 2024-09-17T05:22:42.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.073+0000 7f0c1988a740 1 -- 172.21.15.98:0/3776012247 shutdown_connections 2024-09-17T05:22:42.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.073+0000 7f0c1988a740 1 --2- 172.21.15.98:0/3776012247 >> [v2:172.21.15.167:6835/3889162905,v1:172.21.15.167:6837/3889162905] conn(0x562ccf3c93f0 0x562ccf3e0430 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:42.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.073+0000 7f0c1988a740 1 --2- 172.21.15.98:0/3776012247 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ccf3e1e30 0x562ccf388b70 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:42.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.073+0000 7f0c1988a740 1 --2- 172.21.15.98:0/3776012247 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562ccf3cfdf0 0x562ccf3c85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:42.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.073+0000 7f0c1988a740 1 --2- 172.21.15.98:0/3776012247 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562ccf3b01b0 0x562ccf3df350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:42.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.073+0000 7f0beeffd640 0 client.5076 ms_handle_reset on v2:172.21.15.167:6835/3889162905 2024-09-17T05:22:42.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.073+0000 7f0c1988a740 1 -- 172.21.15.98:0/3776012247 >> 172.21.15.98:0/3776012247 conn(0x562ccf3855f0 msgr2=0x562ccf38a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:42.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.073+0000 7f0c1988a740 1 -- 172.21.15.98:0/3776012247 shutdown_connections 2024-09-17T05:22:42.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.073+0000 7f0c1988a740 1 -- 172.21.15.98:0/3776012247 wait complete. 2024-09-17T05:22:42.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.073+0000 7f0c1988a740 20 client.5076 trim_cache size 0 max 16384 2024-09-17T05:22:42.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.091+0000 7f0c1988a740 1 Processor -- start 2024-09-17T05:22:42.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.091+0000 7f0c1988a740 1 -- start start 2024-09-17T05:22:42.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.092+0000 7f0c1988a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562ccf3b01b0 0x562ccf3cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:42.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.092+0000 7f0c1988a740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562ccf3cfdf0 0x562ccf387430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:42.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.092+0000 7f0c1988a740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ccf3e1e30 0x562ccf3f2840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:42.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.092+0000 7f0c1988a740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0c10200930 con 0x562ccf3e1e30 2024-09-17T05:22:42.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.092+0000 7f0c1988a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0c101f88f0 con 0x562ccf3b01b0 2024-09-17T05:22:42.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.092+0000 7f0c1988a740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f0c101f8f40 con 0x562ccf3cfdf0 2024-09-17T05:22:42.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.092+0000 7f0c14f7f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ccf3e1e30 0x562ccf3f2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:42.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.092+0000 7f0c14f7f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ccf3e1e30 0x562ccf3f2840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46842/0 (socket says 172.21.15.98:46842) 2024-09-17T05:22:42.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.092+0000 7f0c14f7f640 1 -- 172.21.15.98:0/2742763983 learned_addr learned my addr 172.21.15.98:0/2742763983 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:42.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.092+0000 7f0c0ffff640 1 --2- 172.21.15.98:0/2742763983 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562ccf3b01b0 0x562ccf3cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:42.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.092+0000 7f0c0f7fe640 1 --2- 172.21.15.98:0/2742763983 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562ccf3cfdf0 0x562ccf387430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:42.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.092+0000 7f0c14f7f640 1 -- 172.21.15.98:0/2742763983 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562ccf3cfdf0 msgr2=0x562ccf387430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:22:42.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.092+0000 7f0c14f7f640 1 --2- 172.21.15.98:0/2742763983 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562ccf3cfdf0 0x562ccf387430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:42.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.092+0000 7f0c14f7f640 1 -- 172.21.15.98:0/2742763983 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562ccf3b01b0 msgr2=0x562ccf3cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:22:42.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.092+0000 7f0c14f7f640 1 --2- 172.21.15.98:0/2742763983 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562ccf3b01b0 0x562ccf3cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:42.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.092+0000 7f0c14f7f640 1 -- 172.21.15.98:0/2742763983 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ccf3c9ae0 con 0x562ccf3e1e30 2024-09-17T05:22:42.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.092+0000 7f0c0ffff640 1 --2- 172.21.15.98:0/2742763983 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562ccf3b01b0 0x562ccf3cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:22:42.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.093+0000 7f0c14f7f640 1 --2- 172.21.15.98:0/2742763983 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ccf3e1e30 0x562ccf3f2840 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0c080128b0 tx=0x7f0c080098e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd5f775c57b049cd server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:42.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.093+0000 7f0bf57fa640 1 -- 172.21.15.98:0/2742763983 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c08005bc0 con 0x562ccf3e1e30 2024-09-17T05:22:42.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.093+0000 7f0bf57fa640 1 -- 172.21.15.98:0/2742763983 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0c08004ab0 con 0x562ccf3e1e30 2024-09-17T05:22:42.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.093+0000 7f0bf57fa640 1 -- 172.21.15.98:0/2742763983 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c08005020 con 0x562ccf3e1e30 2024-09-17T05:22:42.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.093+0000 7f0c1988a740 1 -- 172.21.15.98:0/2742763983 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ccf3e1e30 msgr2=0x562ccf3f2840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:42.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.093+0000 7f0c1988a740 1 --2- 172.21.15.98:0/2742763983 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ccf3e1e30 0x562ccf3f2840 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0c080128b0 tx=0x7f0c080098e0 comp rx=0 tx=0).stop 2024-09-17T05:22:42.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.093+0000 7f0c1988a740 1 -- 172.21.15.98:0/2742763983 shutdown_connections 2024-09-17T05:22:42.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.093+0000 7f0c1988a740 1 --2- 172.21.15.98:0/2742763983 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ccf3e1e30 0x562ccf3f2840 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:42.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.093+0000 7f0c1988a740 1 --2- 172.21.15.98:0/2742763983 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562ccf3cfdf0 0x562ccf387430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:42.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.093+0000 7f0c1988a740 1 --2- 172.21.15.98:0/2742763983 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562ccf3b01b0 0x562ccf3cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:42.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.093+0000 7f0c1988a740 1 -- 172.21.15.98:0/2742763983 >> 172.21.15.98:0/2742763983 conn(0x562ccf3855f0 msgr2=0x562ccf38a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:42.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.093+0000 7f0c1988a740 1 -- 172.21.15.98:0/2742763983 shutdown_connections 2024-09-17T05:22:42.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.093+0000 7f0c1988a740 1 -- 172.21.15.98:0/2742763983 wait complete. 2024-09-17T05:22:42.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.094+0000 7f0c1988a740 1 -- start start 2024-09-17T05:22:42.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.094+0000 7f0c1988a740 1 Processor -- start 2024-09-17T05:22:42.101 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.095+0000 7f0c1988a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562ccf3b01b0 0x562ccf3b2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:42.101 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.095+0000 7f0c1988a740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ccf3cfdf0 0x562ccf44fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:42.101 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.095+0000 7f0c1988a740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562ccf3e1e30 0x562ccf3e6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:42.102 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.095+0000 7f0c1988a740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562ccf3c9270 con 0x562ccf3cfdf0 2024-09-17T05:22:42.102 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.095+0000 7f0c1988a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x562ccf3e1240 con 0x562ccf3b01b0 2024-09-17T05:22:42.102 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.095+0000 7f0c1988a740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x562ccf3c98c0 con 0x562ccf3e1e30 2024-09-17T05:22:42.102 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.095+0000 7f0c1988a740 10 client.0 _ll_register_callbacks cb 0x7f0c08009aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:22:42.102 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.095+0000 7f0c0f7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ccf3cfdf0 0x562ccf44fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:42.102 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.095+0000 7f0c0f7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ccf3cfdf0 0x562ccf44fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46852/0 (socket says 172.21.15.98:46852) 2024-09-17T05:22:42.102 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.095+0000 7f0c0f7fe640 1 -- 172.21.15.98:0/3796727676 learned_addr learned my addr 172.21.15.98:0/3796727676 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:42.102 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.095+0000 7f0c14f7f640 1 --2- 172.21.15.98:0/3796727676 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562ccf3e1e30 0x562ccf3e6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:42.102 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.095+0000 7f0c0ffff640 1 --2- 172.21.15.98:0/3796727676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562ccf3b01b0 0x562ccf3b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:42.102 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.095+0000 7f0c0f7fe640 1 -- 172.21.15.98:0/3796727676 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562ccf3e1e30 msgr2=0x562ccf3e6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:22:42.102 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.095+0000 7f0c0f7fe640 1 --2- 172.21.15.98:0/3796727676 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562ccf3e1e30 0x562ccf3e6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:42.102 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.095+0000 7f0c0f7fe640 1 -- 172.21.15.98:0/3796727676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562ccf3b01b0 msgr2=0x562ccf3b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:22:42.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.095+0000 7f0c0f7fe640 1 --2- 172.21.15.98:0/3796727676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562ccf3b01b0 0x562ccf3b2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:42.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.095+0000 7f0c0f7fe640 1 -- 172.21.15.98:0/3796727676 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ccf3e14f0 con 0x562ccf3cfdf0 2024-09-17T05:22:42.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.095+0000 7f0c0f7fe640 1 --2- 172.21.15.98:0/3796727676 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ccf3cfdf0 0x562ccf44fb30 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0c0400ef00 tx=0x7f0c040994f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d030431ce04ea36c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:42.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.095+0000 7f0beeffd640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-17T05:22:42.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.096+0000 7f0beeffd640 1 -- 172.21.15.98:0/3796727676 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c0401f040 con 0x562ccf3cfdf0 2024-09-17T05:22:42.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.096+0000 7f0beeffd640 1 -- 172.21.15.98:0/3796727676 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f0c0404e330 con 0x562ccf3cfdf0 2024-09-17T05:22:42.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.096+0000 7f0c1988a740 1 -- 172.21.15.98:0/3796727676 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c08004ab0 con 0x562ccf3cfdf0 2024-09-17T05:22:42.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.096+0000 7f0beeffd640 1 -- 172.21.15.98:0/3796727676 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f0c0407d180 con 0x562ccf3cfdf0 2024-09-17T05:22:42.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.096+0000 7f0c1988a740 10 client.5082 fetch_fsmap learned FSMap version 14 2024-09-17T05:22:42.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.096+0000 7f0c1988a740 1 -- 172.21.15.98:0/3796727676 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x562ccf3b2590 con 0x562ccf3cfdf0 2024-09-17T05:22:42.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.096+0000 7f0beeffd640 1 -- 172.21.15.98:0/3796727676 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0c08004ab0 con 0x562ccf3cfdf0 2024-09-17T05:22:42.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.096+0000 7f0beeffd640 1 -- 172.21.15.98:0/3796727676 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 14) ==== 3502+0+0 (secure 0 0 0) 0x7f0c040851a0 con 0x562ccf3cfdf0 2024-09-17T05:22:42.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.096+0000 7f0c1988a740 10 client.5082 fetch_fsmap finished waiting for FSMap version 14 2024-09-17T05:22:42.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.096+0000 7f0c1988a740 10 client.5082 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-17T05:22:42.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.096+0000 7f0c1988a740 20 client.5082 populate_metadata read hostname 'smithi098' 2024-09-17T05:22:42.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.096+0000 7f0c1988a740 1 --2- 172.21.15.98:0/3796727676 >> [v2:172.21.15.167:6835/3889162905,v1:172.21.15.167:6837/3889162905] conn(0x562ccf3e6ac0 0x562ccf4524f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:42.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.096+0000 7f0c1988a740 4 client.5082 mds_command: new command op to 4890 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T05:22:42.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.096+0000 7f0c1988a740 1 -- 172.21.15.98:0/3796727676 --> [v2:172.21.15.167:6835/3889162905,v1:172.21.15.167:6837/3889162905] -- command(tid 0: {"prefix": "status"}) -- 0x562ccf2fa220 con 0x562ccf3e6ac0 2024-09-17T05:22:42.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.096+0000 7f0c0ffff640 1 --2- 172.21.15.98:0/3796727676 >> [v2:172.21.15.167:6835/3889162905,v1:172.21.15.167:6837/3889162905] conn(0x562ccf3e6ac0 0x562ccf4524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:42.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.097+0000 7f0beeffd640 10 client.5082 ms_handle_connect on v2:172.21.15.167:6835/3889162905 2024-09-17T05:22:42.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.097+0000 7f0c0ffff640 1 --2- 172.21.15.98:0/3796727676 >> [v2:172.21.15.167:6835/3889162905,v1:172.21.15.167:6837/3889162905] conn(0x562ccf3e6ac0 0x562ccf4524f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ef89ff72dba4577 server_cookie=7a0ac7f94b74400d in_seq=0 out_seq=0 2024-09-17T05:22:42.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.097+0000 7f0beeffd640 1 -- 172.21.15.98:0/3796727676 <== mds.0 v2:172.21.15.167:6835/3889162905 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x562ccf2fa220 con 0x562ccf3e6ac0 2024-09-17T05:22:42.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.097+0000 7f0beeffd640 10 client.5082 handle_command_reply: tid=0 2024-09-17T05:22:42.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.097+0000 7f0c1988a740 1 client.5082 shutdown 2024-09-17T05:22:42.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.097+0000 7f0c1988a740 1 -- 172.21.15.98:0/3796727676 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ccf3cfdf0 msgr2=0x562ccf44fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:42.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.097+0000 7f0c1988a740 1 --2- 172.21.15.98:0/3796727676 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ccf3cfdf0 0x562ccf44fb30 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0c0400ef00 tx=0x7f0c040994f0 comp rx=0 tx=0).stop 2024-09-17T05:22:42.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.097+0000 7f0c1988a740 1 -- 172.21.15.98:0/3796727676 shutdown_connections 2024-09-17T05:22:42.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.097+0000 7f0c1988a740 1 --2- 172.21.15.98:0/3796727676 >> [v2:172.21.15.167:6835/3889162905,v1:172.21.15.167:6837/3889162905] conn(0x562ccf3e6ac0 0x562ccf4524f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:42.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.097+0000 7f0c1988a740 1 --2- 172.21.15.98:0/3796727676 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562ccf3e1e30 0x562ccf3e6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:42.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.097+0000 7f0c1988a740 1 --2- 172.21.15.98:0/3796727676 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ccf3cfdf0 0x562ccf44fb30 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:42.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.097+0000 7f0beeffd640 0 client.5082 ms_handle_reset on v2:172.21.15.167:6835/3889162905 2024-09-17T05:22:42.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.097+0000 7f0c1988a740 1 --2- 172.21.15.98:0/3796727676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562ccf3b01b0 0x562ccf3b2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:42.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.097+0000 7f0c1988a740 1 -- 172.21.15.98:0/3796727676 >> 172.21.15.98:0/3796727676 conn(0x562ccf3855f0 msgr2=0x562ccf3a7970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:42.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.097+0000 7f0c1988a740 1 -- 172.21.15.98:0/3796727676 shutdown_connections 2024-09-17T05:22:42.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.097+0000 7f0c1988a740 1 -- 172.21.15.98:0/3796727676 wait complete. 2024-09-17T05:22:42.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.097+0000 7f0c1988a740 20 client.5082 trim_cache size 0 max 16384 2024-09-17T05:22:42.106 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T05:22:42.106 INFO:teuthology.orchestra.run.smithi098.stdout: "cluster_fsid": "fcbf5a43-b3d8-497c-b15d-3cc022477cf0", 2024-09-17T05:22:42.106 INFO:teuthology.orchestra.run.smithi098.stdout: "whoami": 0, 2024-09-17T05:22:42.106 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 4890, 2024-09-17T05:22:42.106 INFO:teuthology.orchestra.run.smithi098.stdout: "want_state": "up:active", 2024-09-17T05:22:42.106 INFO:teuthology.orchestra.run.smithi098.stdout: "state": "up:active", 2024-09-17T05:22:42.106 INFO:teuthology.orchestra.run.smithi098.stdout: "fs_name": "cephfs", 2024-09-17T05:22:42.106 INFO:teuthology.orchestra.run.smithi098.stdout: "rank_uptime": 8.9875012180000002, 2024-09-17T05:22:42.106 INFO:teuthology.orchestra.run.smithi098.stdout: "mdsmap_epoch": 14, 2024-09-17T05:22:42.106 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_epoch": 32, 2024-09-17T05:22:42.106 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_epoch_barrier": 32, 2024-09-17T05:22:42.106 INFO:teuthology.orchestra.run.smithi098.stdout: "uptime": 15.992172273 2024-09-17T05:22:42.107 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T05:22:42.107 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.098+0000 7f0c169e2640 1 -- 172.21.15.98:0/1871876652 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f0bfc078b90 msgr2=0x7f0bfc07b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:42.108 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.098+0000 7f0c169e2640 1 --2- 172.21.15.98:0/1871876652 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f0bfc078b90 0x7f0bfc07b050 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0c00032000 tx=0x7f0c00001360 comp rx=0 tx=0).stop 2024-09-17T05:22:42.108 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.098+0000 7f0c169e2640 1 -- 172.21.15.98:0/1871876652 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c100c97f0 msgr2=0x7f0c101566e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:42.108 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.098+0000 7f0c169e2640 1 --2- 172.21.15.98:0/1871876652 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c100c97f0 0x7f0c101566e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0c0400e540 tx=0x7f0c0400ea00 comp rx=0 tx=0).stop 2024-09-17T05:22:42.108 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.098+0000 7f0c169e2640 1 -- 172.21.15.98:0/1871876652 shutdown_connections 2024-09-17T05:22:42.108 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.098+0000 7f0c169e2640 1 --2- 172.21.15.98:0/1871876652 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f0bfc078b90 0x7f0bfc07b050 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:42.108 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.098+0000 7f0c169e2640 1 --2- 172.21.15.98:0/1871876652 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c10160e80 0x7f0c101f5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:42.108 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.098+0000 7f0c169e2640 1 --2- 172.21.15.98:0/1871876652 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c100c97f0 0x7f0c101566e0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:42.108 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.098+0000 7f0c169e2640 1 --2- 172.21.15.98:0/1871876652 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0bf8003c60 0x7f0c100ca3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:42.108 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.098+0000 7f0c169e2640 1 -- 172.21.15.98:0/1871876652 >> 172.21.15.98:0/1871876652 conn(0x7f0c100d3fe0 msgr2=0x7f0c100b8040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:42.108 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.098+0000 7f0c169e2640 1 -- 172.21.15.98:0/1871876652 shutdown_connections 2024-09-17T05:22:42.108 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.098+0000 7f0c169e2640 1 -- 172.21.15.98:0/1871876652 wait complete. 2024-09-17T05:22:42.109 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:22:42.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.209+0000 7f47188b6640 1 -- 172.21.15.98:0/2437810114 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f47140cf300 msgr2=0x7f47140729a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:42.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.209+0000 7f47188b6640 1 --2- 172.21.15.98:0/2437810114 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f47140cf300 0x7f47140729a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4708009900 tx=0x7f470802a610 comp rx=0 tx=0).stop 2024-09-17T05:22:42.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.209+0000 7f47188b6640 1 -- 172.21.15.98:0/2437810114 shutdown_connections 2024-09-17T05:22:42.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.209+0000 7f47188b6640 1 --2- 172.21.15.98:0/2437810114 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f47140cf300 0x7f47140729a0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:42.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.209+0000 7f47188b6640 1 -- 172.21.15.98:0/2437810114 >> 172.21.15.98:0/2437810114 conn(0x7f47140b1950 msgr2=0x7f47140b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:42.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.209+0000 7f47188b6640 1 -- 172.21.15.98:0/2437810114 shutdown_connections 2024-09-17T05:22:42.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.209+0000 7f47188b6640 1 -- 172.21.15.98:0/2437810114 wait complete. 2024-09-17T05:22:42.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.210+0000 7f47188b6640 1 Processor -- start 2024-09-17T05:22:42.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.210+0000 7f47188b6640 1 -- start start 2024-09-17T05:22:42.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.211+0000 7f47188b6640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47140ccfd0 0x7f471415e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:42.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.211+0000 7f47188b6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47140cf300 0x7f47141e59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:42.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.211+0000 7f47188b6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f47141445d0 0x7f471409ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:42.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.211+0000 7f47188b6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f47140735f0 con 0x7f47141445d0 2024-09-17T05:22:42.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.211+0000 7f47188b6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f47140b4f60 con 0x7f47140cf300 2024-09-17T05:22:42.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.211+0000 7f47188b6640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f4714073770 con 0x7f47140ccfd0 2024-09-17T05:22:42.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.211+0000 7f4712d9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f47141445d0 0x7f471409ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:42.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.211+0000 7f4712d9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f47141445d0 0x7f471409ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46866/0 (socket says 172.21.15.98:46866) 2024-09-17T05:22:42.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.211+0000 7f4712d9d640 1 -- 172.21.15.98:0/2278063920 learned_addr learned my addr 172.21.15.98:0/2278063920 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:42.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.211+0000 7f4711d9b640 1 --2- 172.21.15.98:0/2278063920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47140cf300 0x7f47141e59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:42.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.211+0000 7f471259c640 1 --2- 172.21.15.98:0/2278063920 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47140ccfd0 0x7f471415e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:42.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.211+0000 7f4712d9d640 1 -- 172.21.15.98:0/2278063920 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47140ccfd0 msgr2=0x7f471415e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:42.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.211+0000 7f4712d9d640 1 --2- 172.21.15.98:0/2278063920 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47140ccfd0 0x7f471415e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:42.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.211+0000 7f4712d9d640 1 -- 172.21.15.98:0/2278063920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47140cf300 msgr2=0x7f47141e59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:42.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.211+0000 7f4712d9d640 1 --2- 172.21.15.98:0/2278063920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47140cf300 0x7f47141e59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:42.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.211+0000 7f4712d9d640 1 -- 172.21.15.98:0/2278063920 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f471409c5a0 con 0x7f47141445d0 2024-09-17T05:22:42.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.212+0000 7f4712d9d640 1 --2- 172.21.15.98:0/2278063920 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f47141445d0 0x7f471409ba50 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f470c00c780 tx=0x7f470c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:42.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.212+0000 7f4702ffd640 1 -- 172.21.15.98:0/2278063920 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470c004b60 con 0x7f47141445d0 2024-09-17T05:22:42.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.212+0000 7f4702ffd640 1 -- 172.21.15.98:0/2278063920 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f470c004df0 con 0x7f47141445d0 2024-09-17T05:22:42.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.212+0000 7f4702ffd640 1 -- 172.21.15.98:0/2278063920 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470c00aa70 con 0x7f47141445d0 2024-09-17T05:22:42.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.212+0000 7f47188b6640 1 -- 172.21.15.98:0/2278063920 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f471409c880 con 0x7f47141445d0 2024-09-17T05:22:42.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.212+0000 7f47188b6640 1 -- 172.21.15.98:0/2278063920 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f471413cbf0 con 0x7f47141445d0 2024-09-17T05:22:42.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.213+0000 7f47188b6640 1 -- 172.21.15.98:0/2278063920 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4714073c20 con 0x7f47141445d0 2024-09-17T05:22:42.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.213+0000 7f4702ffd640 1 -- 172.21.15.98:0/2278063920 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f470c00ac10 con 0x7f47141445d0 2024-09-17T05:22:42.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.214+0000 7f4702ffd640 1 --2- 172.21.15.98:0/2278063920 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f46f4078bc0 0x7f46f407b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:42.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.214+0000 7f4702ffd640 1 -- 172.21.15.98:0/2278063920 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f470c09aff0 con 0x7f47141445d0 2024-09-17T05:22:42.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.214+0000 7f471259c640 1 --2- 172.21.15.98:0/2278063920 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f46f4078bc0 0x7f46f407b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:42.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.215+0000 7f471259c640 1 --2- 172.21.15.98:0/2278063920 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f46f4078bc0 0x7f46f407b080 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4704000f60 tx=0x7f4704009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:42.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.218+0000 7f4702ffd640 1 -- 172.21.15.98:0/2278063920 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f470c020070 con 0x7f47141445d0 2024-09-17T05:22:42.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.434+0000 7f47188b6640 1 -- 172.21.15.98:0/2278063920 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f4714070a20 con 0x7f47141445d0 2024-09-17T05:22:42.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.435+0000 7f4702ffd640 1 -- 172.21.15.98:0/2278063920 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) ==== 53+0+73 (secure 0 0 0) 0x7f470c0634c0 con 0x7f47141445d0 2024-09-17T05:22:42.436 INFO:teuthology.orchestra.run.smithi098.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:22:42.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.437+0000 7f47188b6640 1 -- 172.21.15.98:0/2278063920 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f46f4078bc0 msgr2=0x7f46f407b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:42.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.437+0000 7f47188b6640 1 --2- 172.21.15.98:0/2278063920 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f46f4078bc0 0x7f46f407b080 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4704000f60 tx=0x7f4704009040 comp rx=0 tx=0).stop 2024-09-17T05:22:42.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.437+0000 7f47188b6640 1 -- 172.21.15.98:0/2278063920 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f47141445d0 msgr2=0x7f471409ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:42.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.437+0000 7f47188b6640 1 --2- 172.21.15.98:0/2278063920 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f47141445d0 0x7f471409ba50 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f470c00c780 tx=0x7f470c00cc40 comp rx=0 tx=0).stop 2024-09-17T05:22:42.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.437+0000 7f47188b6640 1 -- 172.21.15.98:0/2278063920 shutdown_connections 2024-09-17T05:22:42.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.437+0000 7f47188b6640 1 --2- 172.21.15.98:0/2278063920 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f46f4078bc0 0x7f46f407b080 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:42.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.437+0000 7f47188b6640 1 --2- 172.21.15.98:0/2278063920 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f47141445d0 0x7f471409ba50 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:42.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.437+0000 7f47188b6640 1 --2- 172.21.15.98:0/2278063920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47140cf300 0x7f47141e59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:42.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.437+0000 7f47188b6640 1 --2- 172.21.15.98:0/2278063920 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47140ccfd0 0x7f471415e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:42.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.437+0000 7f47188b6640 1 -- 172.21.15.98:0/2278063920 >> 172.21.15.98:0/2278063920 conn(0x7f47140b1950 msgr2=0x7f47140cdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:42.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.437+0000 7f47188b6640 1 -- 172.21.15.98:0/2278063920 shutdown_connections 2024-09-17T05:22:42.439 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42.437+0000 7f47188b6640 1 -- 172.21.15.98:0/2278063920 wait complete. 2024-09-17T05:22:42.448 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T05:22:42.448 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:22:42.449 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi098.front.sepia.ceph.com 2024-09-17T05:22:42.449 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T05:22:42.449 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T05:22:42.449 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T05:22:42.450 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T05:22:42.450 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:22:42.450 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:22:42.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:42.450 DEBUG:teuthology.orchestra.run.smithi098:> ip addr 2024-09-17T05:22:42.467 INFO:teuthology.orchestra.run.smithi098.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:22:42.467 INFO:teuthology.orchestra.run.smithi098.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:22:42.468 INFO:teuthology.orchestra.run.smithi098.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:22:42.468 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:42.468 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 ::1/128 scope host 2024-09-17T05:22:42.468 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:42.468 INFO:teuthology.orchestra.run.smithi098.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:22:42.468 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:d8:d9:b8 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:22:42.468 INFO:teuthology.orchestra.run.smithi098.stdout: altname enp7s0f0 2024-09-17T05:22:42.468 INFO:teuthology.orchestra.run.smithi098.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:22:42.468 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:d8:d9:b9 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:22:42.468 INFO:teuthology.orchestra.run.smithi098.stdout: altname enp7s0f1 2024-09-17T05:22:42.468 INFO:teuthology.orchestra.run.smithi098.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:22:42.468 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:8f:d2:6a brd ff:ff:ff:ff:ff:ff 2024-09-17T05:22:42.469 INFO:teuthology.orchestra.run.smithi098.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:22:42.469 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:8f:d2:6b brd ff:ff:ff:ff:ff:ff 2024-09-17T05:22:42.469 INFO:teuthology.orchestra.run.smithi098.stdout: inet 172.21.15.98/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T05:22:42.469 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft 42740sec preferred_lft 42740sec 2024-09-17T05:22:42.469 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::ec4:7aff:fe8f:d26b/64 scope link noprefixroute 2024-09-17T05:22:42.469 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:42.469 INFO:teuthology.orchestra.run.smithi098.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:22:42.469 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 36:ed:5b:fe:d8:4c brd ff:ff:ff:ff:ff:ff 2024-09-17T05:22:42.469 INFO:teuthology.orchestra.run.smithi098.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:22:42.469 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:42.469 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::bcd4:a6ff:feee:18c/64 scope link 2024-09-17T05:22:42.469 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:42.469 INFO:teuthology.orchestra.run.smithi098.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:22:42.470 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 66:7a:21:b8:75:17 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:22:42.470 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::647a:21ff:feb8:7517/64 scope link 2024-09-17T05:22:42.470 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:42.470 INFO:teuthology.orchestra.run.smithi098.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:22:42.470 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 36:ed:5b:fe:d8:4c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:22:42.470 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::34ed:5bff:fefe:d84c/64 scope link 2024-09-17T05:22:42.470 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:42.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:42.470 DEBUG:teuthology.orchestra.run.smithi098:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:22:42.531 INFO:teuthology.orchestra.run.smithi098.stdout:1 2024-09-17T05:22:42.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:42.533 DEBUG:teuthology.orchestra.run.smithi098:> route 2024-09-17T05:22:42.589 INFO:teuthology.orchestra.run.smithi098.stdout:Kernel IP routing table 2024-09-17T05:22:42.589 INFO:teuthology.orchestra.run.smithi098.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:22:42.589 INFO:teuthology.orchestra.run.smithi098.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T05:22:42.589 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T05:22:42.589 INFO:teuthology.orchestra.run.smithi098.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:22:42.590 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:22:42.590 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2024-09-17T05:22:42.590 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T05:22:42.590 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T05:22:42.590 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T05:22:42.590 DEBUG:teuthology.orchestra.run.smithi098:> ') 2024-09-17T05:22:42.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:22:42.708 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:22:42.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:42.714 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list 2024-09-17T05:22:42.729 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T05:22:42.730 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T05:22:42.730 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:22:42.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:42.730 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link set brx.0 up 2024-09-17T05:22:42.794 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:22:42.795 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T05:22:42.850 INFO:teuthology.orchestra.run.smithi098.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:22:42.850 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:22:42.850 DEBUG:teuthology.orchestra.run.smithi098:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:22:42.906 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-17T05:22:42.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:42.906 DEBUG:teuthology.orchestra.run.smithi098:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:22:42.990 INFO:teuthology.orchestra.run.smithi098.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:22:42.990 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:22:42.998 INFO:teuthology.orchestra.run.smithi098.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:22:42.998 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:22:42.998 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: resolved to: "172.21.15.98:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-09-17T05:22:42.998 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: trying mount with new device syntax: 0@fcbf5a43-b3d8-497c-b15d-3cc022477cf0.cephfs=/ 2024-09-17T05:22:42.998 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.98:3300/172.21.15.167:3300/172.21.15.167:3301" will pass to kernel 2024-09-17T05:22:42.998 INFO:teuthology.orchestra.run.smithi098.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T05:22:42.999 INFO:teuthology.orchestra.run.smithi098.stdout: You just mounted a file system that supports labels which does not 2024-09-17T05:22:42.999 INFO:teuthology.orchestra.run.smithi098.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T05:22:42.999 INFO:teuthology.orchestra.run.smithi098.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T05:22:42.999 INFO:teuthology.orchestra.run.smithi098.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T05:22:43.000 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:22:43.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:43.000 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:22:43.066 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:22:43.156 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:22:43.163 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:22:43.168 INFO:teuthology.orchestra.run.smithi098.stdout:client5094 2024-09-17T05:22:43.169 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T05:22:43.169 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:22:43.185 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:22:43.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:43.326+0000 7f063b2c6640 1 -- 172.21.15.98:0/1091244817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f063413efa0 msgr2=0x7f06340cd1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:43.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:43.326+0000 7f063b2c6640 1 --2- 172.21.15.98:0/1091244817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f063413efa0 0x7f06340cd1d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0630009830 tx=0x7f063002a510 comp rx=0 tx=0).stop 2024-09-17T05:22:43.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:43.326+0000 7f063b2c6640 1 -- 172.21.15.98:0/1091244817 shutdown_connections 2024-09-17T05:22:43.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:43.326+0000 7f063b2c6640 1 --2- 172.21.15.98:0/1091244817 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f063406cb70 0x7f063406d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:43.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:43.326+0000 7f063b2c6640 1 --2- 172.21.15.98:0/1091244817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f063413efa0 0x7f06340cd1d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:43.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:43.326+0000 7f063b2c6640 1 -- 172.21.15.98:0/1091244817 >> 172.21.15.98:0/1091244817 conn(0x7f06340b2230 msgr2=0x7f06340b2610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:43.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:43.326+0000 7f063b2c6640 1 -- 172.21.15.98:0/1091244817 shutdown_connections 2024-09-17T05:22:43.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:43.326+0000 7f063b2c6640 1 -- 172.21.15.98:0/1091244817 wait complete. 2024-09-17T05:22:43.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:43.327+0000 7f063b2c6640 1 Processor -- start 2024-09-17T05:22:43.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:43.327+0000 7f063b2c6640 1 -- start start 2024-09-17T05:22:43.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:43.328+0000 7f063b2c6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f063406cb70 0x7f06341294d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:43.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:43.328+0000 7f063b2c6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06340730c0 0x7f06341f1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:43.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:43.328+0000 7f063b2c6640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f063413efa0 0x7f063412e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:43.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:43.328+0000 7f063b2c6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f06340cd890 con 0x7f063406cb70 2024-09-17T05:22:43.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:43.328+0000 7f063b2c6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f06340cd710 con 0x7f06340730c0 2024-09-17T05:22:43.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:43.328+0000 7f063b2c6640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f0634073c20 con 0x7f063413efa0 2024-09-17T05:22:43.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:43.328+0000 7f0639062640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f063406cb70 0x7f06341294d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:43.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:43.328+0000 7f0639062640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f063406cb70 0x7f06341294d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46878/0 (socket says 172.21.15.98:46878) 2024-09-17T05:22:43.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:43.328+0000 7f0639062640 1 -- 172.21.15.98:0/448534699 learned_addr learned my addr 172.21.15.98:0/448534699 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:43.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:43.328+0000 7f0638861640 1 --2- 172.21.15.98:0/448534699 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06340730c0 0x7f06341f1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:43.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:43.328+0000 7f0639863640 1 --2- 172.21.15.98:0/448534699 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f063413efa0 0x7f063412e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:43.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:43.328+0000 7f0639062640 1 -- 172.21.15.98:0/448534699 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f063413efa0 msgr2=0x7f063412e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:43.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:43.328+0000 7f0639062640 1 --2- 172.21.15.98:0/448534699 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f063413efa0 0x7f063412e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:43.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:43.328+0000 7f0639062640 1 -- 172.21.15.98:0/448534699 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06340730c0 msgr2=0x7f06341f1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:43.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:43.328+0000 7f0639062640 1 --2- 172.21.15.98:0/448534699 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06340730c0 0x7f06341f1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:43.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:43.328+0000 7f0639062640 1 -- 172.21.15.98:0/448534699 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f063412c600 con 0x7f063406cb70 2024-09-17T05:22:43.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:43.328+0000 7f0638861640 1 --2- 172.21.15.98:0/448534699 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06340730c0 0x7f06341f1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:22:43.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:43.328+0000 7f0639062640 1 --2- 172.21.15.98:0/448534699 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f063406cb70 0x7f06341294d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0630009950 tx=0x7f0630033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:43.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:43.329+0000 7f0629ffb640 1 -- 172.21.15.98:0/448534699 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0630031d60 con 0x7f063406cb70 2024-09-17T05:22:43.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:43.329+0000 7f0629ffb640 1 -- 172.21.15.98:0/448534699 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0630033e10 con 0x7f063406cb70 2024-09-17T05:22:43.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:43.329+0000 7f063b2c6640 1 -- 172.21.15.98:0/448534699 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f063412c8e0 con 0x7f063406cb70 2024-09-17T05:22:43.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:43.329+0000 7f0629ffb640 1 -- 172.21.15.98:0/448534699 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0630005260 con 0x7f063406cb70 2024-09-17T05:22:43.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:43.329+0000 7f063b2c6640 1 -- 172.21.15.98:0/448534699 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f063412cea0 con 0x7f063406cb70 2024-09-17T05:22:43.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:43.330+0000 7f063b2c6640 1 -- 172.21.15.98:0/448534699 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f063406d000 con 0x7f063406cb70 2024-09-17T05:22:43.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:43.330+0000 7f0629ffb640 1 -- 172.21.15.98:0/448534699 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0630005400 con 0x7f063406cb70 2024-09-17T05:22:43.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:43.331+0000 7f0629ffb640 1 --2- 172.21.15.98:0/448534699 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f0618078b90 0x7f061807b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:43.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:43.331+0000 7f0629ffb640 1 -- 172.21.15.98:0/448534699 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f06300bbd50 con 0x7f063406cb70 2024-09-17T05:22:43.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:43.331+0000 7f0638861640 1 --2- 172.21.15.98:0/448534699 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f0618078b90 0x7f061807b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:43.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:43.332+0000 7f0638861640 1 --2- 172.21.15.98:0/448534699 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f0618078b90 0x7f061807b050 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0624009c30 tx=0x7f0624005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:43.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:43.335+0000 7f0629ffb640 1 -- 172.21.15.98:0/448534699 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f06300bf030 con 0x7f063406cb70 2024-09-17T05:22:43.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:43.548+0000 7f063b2c6640 1 -- 172.21.15.98:0/448534699 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f0634156600 con 0x7f063406cb70 2024-09-17T05:22:43.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:43.548+0000 7f0629ffb640 1 -- 172.21.15.98:0/448534699 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) ==== 53+0+73 (secure 0 0 0) 0x7f063003f030 con 0x7f063406cb70 2024-09-17T05:22:43.549 INFO:teuthology.orchestra.run.smithi098.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:22:43.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:43.551+0000 7f063b2c6640 1 -- 172.21.15.98:0/448534699 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f0618078b90 msgr2=0x7f061807b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:43.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:43.551+0000 7f063b2c6640 1 --2- 172.21.15.98:0/448534699 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f0618078b90 0x7f061807b050 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0624009c30 tx=0x7f0624005f90 comp rx=0 tx=0).stop 2024-09-17T05:22:43.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:43.551+0000 7f063b2c6640 1 -- 172.21.15.98:0/448534699 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f063406cb70 msgr2=0x7f06341294d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:43.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:43.551+0000 7f063b2c6640 1 --2- 172.21.15.98:0/448534699 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f063406cb70 0x7f06341294d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0630009950 tx=0x7f0630033c20 comp rx=0 tx=0).stop 2024-09-17T05:22:43.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:43.551+0000 7f063b2c6640 1 -- 172.21.15.98:0/448534699 shutdown_connections 2024-09-17T05:22:43.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:43.551+0000 7f063b2c6640 1 --2- 172.21.15.98:0/448534699 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f0618078b90 0x7f061807b050 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:43.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:43.551+0000 7f063b2c6640 1 --2- 172.21.15.98:0/448534699 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f063413efa0 0x7f063412e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:43.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:43.551+0000 7f063b2c6640 1 --2- 172.21.15.98:0/448534699 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06340730c0 0x7f06341f1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:43.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:43.551+0000 7f063b2c6640 1 --2- 172.21.15.98:0/448534699 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f063406cb70 0x7f06341294d0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:43.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:43.551+0000 7f063b2c6640 1 -- 172.21.15.98:0/448534699 >> 172.21.15.98:0/448534699 conn(0x7f06340b2230 msgr2=0x7f063415eeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:43.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:43.551+0000 7f063b2c6640 1 -- 172.21.15.98:0/448534699 shutdown_connections 2024-09-17T05:22:43.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:43.551+0000 7f063b2c6640 1 -- 172.21.15.98:0/448534699 wait complete. 2024-09-17T05:22:43.562 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T05:22:43.562 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:22:43.562 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi167.front.sepia.ceph.com 2024-09-17T05:22:43.562 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T05:22:43.562 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T05:22:43.562 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T05:22:43.562 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T05:22:43.563 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:22:43.563 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:22:43.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:43.563 DEBUG:teuthology.orchestra.run.smithi167:> ip addr 2024-09-17T05:22:43.583 INFO:teuthology.orchestra.run.smithi167.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:22:43.583 INFO:teuthology.orchestra.run.smithi167.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:22:43.583 INFO:teuthology.orchestra.run.smithi167.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:22:43.583 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:43.583 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 ::1/128 scope host 2024-09-17T05:22:43.583 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:43.583 INFO:teuthology.orchestra.run.smithi167.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:22:43.583 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:d9:35:e6 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:22:43.583 INFO:teuthology.orchestra.run.smithi167.stdout: altname enp7s0f0 2024-09-17T05:22:43.584 INFO:teuthology.orchestra.run.smithi167.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:22:43.584 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:d9:35:e7 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:22:43.584 INFO:teuthology.orchestra.run.smithi167.stdout: altname enp7s0f1 2024-09-17T05:22:43.584 INFO:teuthology.orchestra.run.smithi167.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:22:43.584 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:88:73:08 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:22:43.584 INFO:teuthology.orchestra.run.smithi167.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:22:43.584 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:88:73:09 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:22:43.584 INFO:teuthology.orchestra.run.smithi167.stdout: inet 172.21.15.167/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T05:22:43.584 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft 42755sec preferred_lft 42755sec 2024-09-17T05:22:43.584 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 fe80::ec4:7aff:fe88:7309/64 scope link noprefixroute 2024-09-17T05:22:43.584 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:43.584 INFO:teuthology.orchestra.run.smithi167.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:22:43.585 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 5e:f8:d8:29:f9:42 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:22:43.585 INFO:teuthology.orchestra.run.smithi167.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:22:43.585 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:43.585 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 fe80::50d3:3bff:fea3:1a75/64 scope link 2024-09-17T05:22:43.585 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:43.585 INFO:teuthology.orchestra.run.smithi167.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:22:43.585 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether fa:5a:2f:53:c0:39 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:22:43.585 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 fe80::f85a:2fff:fe53:c039/64 scope link 2024-09-17T05:22:43.585 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:43.585 INFO:teuthology.orchestra.run.smithi167.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:22:43.585 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 5e:f8:d8:29:f9:42 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:22:43.585 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 fe80::5cf8:d8ff:fe29:f942/64 scope link 2024-09-17T05:22:43.586 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:43.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:43.586 DEBUG:teuthology.orchestra.run.smithi167:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:22:43.652 INFO:teuthology.orchestra.run.smithi167.stdout:1 2024-09-17T05:22:43.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:43.653 DEBUG:teuthology.orchestra.run.smithi167:> route 2024-09-17T05:22:43.712 INFO:teuthology.orchestra.run.smithi167.stdout:Kernel IP routing table 2024-09-17T05:22:43.713 INFO:teuthology.orchestra.run.smithi167.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:22:43.713 INFO:teuthology.orchestra.run.smithi167.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T05:22:43.713 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T05:22:43.713 INFO:teuthology.orchestra.run.smithi167.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:22:43.713 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:22:43.713 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2024-09-17T05:22:43.713 DEBUG:teuthology.orchestra.run.smithi167:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T05:22:43.713 DEBUG:teuthology.orchestra.run.smithi167:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T05:22:43.713 DEBUG:teuthology.orchestra.run.smithi167:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T05:22:43.713 DEBUG:teuthology.orchestra.run.smithi167:> ') 2024-09-17T05:22:43.806 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:22:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:22:43.840 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:22:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:22:43.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:43.847 DEBUG:teuthology.orchestra.run.smithi167:> ip netns list 2024-09-17T05:22:43.863 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-17T05:22:43.863 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T05:22:43.863 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:22:43.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:43.863 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link set brx.0 up 2024-09-17T05:22:43.929 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:22:43.929 DEBUG:teuthology.orchestra.run.smithi167:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T05:22:43.985 INFO:teuthology.orchestra.run.smithi167.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:22:43.985 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:22:43.985 DEBUG:teuthology.orchestra.run.smithi167:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T05:22:44.040 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-17T05:22:44.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:44.040 DEBUG:teuthology.orchestra.run.smithi167:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:22:44.123 INFO:teuthology.orchestra.run.smithi167.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:22:44.124 INFO:teuthology.orchestra.run.smithi167.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:22:44.131 INFO:teuthology.orchestra.run.smithi167.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:22:44.131 INFO:teuthology.orchestra.run.smithi167.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:22:44.131 INFO:teuthology.orchestra.run.smithi167.stdout:mount.ceph: resolved to: "172.21.15.98:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-09-17T05:22:44.131 INFO:teuthology.orchestra.run.smithi167.stdout:mount.ceph: trying mount with new device syntax: 1@fcbf5a43-b3d8-497c-b15d-3cc022477cf0.cephfs=/ 2024-09-17T05:22:44.131 INFO:teuthology.orchestra.run.smithi167.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.98:3300/172.21.15.167:3300/172.21.15.167:3301" will pass to kernel 2024-09-17T05:22:44.133 INFO:teuthology.orchestra.run.smithi167.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-17T05:22:44.133 INFO:teuthology.orchestra.run.smithi167.stdout: You just mounted a file system that supports labels which does not 2024-09-17T05:22:44.134 INFO:teuthology.orchestra.run.smithi167.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T05:22:44.134 INFO:teuthology.orchestra.run.smithi167.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T05:22:44.134 INFO:teuthology.orchestra.run.smithi167.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T05:22:44.134 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:22:44.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:44.134 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T05:22:44.206 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:22:44.296 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:22:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:22:44.297 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T05:22:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:22:44.303 INFO:teuthology.orchestra.run.smithi167.stdout:client5100 2024-09-17T05:22:44.303 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-17T05:22:44.304 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:22:44.320 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-17T05:22:44.426 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:44.425+0000 7fe518175640 1 -- 172.21.15.98:0/2044862725 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5101512b0 msgr2=0x7fe5100cefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:44.426 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:44.425+0000 7fe518175640 1 --2- 172.21.15.98:0/2044862725 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5101512b0 0x7fe5100cefb0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe510151690 tx=0x7fe50c02a5f0 comp rx=0 tx=0).stop 2024-09-17T05:22:44.426 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:44.425+0000 7fe518175640 1 -- 172.21.15.98:0/2044862725 shutdown_connections 2024-09-17T05:22:44.426 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:44.425+0000 7fe518175640 1 --2- 172.21.15.98:0/2044862725 >> v2:172.21.15.167:3300/0 conn(0x7fe5100b3e20 0x7fe5100cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:44.426 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:44.425+0000 7fe518175640 1 --2- 172.21.15.98:0/2044862725 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5101512b0 0x7fe5100cefb0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:44.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:44.425+0000 7fe518175640 1 -- 172.21.15.98:0/2044862725 >> 172.21.15.98:0/2044862725 conn(0x7fe5100b18e0 msgr2=0x7fe5100b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:44.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:44.425+0000 7fe518175640 1 -- 172.21.15.98:0/2044862725 shutdown_connections 2024-09-17T05:22:44.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:44.425+0000 7fe518175640 1 -- 172.21.15.98:0/2044862725 wait complete. 2024-09-17T05:22:44.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:44.426+0000 7fe518175640 1 Processor -- start 2024-09-17T05:22:44.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:44.426+0000 7fe518175640 1 -- start start 2024-09-17T05:22:44.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:44.427+0000 7fe518175640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe51006fa00 0x7fe51014e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:44.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:44.427+0000 7fe518175640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe5100b3e20 0x7fe5100adfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:44.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:44.427+0000 7fe518175640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5101512b0 0x7fe5100ae520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:44.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:44.427+0000 7fe518175640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe5100cc6d0 con 0x7fe5101512b0 2024-09-17T05:22:44.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:44.427+0000 7fe518175640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe5100cc550 con 0x7fe51006fa00 2024-09-17T05:22:44.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:44.427+0000 7fe518175640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fe5100cc850 con 0x7fe5100b3e20 2024-09-17T05:22:44.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:44.427+0000 7fe516712640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5101512b0 0x7fe5100ae520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:44.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:44.427+0000 7fe516712640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5101512b0 0x7fe5100ae520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46894/0 (socket says 172.21.15.98:46894) 2024-09-17T05:22:44.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:44.427+0000 7fe516712640 1 -- 172.21.15.98:0/1410956852 learned_addr learned my addr 172.21.15.98:0/1410956852 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:44.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:44.427+0000 7fe515f11640 1 --2- 172.21.15.98:0/1410956852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe51006fa00 0x7fe51014e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:44.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:44.427+0000 7fe515710640 1 --2- 172.21.15.98:0/1410956852 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe5100b3e20 0x7fe5100adfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:44.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:44.427+0000 7fe516712640 1 -- 172.21.15.98:0/1410956852 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe5100b3e20 msgr2=0x7fe5100adfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:44.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:44.427+0000 7fe516712640 1 --2- 172.21.15.98:0/1410956852 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe5100b3e20 0x7fe5100adfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:44.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:44.427+0000 7fe516712640 1 -- 172.21.15.98:0/1410956852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe51006fa00 msgr2=0x7fe51014e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:44.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:44.427+0000 7fe516712640 1 --2- 172.21.15.98:0/1410956852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe51006fa00 0x7fe51014e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:44.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:44.427+0000 7fe516712640 1 -- 172.21.15.98:0/1410956852 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe51014ec80 con 0x7fe5101512b0 2024-09-17T05:22:44.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:44.427+0000 7fe516712640 1 --2- 172.21.15.98:0/1410956852 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5101512b0 0x7fe5100ae520 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe50800c7a0 tx=0x7fe50800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:44.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:44.428+0000 7fe5067fc640 1 -- 172.21.15.98:0/1410956852 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe508017070 con 0x7fe5101512b0 2024-09-17T05:22:44.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:44.428+0000 7fe5067fc640 1 -- 172.21.15.98:0/1410956852 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe508005070 con 0x7fe5101512b0 2024-09-17T05:22:44.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:44.428+0000 7fe5067fc640 1 -- 172.21.15.98:0/1410956852 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5080054c0 con 0x7fe5101512b0 2024-09-17T05:22:44.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:44.428+0000 7fe518175640 1 -- 172.21.15.98:0/1410956852 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe51009b980 con 0x7fe5101512b0 2024-09-17T05:22:44.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:44.428+0000 7fe518175640 1 -- 172.21.15.98:0/1410956852 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe51009bf40 con 0x7fe5101512b0 2024-09-17T05:22:44.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:44.429+0000 7fe518175640 1 -- 172.21.15.98:0/1410956852 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe510069360 con 0x7fe5101512b0 2024-09-17T05:22:44.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:44.429+0000 7fe5067fc640 1 -- 172.21.15.98:0/1410956852 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe50801a070 con 0x7fe5101512b0 2024-09-17T05:22:44.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:44.430+0000 7fe5067fc640 1 --2- 172.21.15.98:0/1410956852 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fe4f4078b90 0x7fe4f407b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:44.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:44.430+0000 7fe5067fc640 1 -- 172.21.15.98:0/1410956852 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fe50809a240 con 0x7fe5101512b0 2024-09-17T05:22:44.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:44.430+0000 7fe515f11640 1 --2- 172.21.15.98:0/1410956852 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fe4f4078b90 0x7fe4f407b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:44.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:44.431+0000 7fe515f11640 1 --2- 172.21.15.98:0/1410956852 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fe4f4078b90 0x7fe4f407b050 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe50c033000 tx=0x7fe50c004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:44.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:44.434+0000 7fe5067fc640 1 -- 172.21.15.98:0/1410956852 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fe51014ec80 con 0x7fe5101512b0 2024-09-17T05:22:44.647 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:44.646+0000 7fe518175640 1 -- 172.21.15.98:0/1410956852 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7fe5100cd490 con 0x7fe5101512b0 2024-09-17T05:22:45.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.325+0000 7fe5067fc640 1 -- 172.21.15.98:0/1410956852 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v15) ==== 136+0+0 (secure 0 0 0) 0x7fe508062150 con 0x7fe5101512b0 2024-09-17T05:22:45.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.328+0000 7fe518175640 1 -- 172.21.15.98:0/1410956852 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fe4f4078b90 msgr2=0x7fe4f407b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:45.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.328+0000 7fe518175640 1 --2- 172.21.15.98:0/1410956852 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fe4f4078b90 0x7fe4f407b050 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe50c033000 tx=0x7fe50c004730 comp rx=0 tx=0).stop 2024-09-17T05:22:45.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.328+0000 7fe518175640 1 -- 172.21.15.98:0/1410956852 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5101512b0 msgr2=0x7fe5100ae520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:45.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.328+0000 7fe518175640 1 --2- 172.21.15.98:0/1410956852 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5101512b0 0x7fe5100ae520 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe50800c7a0 tx=0x7fe50800cc60 comp rx=0 tx=0).stop 2024-09-17T05:22:45.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.328+0000 7fe518175640 1 -- 172.21.15.98:0/1410956852 shutdown_connections 2024-09-17T05:22:45.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.328+0000 7fe518175640 1 --2- 172.21.15.98:0/1410956852 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fe4f4078b90 0x7fe4f407b050 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:45.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.328+0000 7fe518175640 1 --2- 172.21.15.98:0/1410956852 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5101512b0 0x7fe5100ae520 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:45.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.328+0000 7fe518175640 1 --2- 172.21.15.98:0/1410956852 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe5100b3e20 0x7fe5100adfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:45.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.328+0000 7fe518175640 1 --2- 172.21.15.98:0/1410956852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe51006fa00 0x7fe51014e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:45.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.328+0000 7fe518175640 1 -- 172.21.15.98:0/1410956852 >> 172.21.15.98:0/1410956852 conn(0x7fe5100b18e0 msgr2=0x7fe51006e540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:45.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.328+0000 7fe518175640 1 -- 172.21.15.98:0/1410956852 shutdown_connections 2024-09-17T05:22:45.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.328+0000 7fe518175640 1 -- 172.21.15.98:0/1410956852 wait complete. 2024-09-17T05:22:45.341 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-17T05:22:45.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.444+0000 7f8f97e47640 1 -- 172.21.15.98:0/3474943729 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f90073fb0 msgr2=0x7f8f90074420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:45.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.444+0000 7f8f97e47640 1 --2- 172.21.15.98:0/3474943729 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f90073fb0 0x7f8f90074420 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8f900cfbb0 tx=0x7f8f8802a560 comp rx=0 tx=0).stop 2024-09-17T05:22:45.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.444+0000 7f8f97e47640 1 -- 172.21.15.98:0/3474943729 shutdown_connections 2024-09-17T05:22:45.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.444+0000 7f8f97e47640 1 --2- 172.21.15.98:0/3474943729 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f90073fb0 0x7f8f90074420 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:45.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.444+0000 7f8f97e47640 1 --2- 172.21.15.98:0/3474943729 >> v2:172.21.15.167:3300/0 conn(0x7f8f900ccf00 0x7f8f900b2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:45.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.444+0000 7f8f97e47640 1 -- 172.21.15.98:0/3474943729 >> 172.21.15.98:0/3474943729 conn(0x7f8f900b1950 msgr2=0x7f8f900b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:45.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.444+0000 7f8f97e47640 1 -- 172.21.15.98:0/3474943729 shutdown_connections 2024-09-17T05:22:45.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.444+0000 7f8f97e47640 1 -- 172.21.15.98:0/3474943729 wait complete. 2024-09-17T05:22:45.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.445+0000 7f8f97e47640 1 Processor -- start 2024-09-17T05:22:45.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.446+0000 7f8f97e47640 1 -- start start 2024-09-17T05:22:45.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.446+0000 7f8f97e47640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8f90073fb0 0x7f8f9015a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:45.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.446+0000 7f8f97e47640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f900ccf00 0x7f8f9015bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:45.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.446+0000 7f8f97e47640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f9015f5a0 0x7f8f901537c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:45.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.446+0000 7f8f97e47640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8f9006f2e0 con 0x7f8f900ccf00 2024-09-17T05:22:45.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.446+0000 7f8f97e47640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8f9006f160 con 0x7f8f9015f5a0 2024-09-17T05:22:45.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.446+0000 7f8f97e47640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f8f9006f460 con 0x7f8f90073fb0 2024-09-17T05:22:45.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.446+0000 7f8f953e2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f900ccf00 0x7f8f9015bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:45.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.446+0000 7f8f953e2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f900ccf00 0x7f8f9015bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46900/0 (socket says 172.21.15.98:46900) 2024-09-17T05:22:45.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.446+0000 7f8f953e2640 1 -- 172.21.15.98:0/3541193416 learned_addr learned my addr 172.21.15.98:0/3541193416 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:45.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.446+0000 7f8f963e4640 1 --2- 172.21.15.98:0/3541193416 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f9015f5a0 0x7f8f901537c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:45.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.446+0000 7f8f95be3640 1 --2- 172.21.15.98:0/3541193416 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8f90073fb0 0x7f8f9015a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:45.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.447+0000 7f8f953e2640 1 -- 172.21.15.98:0/3541193416 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8f90073fb0 msgr2=0x7f8f9015a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:45.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.447+0000 7f8f953e2640 1 --2- 172.21.15.98:0/3541193416 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8f90073fb0 0x7f8f9015a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:45.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.447+0000 7f8f953e2640 1 -- 172.21.15.98:0/3541193416 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f9015f5a0 msgr2=0x7f8f901537c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:45.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.447+0000 7f8f953e2640 1 --2- 172.21.15.98:0/3541193416 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f9015f5a0 0x7f8f901537c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:45.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.447+0000 7f8f953e2640 1 -- 172.21.15.98:0/3541193416 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f901597b0 con 0x7f8f900ccf00 2024-09-17T05:22:45.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.447+0000 7f8f953e2640 1 --2- 172.21.15.98:0/3541193416 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f900ccf00 0x7f8f9015bf80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f8f8400d770 tx=0x7f8f8400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:45.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.447+0000 7f8f8e7fc640 1 -- 172.21.15.98:0/3541193416 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f84017070 con 0x7f8f900ccf00 2024-09-17T05:22:45.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.447+0000 7f8f8e7fc640 1 -- 172.21.15.98:0/3541193416 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8f84009d20 con 0x7f8f900ccf00 2024-09-17T05:22:45.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.447+0000 7f8f97e47640 1 -- 172.21.15.98:0/3541193416 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f90159a90 con 0x7f8f900ccf00 2024-09-17T05:22:45.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.447+0000 7f8f8e7fc640 1 -- 172.21.15.98:0/3541193416 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f84005280 con 0x7f8f900ccf00 2024-09-17T05:22:45.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.447+0000 7f8f97e47640 1 -- 172.21.15.98:0/3541193416 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f9015a050 con 0x7f8f900ccf00 2024-09-17T05:22:45.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.448+0000 7f8f97e47640 1 -- 172.21.15.98:0/3541193416 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f9006f9f0 con 0x7f8f900ccf00 2024-09-17T05:22:45.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.449+0000 7f8f8e7fc640 1 -- 172.21.15.98:0/3541193416 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8f84005420 con 0x7f8f900ccf00 2024-09-17T05:22:45.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.449+0000 7f8f8e7fc640 1 --2- 172.21.15.98:0/3541193416 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f8f7c078b90 0x7f8f7c07b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:45.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.449+0000 7f8f8e7fc640 1 -- 172.21.15.98:0/3541193416 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f8f8409adf0 con 0x7f8f900ccf00 2024-09-17T05:22:45.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.449+0000 7f8f95be3640 1 --2- 172.21.15.98:0/3541193416 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f8f7c078b90 0x7f8f7c07b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:45.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.450+0000 7f8f95be3640 1 --2- 172.21.15.98:0/3541193416 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f8f7c078b90 0x7f8f7c07b050 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8f800012e0 tx=0x7f8f80009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:45.454 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.453+0000 7f8f8e7fc640 1 -- 172.21.15.98:0/3541193416 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f8f84062c70 con 0x7f8f900ccf00 2024-09-17T05:22:45.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.650+0000 7f8f97e47640 1 -- 172.21.15.98:0/3541193416 --> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f8f900ad070 con 0x7f8f7c078b90 2024-09-17T05:22:45.653 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.652+0000 7f8f8e7fc640 1 -- 172.21.15.98:0/3541193416 <== mgr.4103 v2:172.21.15.167:6800/610796449 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f8f900ad070 con 0x7f8f7c078b90 2024-09-17T05:22:45.653 INFO:teuthology.orchestra.run.smithi098.stdout:[ 2024-09-17T05:22:45.653 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:22:45.653 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "cephfs" 2024-09-17T05:22:45.653 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:22:45.653 INFO:teuthology.orchestra.run.smithi098.stdout:] 2024-09-17T05:22:45.656 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.654+0000 7f8f97e47640 1 -- 172.21.15.98:0/3541193416 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f8f7c078b90 msgr2=0x7f8f7c07b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:45.656 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.654+0000 7f8f97e47640 1 --2- 172.21.15.98:0/3541193416 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f8f7c078b90 0x7f8f7c07b050 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8f800012e0 tx=0x7f8f80009040 comp rx=0 tx=0).stop 2024-09-17T05:22:45.656 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.654+0000 7f8f97e47640 1 -- 172.21.15.98:0/3541193416 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f900ccf00 msgr2=0x7f8f9015bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:45.656 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.654+0000 7f8f97e47640 1 --2- 172.21.15.98:0/3541193416 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f900ccf00 0x7f8f9015bf80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f8f8400d770 tx=0x7f8f8400dc30 comp rx=0 tx=0).stop 2024-09-17T05:22:45.656 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.655+0000 7f8f97e47640 1 -- 172.21.15.98:0/3541193416 shutdown_connections 2024-09-17T05:22:45.656 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.655+0000 7f8f97e47640 1 --2- 172.21.15.98:0/3541193416 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f8f7c078b90 0x7f8f7c07b050 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:45.656 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.655+0000 7f8f97e47640 1 --2- 172.21.15.98:0/3541193416 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f9015f5a0 0x7f8f901537c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:45.656 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.655+0000 7f8f97e47640 1 --2- 172.21.15.98:0/3541193416 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f900ccf00 0x7f8f9015bf80 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:45.656 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.655+0000 7f8f97e47640 1 --2- 172.21.15.98:0/3541193416 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8f90073fb0 0x7f8f9015a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:45.656 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.655+0000 7f8f97e47640 1 -- 172.21.15.98:0/3541193416 >> 172.21.15.98:0/3541193416 conn(0x7f8f900b1950 msgr2=0x7f8f900ae5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:45.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.655+0000 7f8f97e47640 1 -- 172.21.15.98:0/3541193416 shutdown_connections 2024-09-17T05:22:45.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.655+0000 7f8f97e47640 1 -- 172.21.15.98:0/3541193416 wait complete. 2024-09-17T05:22:45.667 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:22:45.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.771+0000 7f5d6b26e640 1 -- 172.21.15.98:0/316926425 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d641437c0 msgr2=0x7f5d640cdad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:45.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.771+0000 7f5d6b26e640 1 --2- 172.21.15.98:0/316926425 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d641437c0 0x7f5d640cdad0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5d640cd540 tx=0x7f5d5402a6f0 comp rx=0 tx=0).stop 2024-09-17T05:22:45.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.771+0000 7f5d6b26e640 1 -- 172.21.15.98:0/316926425 shutdown_connections 2024-09-17T05:22:45.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.771+0000 7f5d6b26e640 1 --2- 172.21.15.98:0/316926425 >> v2:172.21.15.167:3300/0 conn(0x7f5d640b4bd0 0x7f5d640b3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:45.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.771+0000 7f5d6b26e640 1 --2- 172.21.15.98:0/316926425 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d640b4400 0x7f5d6415db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:45.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.771+0000 7f5d6b26e640 1 --2- 172.21.15.98:0/316926425 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d641437c0 0x7f5d640cdad0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:45.773 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.771+0000 7f5d6b26e640 1 -- 172.21.15.98:0/316926425 >> 172.21.15.98:0/316926425 conn(0x7f5d640b1840 msgr2=0x7f5d640b1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:45.773 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.771+0000 7f5d6b26e640 1 -- 172.21.15.98:0/316926425 shutdown_connections 2024-09-17T05:22:45.773 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.771+0000 7f5d6b26e640 1 -- 172.21.15.98:0/316926425 wait complete. 2024-09-17T05:22:45.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.772+0000 7f5d6b26e640 1 Processor -- start 2024-09-17T05:22:45.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.772+0000 7f5d6b26e640 1 -- start start 2024-09-17T05:22:45.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.773+0000 7f5d6b26e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d640b4400 0x7f5d6413f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:45.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.773+0000 7f5d6b26e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d640b4bd0 0x7f5d640ac8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:45.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.773+0000 7f5d6b26e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d641437c0 0x7f5d640ace30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:45.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.773+0000 7f5d6b26e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5d6415e090 con 0x7f5d640b4400 2024-09-17T05:22:45.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.773+0000 7f5d6b26e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5d64070a80 con 0x7f5d641437c0 2024-09-17T05:22:45.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.773+0000 7f5d6b26e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f5d6415e210 con 0x7f5d640b4bd0 2024-09-17T05:22:45.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.773+0000 7f5d6900a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d640b4400 0x7f5d6413f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:45.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.773+0000 7f5d6900a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d640b4400 0x7f5d6413f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46916/0 (socket says 172.21.15.98:46916) 2024-09-17T05:22:45.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.773+0000 7f5d6900a640 1 -- 172.21.15.98:0/1923652551 learned_addr learned my addr 172.21.15.98:0/1923652551 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:45.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.773+0000 7f5d68809640 1 --2- 172.21.15.98:0/1923652551 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d640b4bd0 0x7f5d640ac8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:45.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.773+0000 7f5d6980b640 1 --2- 172.21.15.98:0/1923652551 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d641437c0 0x7f5d640ace30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:45.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.773+0000 7f5d6900a640 1 -- 172.21.15.98:0/1923652551 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d640b4bd0 msgr2=0x7f5d640ac8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:45.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.773+0000 7f5d6900a640 1 --2- 172.21.15.98:0/1923652551 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d640b4bd0 0x7f5d640ac8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:45.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.773+0000 7f5d6900a640 1 -- 172.21.15.98:0/1923652551 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d641437c0 msgr2=0x7f5d640ace30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:45.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.773+0000 7f5d6900a640 1 --2- 172.21.15.98:0/1923652551 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d641437c0 0x7f5d640ace30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:45.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.773+0000 7f5d6900a640 1 -- 172.21.15.98:0/1923652551 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d6413fba0 con 0x7f5d640b4400 2024-09-17T05:22:45.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.773+0000 7f5d6900a640 1 --2- 172.21.15.98:0/1923652551 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d640b4400 0x7f5d6413f660 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5d54009750 tx=0x7f5d54003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:45.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.773+0000 7f5d61ffb640 1 -- 172.21.15.98:0/1923652551 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d54004450 con 0x7f5d640b4400 2024-09-17T05:22:45.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.773+0000 7f5d61ffb640 1 -- 172.21.15.98:0/1923652551 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5d540045f0 con 0x7f5d640b4400 2024-09-17T05:22:45.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.773+0000 7f5d6b26e640 1 -- 172.21.15.98:0/1923652551 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d640ad460 con 0x7f5d640b4400 2024-09-17T05:22:45.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.774+0000 7f5d61ffb640 1 -- 172.21.15.98:0/1923652551 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d54003e10 con 0x7f5d640b4400 2024-09-17T05:22:45.780 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.774+0000 7f5d6b26e640 1 -- 172.21.15.98:0/1923652551 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d640ac000 con 0x7f5d640b4400 2024-09-17T05:22:45.780 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.775+0000 7f5d6b26e640 1 -- 172.21.15.98:0/1923652551 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d6415e6c0 con 0x7f5d640b4400 2024-09-17T05:22:45.780 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.775+0000 7f5d61ffb640 1 -- 172.21.15.98:0/1923652551 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5d5403b410 con 0x7f5d640b4400 2024-09-17T05:22:45.781 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.776+0000 7f5d61ffb640 1 --2- 172.21.15.98:0/1923652551 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f5d50078b80 0x7f5d5007b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:45.781 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.776+0000 7f5d61ffb640 1 -- 172.21.15.98:0/1923652551 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f5d540bc0e0 con 0x7f5d640b4400 2024-09-17T05:22:45.781 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.776+0000 7f5d68809640 1 --2- 172.21.15.98:0/1923652551 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f5d50078b80 0x7f5d5007b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:45.781 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.777+0000 7f5d68809640 1 --2- 172.21.15.98:0/1923652551 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f5d50078b80 0x7f5d5007b040 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5d640ac8a0 tx=0x7f5d5800b490 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:45.781 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.780+0000 7f5d61ffb640 1 -- 172.21.15.98:0/1923652551 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f5d6413fba0 con 0x7f5d640b4400 2024-09-17T05:22:45.955 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.954+0000 7f5d6b26e640 1 -- 172.21.15.98:0/1923652551 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f5d640cd570 con 0x7f5d640b4400 2024-09-17T05:22:45.955 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.954+0000 7f5d61ffb640 1 -- 172.21.15.98:0/1923652551 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v28)=0 v28) ==== 122+0+0 (secure 0 0 0) 0x7f5d5403f030 con 0x7f5d640b4400 2024-09-17T05:22:45.957 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.956+0000 7f5d6b26e640 1 -- 172.21.15.98:0/1923652551 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f5d50078b80 msgr2=0x7f5d5007b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:45.957 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.956+0000 7f5d6b26e640 1 --2- 172.21.15.98:0/1923652551 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f5d50078b80 0x7f5d5007b040 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5d640ac8a0 tx=0x7f5d5800b490 comp rx=0 tx=0).stop 2024-09-17T05:22:45.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.956+0000 7f5d6b26e640 1 -- 172.21.15.98:0/1923652551 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d640b4400 msgr2=0x7f5d6413f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:45.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.956+0000 7f5d6b26e640 1 --2- 172.21.15.98:0/1923652551 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d640b4400 0x7f5d6413f660 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5d54009750 tx=0x7f5d54003c20 comp rx=0 tx=0).stop 2024-09-17T05:22:45.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.956+0000 7f5d6b26e640 1 -- 172.21.15.98:0/1923652551 shutdown_connections 2024-09-17T05:22:45.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.956+0000 7f5d6b26e640 1 --2- 172.21.15.98:0/1923652551 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f5d50078b80 0x7f5d5007b040 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:45.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.956+0000 7f5d6b26e640 1 --2- 172.21.15.98:0/1923652551 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d641437c0 0x7f5d640ace30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:45.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.956+0000 7f5d6b26e640 1 --2- 172.21.15.98:0/1923652551 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d640b4bd0 0x7f5d640ac8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:45.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.956+0000 7f5d6b26e640 1 --2- 172.21.15.98:0/1923652551 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d640b4400 0x7f5d6413f660 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:45.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.956+0000 7f5d6b26e640 1 -- 172.21.15.98:0/1923652551 >> 172.21.15.98:0/1923652551 conn(0x7f5d640b1840 msgr2=0x7f5d6406e860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:45.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.956+0000 7f5d6b26e640 1 -- 172.21.15.98:0/1923652551 shutdown_connections 2024-09-17T05:22:45.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:45.956+0000 7f5d6b26e640 1 -- 172.21.15.98:0/1923652551 wait complete. 2024-09-17T05:22:45.969 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs subvol_grp29590 2024-09-17T05:22:46.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.071+0000 7f2ce8ff3640 1 -- 172.21.15.98:0/3535944513 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ce40d00b0 msgr2=0x7f2ce415fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:46.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.071+0000 7f2ce8ff3640 1 --2- 172.21.15.98:0/3535944513 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ce40d00b0 0x7f2ce415fe00 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2cd4009830 tx=0x7f2cd402a510 comp rx=0 tx=0).stop 2024-09-17T05:22:46.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.071+0000 7f2ce8ff3640 1 -- 172.21.15.98:0/3535944513 shutdown_connections 2024-09-17T05:22:46.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.071+0000 7f2ce8ff3640 1 --2- 172.21.15.98:0/3535944513 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ce40d00b0 0x7f2ce415fe00 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:46.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.071+0000 7f2ce8ff3640 1 -- 172.21.15.98:0/3535944513 >> 172.21.15.98:0/3535944513 conn(0x7f2ce40d1e40 msgr2=0x7f2ce40d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:46.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.071+0000 7f2ce8ff3640 1 -- 172.21.15.98:0/3535944513 shutdown_connections 2024-09-17T05:22:46.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.071+0000 7f2ce8ff3640 1 -- 172.21.15.98:0/3535944513 wait complete. 2024-09-17T05:22:46.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.072+0000 7f2ce8ff3640 1 Processor -- start 2024-09-17T05:22:46.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.072+0000 7f2ce8ff3640 1 -- start start 2024-09-17T05:22:46.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.073+0000 7f2ce8ff3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ce40b0b30 0x7f2ce41f6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:46.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.073+0000 7f2ce8ff3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ce40d00b0 0x7f2ce40cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:46.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.073+0000 7f2ce8ff3640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ce40d2960 0x7f2ce41f2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:46.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.073+0000 7f2ce8ff3640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce40afa30 con 0x7f2ce40d00b0 2024-09-17T05:22:46.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.073+0000 7f2ce8ff3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce40d06e0 con 0x7f2ce40b0b30 2024-09-17T05:22:46.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.073+0000 7f2ce8ff3640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f2ce40afbb0 con 0x7f2ce40d2960 2024-09-17T05:22:46.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.073+0000 7f2ce1d9b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ce40d00b0 0x7f2ce40cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:46.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.073+0000 7f2ce1d9b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ce40d00b0 0x7f2ce40cc8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46940/0 (socket says 172.21.15.98:46940) 2024-09-17T05:22:46.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.073+0000 7f2ce259c640 1 --2- 172.21.15.98:0/1545946859 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ce40b0b30 0x7f2ce41f6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:46.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.073+0000 7f2ce1d9b640 1 -- 172.21.15.98:0/1545946859 learned_addr learned my addr 172.21.15.98:0/1545946859 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:46.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.073+0000 7f2ce2d9d640 1 --2- 172.21.15.98:0/1545946859 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ce40d2960 0x7f2ce41f2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:46.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.074+0000 7f2ce1d9b640 1 -- 172.21.15.98:0/1545946859 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ce40d2960 msgr2=0x7f2ce41f2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:46.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.074+0000 7f2ce1d9b640 1 --2- 172.21.15.98:0/1545946859 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ce40d2960 0x7f2ce41f2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:46.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.074+0000 7f2ce1d9b640 1 -- 172.21.15.98:0/1545946859 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ce40b0b30 msgr2=0x7f2ce41f6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:46.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.074+0000 7f2ce1d9b640 1 --2- 172.21.15.98:0/1545946859 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ce40b0b30 0x7f2ce41f6c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:46.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.074+0000 7f2ce1d9b640 1 -- 172.21.15.98:0/1545946859 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ce41f36c0 con 0x7f2ce40d00b0 2024-09-17T05:22:46.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.074+0000 7f2ce1d9b640 1 --2- 172.21.15.98:0/1545946859 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ce40d00b0 0x7f2ce40cc8b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2cd800c3f0 tx=0x7f2cd800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:46.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.074+0000 7f2cd2ffd640 1 -- 172.21.15.98:0/1545946859 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd8017070 con 0x7f2ce40d00b0 2024-09-17T05:22:46.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.074+0000 7f2cd2ffd640 1 -- 172.21.15.98:0/1545946859 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2cd80035f0 con 0x7f2ce40d00b0 2024-09-17T05:22:46.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.074+0000 7f2ce8ff3640 1 -- 172.21.15.98:0/1545946859 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ce41f39a0 con 0x7f2ce40d00b0 2024-09-17T05:22:46.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.074+0000 7f2cd2ffd640 1 -- 172.21.15.98:0/1545946859 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd8003a40 con 0x7f2ce40d00b0 2024-09-17T05:22:46.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.074+0000 7f2ce8ff3640 1 -- 172.21.15.98:0/1545946859 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ce40c7780 con 0x7f2ce40d00b0 2024-09-17T05:22:46.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.075+0000 7f2ce8ff3640 1 -- 172.21.15.98:0/1545946859 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ce40cfa80 con 0x7f2ce40d00b0 2024-09-17T05:22:46.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.076+0000 7f2cd2ffd640 1 -- 172.21.15.98:0/1545946859 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2cd801a070 con 0x7f2ce40d00b0 2024-09-17T05:22:46.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.076+0000 7f2cd2ffd640 1 --2- 172.21.15.98:0/1545946859 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f2cc4078bc0 0x7f2cc407b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:46.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.076+0000 7f2cd2ffd640 1 -- 172.21.15.98:0/1545946859 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f2cd8099f10 con 0x7f2ce40d00b0 2024-09-17T05:22:46.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.076+0000 7f2ce259c640 1 --2- 172.21.15.98:0/1545946859 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f2cc4078bc0 0x7f2cc407b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:46.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.077+0000 7f2ce259c640 1 --2- 172.21.15.98:0/1545946859 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f2cc4078bc0 0x7f2cc407b080 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2cd4034000 tx=0x7f2cd4004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:46.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.080+0000 7f2cd2ffd640 1 -- 172.21.15.98:0/1545946859 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f2cd8061d90 con 0x7f2ce40d00b0 2024-09-17T05:22:46.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.282+0000 7f2ce8ff3640 1 -- 172.21.15.98:0/1545946859 --> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "subvol_grp29590", "target": ["mon-mgr", ""]}) -- 0x7f2ce40c72e0 con 0x7f2cc4078bc0 2024-09-17T05:22:46.287 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-17T05:22:46.286+0000 7fdaf87dc640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:22:46.287 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-17T05:22:46.286+0000 7fdaf87dc640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:22:46.288 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-17T05:22:46.286+0000 7fdaf87dc640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:22:46.288 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-17T05:22:46.286+0000 7fdaf87dc640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:22:46.288 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-17T05:22:46.286+0000 7fdaf87dc640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:22:46.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.299+0000 7f2cd2ffd640 1 -- 172.21.15.98:0/1545946859 <== mgr.4103 v2:172.21.15.167:6800/610796449 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f2cd4004350 con 0x7f2cc4078bc0 2024-09-17T05:22:46.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.301+0000 7f2ce8ff3640 1 -- 172.21.15.98:0/1545946859 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f2cc4078bc0 msgr2=0x7f2cc407b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:46.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.301+0000 7f2ce8ff3640 1 --2- 172.21.15.98:0/1545946859 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f2cc4078bc0 0x7f2cc407b080 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2cd4034000 tx=0x7f2cd4004730 comp rx=0 tx=0).stop 2024-09-17T05:22:46.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.301+0000 7f2ce8ff3640 1 -- 172.21.15.98:0/1545946859 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ce40d00b0 msgr2=0x7f2ce40cc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:46.303 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.301+0000 7f2ce8ff3640 1 --2- 172.21.15.98:0/1545946859 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ce40d00b0 0x7f2ce40cc8b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2cd800c3f0 tx=0x7f2cd800c8b0 comp rx=0 tx=0).stop 2024-09-17T05:22:46.303 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.301+0000 7f2ce8ff3640 1 -- 172.21.15.98:0/1545946859 shutdown_connections 2024-09-17T05:22:46.303 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.301+0000 7f2ce8ff3640 1 --2- 172.21.15.98:0/1545946859 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f2cc4078bc0 0x7f2cc407b080 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:46.303 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.301+0000 7f2ce8ff3640 1 --2- 172.21.15.98:0/1545946859 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ce40d2960 0x7f2ce41f2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:46.303 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.301+0000 7f2ce8ff3640 1 --2- 172.21.15.98:0/1545946859 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2ce40d00b0 0x7f2ce40cc8b0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:46.303 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.301+0000 7f2ce8ff3640 1 --2- 172.21.15.98:0/1545946859 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ce40b0b30 0x7f2ce41f6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:46.303 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.301+0000 7f2ce8ff3640 1 -- 172.21.15.98:0/1545946859 >> 172.21.15.98:0/1545946859 conn(0x7f2ce40d1e40 msgr2=0x7f2ce40b4c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:46.303 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.301+0000 7f2ce8ff3640 1 -- 172.21.15.98:0/1545946859 shutdown_connections 2024-09-17T05:22:46.303 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.301+0000 7f2ce8ff3640 1 -- 172.21.15.98:0/1545946859 wait complete. 2024-09-17T05:22:46.313 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol28310 --group_name subvol_grp29590 2024-09-17T05:22:46.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.420+0000 7f8b4fd24640 1 -- 172.21.15.98:0/3733997615 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b4806f220 msgr2=0x7f8b4806f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:46.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.420+0000 7f8b4fd24640 1 --2- 172.21.15.98:0/3733997615 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b4806f220 0x7f8b4806f6d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f8b40009ca0 tx=0x7f8b4002aa30 comp rx=0 tx=0).stop 2024-09-17T05:22:46.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.420+0000 7f8b4fd24640 1 -- 172.21.15.98:0/3733997615 shutdown_connections 2024-09-17T05:22:46.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.420+0000 7f8b4fd24640 1 --2- 172.21.15.98:0/3733997615 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b4806f220 0x7f8b4806f6d0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:46.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.420+0000 7f8b4fd24640 1 --2- 172.21.15.98:0/3733997615 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b48159aa0 0x7f8b480741a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:46.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.420+0000 7f8b4fd24640 1 -- 172.21.15.98:0/3733997615 >> 172.21.15.98:0/3733997615 conn(0x7f8b480b18e0 msgr2=0x7f8b480b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:46.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.420+0000 7f8b4fd24640 1 -- 172.21.15.98:0/3733997615 shutdown_connections 2024-09-17T05:22:46.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.420+0000 7f8b4fd24640 1 -- 172.21.15.98:0/3733997615 wait complete. 2024-09-17T05:22:46.423 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.421+0000 7f8b4fd24640 1 Processor -- start 2024-09-17T05:22:46.423 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.421+0000 7f8b4fd24640 1 -- start start 2024-09-17T05:22:46.423 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.422+0000 7f8b4fd24640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b4806f220 0x7f8b48154600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:46.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.422+0000 7f8b4fd24640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b48159aa0 0x7f8b48154b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:46.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.422+0000 7f8b4fd24640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b4815cff0 0x7f8b481f2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:46.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.422+0000 7f8b4fd24640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8b480cc520 con 0x7f8b4806f220 2024-09-17T05:22:46.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.422+0000 7f8b4fd24640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8b480cc3a0 con 0x7f8b48159aa0 2024-09-17T05:22:46.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.422+0000 7f8b4fd24640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f8b480cc6a0 con 0x7f8b4815cff0 2024-09-17T05:22:46.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.422+0000 7f8b4dac0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b4806f220 0x7f8b48154600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:46.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.422+0000 7f8b4dac0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b4806f220 0x7f8b48154600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51962/0 (socket says 172.21.15.98:51962) 2024-09-17T05:22:46.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.422+0000 7f8b4dac0640 1 -- 172.21.15.98:0/3486398477 learned_addr learned my addr 172.21.15.98:0/3486398477 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:46.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.422+0000 7f8b4e2c1640 1 --2- 172.21.15.98:0/3486398477 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b4815cff0 0x7f8b481f2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:46.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.422+0000 7f8b4d2bf640 1 --2- 172.21.15.98:0/3486398477 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b48159aa0 0x7f8b48154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:46.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.422+0000 7f8b4dac0640 1 -- 172.21.15.98:0/3486398477 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b4815cff0 msgr2=0x7f8b481f2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:46.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.422+0000 7f8b4dac0640 1 --2- 172.21.15.98:0/3486398477 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b4815cff0 0x7f8b481f2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:46.425 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.422+0000 7f8b4dac0640 1 -- 172.21.15.98:0/3486398477 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b48159aa0 msgr2=0x7f8b48154b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:46.425 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.422+0000 7f8b4dac0640 1 --2- 172.21.15.98:0/3486398477 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b48159aa0 0x7f8b48154b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:46.425 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.422+0000 7f8b4dac0640 1 -- 172.21.15.98:0/3486398477 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b481455d0 con 0x7f8b4806f220 2024-09-17T05:22:46.425 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.422+0000 7f8b4d2bf640 1 --2- 172.21.15.98:0/3486398477 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b48159aa0 0x7f8b48154b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:22:46.425 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.422+0000 7f8b4dac0640 1 --2- 172.21.15.98:0/3486398477 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b4806f220 0x7f8b48154600 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8b4400c970 tx=0x7f8b4400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:46.425 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.422+0000 7f8b3e7fc640 1 -- 172.21.15.98:0/3486398477 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b44007bb0 con 0x7f8b4806f220 2024-09-17T05:22:46.425 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.422+0000 7f8b3e7fc640 1 -- 172.21.15.98:0/3486398477 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b44005020 con 0x7f8b4806f220 2024-09-17T05:22:46.425 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.422+0000 7f8b4fd24640 1 -- 172.21.15.98:0/3486398477 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b48145890 con 0x7f8b4806f220 2024-09-17T05:22:46.425 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.422+0000 7f8b3e7fc640 1 -- 172.21.15.98:0/3486398477 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b44007e60 con 0x7f8b4806f220 2024-09-17T05:22:46.425 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.422+0000 7f8b4fd24640 1 -- 172.21.15.98:0/3486398477 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b48145e50 con 0x7f8b4806f220 2024-09-17T05:22:46.426 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.423+0000 7f8b4fd24640 1 -- 172.21.15.98:0/3486398477 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b48069360 con 0x7f8b4806f220 2024-09-17T05:22:46.426 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.424+0000 7f8b3e7fc640 1 -- 172.21.15.98:0/3486398477 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8b44005470 con 0x7f8b4806f220 2024-09-17T05:22:46.426 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.425+0000 7f8b3e7fc640 1 --2- 172.21.15.98:0/3486398477 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f8b2c078b90 0x7f8b2c07b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:46.426 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.425+0000 7f8b3e7fc640 1 -- 172.21.15.98:0/3486398477 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f8b4409b180 con 0x7f8b4806f220 2024-09-17T05:22:46.426 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.425+0000 7f8b4d2bf640 1 --2- 172.21.15.98:0/3486398477 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f8b2c078b90 0x7f8b2c07b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:46.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.425+0000 7f8b4d2bf640 1 --2- 172.21.15.98:0/3486398477 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f8b2c078b90 0x7f8b2c07b050 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8b38006fd0 tx=0x7f8b38008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:46.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.429+0000 7f8b3e7fc640 1 -- 172.21.15.98:0/3486398477 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f8b44014030 con 0x7f8b4806f220 2024-09-17T05:22:46.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.631+0000 7f8b4fd24640 1 -- 172.21.15.98:0/3486398477 --> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol28310", "group_name": "subvol_grp29590", "target": ["mon-mgr", ""]}) -- 0x7f8b48070980 con 0x7f8b2c078b90 2024-09-17T05:22:46.660 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.659+0000 7f8b3e7fc640 1 -- 172.21.15.98:0/3486398477 <== mgr.4103 v2:172.21.15.167:6800/610796449 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f8b48070980 con 0x7f8b2c078b90 2024-09-17T05:22:46.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.662+0000 7f8b4fd24640 1 -- 172.21.15.98:0/3486398477 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f8b2c078b90 msgr2=0x7f8b2c07b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:46.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.662+0000 7f8b4fd24640 1 --2- 172.21.15.98:0/3486398477 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f8b2c078b90 0x7f8b2c07b050 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8b38006fd0 tx=0x7f8b38008040 comp rx=0 tx=0).stop 2024-09-17T05:22:46.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.662+0000 7f8b4fd24640 1 -- 172.21.15.98:0/3486398477 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b4806f220 msgr2=0x7f8b48154600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:46.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.662+0000 7f8b4fd24640 1 --2- 172.21.15.98:0/3486398477 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b4806f220 0x7f8b48154600 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8b4400c970 tx=0x7f8b4400ce30 comp rx=0 tx=0).stop 2024-09-17T05:22:46.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.662+0000 7f8b4fd24640 1 -- 172.21.15.98:0/3486398477 shutdown_connections 2024-09-17T05:22:46.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.662+0000 7f8b4fd24640 1 --2- 172.21.15.98:0/3486398477 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f8b2c078b90 0x7f8b2c07b050 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:46.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.662+0000 7f8b4fd24640 1 --2- 172.21.15.98:0/3486398477 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b4815cff0 0x7f8b481f2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:46.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.662+0000 7f8b4fd24640 1 --2- 172.21.15.98:0/3486398477 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b48159aa0 0x7f8b48154b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:46.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.662+0000 7f8b4fd24640 1 --2- 172.21.15.98:0/3486398477 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b4806f220 0x7f8b48154600 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:46.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.662+0000 7f8b4fd24640 1 -- 172.21.15.98:0/3486398477 >> 172.21.15.98:0/3486398477 conn(0x7f8b480b18e0 msgr2=0x7f8b480aecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:46.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.662+0000 7f8b4fd24640 1 -- 172.21.15.98:0/3486398477 shutdown_connections 2024-09-17T05:22:46.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.662+0000 7f8b4fd24640 1 -- 172.21.15.98:0/3486398477 wait complete. 2024-09-17T05:22:46.673 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol1651 --group_name subvol_grp29590 2024-09-17T05:22:46.783 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.779+0000 7f3e470b8640 1 -- 172.21.15.98:0/4140058521 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e30003a30 msgr2=0x7f3e30003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:46.783 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.779+0000 7f3e470b8640 1 --2- 172.21.15.98:0/4140058521 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e30003a30 0x7f3e30003e50 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f3e34001050 tx=0x7f3e30005830 comp rx=0 tx=0).stop 2024-09-17T05:22:46.783 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.779+0000 7f3e45655640 1 -- 172.21.15.98:0/4140058521 reap_dead start 2024-09-17T05:22:46.783 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.779+0000 7f3e470b8640 1 -- 172.21.15.98:0/4140058521 shutdown_connections 2024-09-17T05:22:46.784 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.779+0000 7f3e470b8640 1 -- 172.21.15.98:0/4140058521 >> 172.21.15.98:0/4140058521 conn(0x7f3e400d4050 msgr2=0x7f3e400d4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:46.784 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.779+0000 7f3e470b8640 1 -- 172.21.15.98:0/4140058521 shutdown_connections 2024-09-17T05:22:46.784 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.779+0000 7f3e470b8640 1 -- 172.21.15.98:0/4140058521 wait complete. 2024-09-17T05:22:46.784 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.780+0000 7f3e470b8640 1 Processor -- start 2024-09-17T05:22:46.784 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.780+0000 7f3e470b8640 1 -- start start 2024-09-17T05:22:46.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.781+0000 7f3e470b8640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e30003a30 0x7f3e40157aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:46.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.781+0000 7f3e470b8640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e40155040 0x7f3e40155480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:46.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.781+0000 7f3e470b8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e400b5bc0 0x7f3e400b6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:46.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.781+0000 7f3e470b8640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3e400b8000 con 0x7f3e40155040 2024-09-17T05:22:46.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.781+0000 7f3e470b8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3e400d4db0 con 0x7f3e400b5bc0 2024-09-17T05:22:46.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.781+0000 7f3e470b8640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f3e400b8180 con 0x7f3e30003a30 2024-09-17T05:22:46.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.781+0000 7f3e3ffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e40155040 0x7f3e40155480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:46.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.781+0000 7f3e3ffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e40155040 0x7f3e40155480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51992/0 (socket says 172.21.15.98:51992) 2024-09-17T05:22:46.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.781+0000 7f3e3ffff640 1 -- 172.21.15.98:0/3482477945 learned_addr learned my addr 172.21.15.98:0/3482477945 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:46.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.781+0000 7f3e3ffff640 1 -- 172.21.15.98:0/3482477945 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e30003a30 msgr2=0x7f3e40157aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:46.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.781+0000 7f3e3ffff640 1 --2- 172.21.15.98:0/3482477945 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e30003a30 0x7f3e40157aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:46.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.781+0000 7f3e3ffff640 1 -- 172.21.15.98:0/3482477945 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e400b5bc0 msgr2=0x7f3e400b6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:46.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.781+0000 7f3e3ffff640 1 --2- 172.21.15.98:0/3482477945 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e400b5bc0 0x7f3e400b6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:46.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.781+0000 7f3e3ffff640 1 -- 172.21.15.98:0/3482477945 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e40157fe0 con 0x7f3e40155040 2024-09-17T05:22:46.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.782+0000 7f3e3ffff640 1 --2- 172.21.15.98:0/3482477945 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e40155040 0x7f3e40155480 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c004e50 tx=0x7f3e2c0015d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:46.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.782+0000 7f3e3d7fa640 1 -- 172.21.15.98:0/3482477945 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e2c011660 con 0x7f3e40155040 2024-09-17T05:22:46.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.782+0000 7f3e3d7fa640 1 -- 172.21.15.98:0/3482477945 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3e2c016070 con 0x7f3e40155040 2024-09-17T05:22:46.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.782+0000 7f3e470b8640 1 -- 172.21.15.98:0/3482477945 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e40155b70 con 0x7f3e40155040 2024-09-17T05:22:46.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.782+0000 7f3e3d7fa640 1 -- 172.21.15.98:0/3482477945 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e2c011af0 con 0x7f3e40155040 2024-09-17T05:22:46.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.782+0000 7f3e470b8640 1 -- 172.21.15.98:0/3482477945 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e40156130 con 0x7f3e40155040 2024-09-17T05:22:46.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.783+0000 7f3e470b8640 1 -- 172.21.15.98:0/3482477945 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e400b8740 con 0x7f3e40155040 2024-09-17T05:22:46.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.783+0000 7f3e3d7fa640 1 -- 172.21.15.98:0/3482477945 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3e2c011c90 con 0x7f3e40155040 2024-09-17T05:22:46.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.784+0000 7f3e3d7fa640 1 --2- 172.21.15.98:0/3482477945 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f3e24078b90 0x7f3e2407b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:46.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.784+0000 7f3e3d7fa640 1 -- 172.21.15.98:0/3482477945 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f3e2c09b420 con 0x7f3e40155040 2024-09-17T05:22:46.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.784+0000 7f3e44e54640 1 --2- 172.21.15.98:0/3482477945 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f3e24078b90 0x7f3e2407b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:46.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.784+0000 7f3e44e54640 1 --2- 172.21.15.98:0/3482477945 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f3e24078b90 0x7f3e2407b050 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3e34033000 tx=0x7f3e34000fe0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:46.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.788+0000 7f3e3d7fa640 1 -- 172.21.15.98:0/3482477945 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f3e40157fe0 con 0x7f3e40155040 2024-09-17T05:22:46.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:46.989+0000 7f3e470b8640 1 -- 172.21.15.98:0/3482477945 --> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol1651", "group_name": "subvol_grp29590", "target": ["mon-mgr", ""]}) -- 0x7f3e4006aaf0 con 0x7f3e24078b90 2024-09-17T05:22:47.014 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.014+0000 7f3e3d7fa640 1 -- 172.21.15.98:0/3482477945 <== mgr.4103 v2:172.21.15.167:6800/610796449 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3e4006aaf0 con 0x7f3e24078b90 2024-09-17T05:22:47.017 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.016+0000 7f3e470b8640 1 -- 172.21.15.98:0/3482477945 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f3e24078b90 msgr2=0x7f3e2407b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:47.017 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.016+0000 7f3e470b8640 1 --2- 172.21.15.98:0/3482477945 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f3e24078b90 0x7f3e2407b050 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3e34033000 tx=0x7f3e34000fe0 comp rx=0 tx=0).stop 2024-09-17T05:22:47.017 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.016+0000 7f3e470b8640 1 -- 172.21.15.98:0/3482477945 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e40155040 msgr2=0x7f3e40155480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:47.017 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.016+0000 7f3e470b8640 1 --2- 172.21.15.98:0/3482477945 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e40155040 0x7f3e40155480 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c004e50 tx=0x7f3e2c0015d0 comp rx=0 tx=0).stop 2024-09-17T05:22:47.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.016+0000 7f3e470b8640 1 -- 172.21.15.98:0/3482477945 shutdown_connections 2024-09-17T05:22:47.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.016+0000 7f3e470b8640 1 --2- 172.21.15.98:0/3482477945 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f3e24078b90 0x7f3e2407b050 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:47.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.016+0000 7f3e470b8640 1 --2- 172.21.15.98:0/3482477945 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e400b5bc0 0x7f3e400b6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:47.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.016+0000 7f3e470b8640 1 --2- 172.21.15.98:0/3482477945 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e40155040 0x7f3e40155480 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:47.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.016+0000 7f3e470b8640 1 --2- 172.21.15.98:0/3482477945 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e30003a30 0x7f3e40157aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:47.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.016+0000 7f3e470b8640 1 -- 172.21.15.98:0/3482477945 >> 172.21.15.98:0/3482477945 conn(0x7f3e400d4050 msgr2=0x7f3e4006e060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:47.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.016+0000 7f3e470b8640 1 -- 172.21.15.98:0/3482477945 shutdown_connections 2024-09-17T05:22:47.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.016+0000 7f3e470b8640 1 -- 172.21.15.98:0/3482477945 wait complete. 2024-09-17T05:22:47.028 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol89542 --group_name subvol_grp29590 2024-09-17T05:22:47.141 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.134+0000 7f7955001640 1 -- 172.21.15.98:0/670469008 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79500cf2f0 msgr2=0x7f79500b49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:47.141 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.134+0000 7f7955001640 1 --2- 172.21.15.98:0/670469008 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79500cf2f0 0x7f79500b49c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7944009830 tx=0x7f794402a480 comp rx=0 tx=0).stop 2024-09-17T05:22:47.141 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.134+0000 7f7955001640 1 -- 172.21.15.98:0/670469008 shutdown_connections 2024-09-17T05:22:47.141 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.134+0000 7f7955001640 1 --2- 172.21.15.98:0/670469008 >> v2:172.21.15.167:3300/0 conn(0x7f795006ffa0 0x7f79500cc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:47.142 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.134+0000 7f7955001640 1 --2- 172.21.15.98:0/670469008 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79500cf2f0 0x7f79500b49c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:47.142 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.134+0000 7f7955001640 1 -- 172.21.15.98:0/670469008 >> 172.21.15.98:0/670469008 conn(0x7f79500b18e0 msgr2=0x7f79500b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:47.142 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.134+0000 7f7955001640 1 -- 172.21.15.98:0/670469008 shutdown_connections 2024-09-17T05:22:47.142 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.134+0000 7f7955001640 1 -- 172.21.15.98:0/670469008 wait complete. 2024-09-17T05:22:47.142 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.136+0000 7f7955001640 1 Processor -- start 2024-09-17T05:22:47.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.136+0000 7f7955001640 1 -- start start 2024-09-17T05:22:47.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.136+0000 7f7955001640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f795006ffa0 0x7f795014b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:47.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.136+0000 7f7955001640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79500cf2f0 0x7f7950157300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:47.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.136+0000 7f7955001640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f795015ae70 0x7f795009cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:47.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.136+0000 7f7955001640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f79500ccb60 con 0x7f79500cf2f0 2024-09-17T05:22:47.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.137+0000 7f7955001640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f79500cc9e0 con 0x7f795015ae70 2024-09-17T05:22:47.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.137+0000 7f7955001640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f79500ccce0 con 0x7f795006ffa0 2024-09-17T05:22:47.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.137+0000 7f794e59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79500cf2f0 0x7f7950157300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:47.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.137+0000 7f794e59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79500cf2f0 0x7f7950157300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51994/0 (socket says 172.21.15.98:51994) 2024-09-17T05:22:47.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.137+0000 7f794e59c640 1 -- 172.21.15.98:0/3500119925 learned_addr learned my addr 172.21.15.98:0/3500119925 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:47.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.137+0000 7f794f59e640 1 --2- 172.21.15.98:0/3500119925 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f795015ae70 0x7f795009cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:47.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.137+0000 7f794ed9d640 1 --2- 172.21.15.98:0/3500119925 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f795006ffa0 0x7f795014b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:47.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.137+0000 7f794e59c640 1 -- 172.21.15.98:0/3500119925 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f795006ffa0 msgr2=0x7f795014b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:47.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.137+0000 7f794e59c640 1 --2- 172.21.15.98:0/3500119925 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f795006ffa0 0x7f795014b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:47.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.137+0000 7f794e59c640 1 -- 172.21.15.98:0/3500119925 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f795015ae70 msgr2=0x7f795009cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:47.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.137+0000 7f794e59c640 1 --2- 172.21.15.98:0/3500119925 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f795015ae70 0x7f795009cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:47.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.137+0000 7f794e59c640 1 -- 172.21.15.98:0/3500119925 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7950155b80 con 0x7f79500cf2f0 2024-09-17T05:22:47.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.137+0000 7f794e59c640 1 --2- 172.21.15.98:0/3500119925 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79500cf2f0 0x7f7950157300 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f794402aa70 tx=0x7f7944032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:47.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.137+0000 7f79377fe640 1 -- 172.21.15.98:0/3500119925 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7944040070 con 0x7f79500cf2f0 2024-09-17T05:22:47.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.137+0000 7f79377fe640 1 -- 172.21.15.98:0/3500119925 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7944005310 con 0x7f79500cf2f0 2024-09-17T05:22:47.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.137+0000 7f79377fe640 1 -- 172.21.15.98:0/3500119925 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7944005c90 con 0x7f79500cf2f0 2024-09-17T05:22:47.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.137+0000 7f7955001640 1 -- 172.21.15.98:0/3500119925 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7950156820 con 0x7f79500cf2f0 2024-09-17T05:22:47.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.137+0000 7f7955001640 1 -- 172.21.15.98:0/3500119925 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7950156de0 con 0x7f79500cf2f0 2024-09-17T05:22:47.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.138+0000 7f7955001640 1 -- 172.21.15.98:0/3500119925 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7950069360 con 0x7f79500cf2f0 2024-09-17T05:22:47.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.139+0000 7f79377fe640 1 -- 172.21.15.98:0/3500119925 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7944039040 con 0x7f79500cf2f0 2024-09-17T05:22:47.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.139+0000 7f79377fe640 1 --2- 172.21.15.98:0/3500119925 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f793c078b90 0x7f793c07b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:47.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.139+0000 7f79377fe640 1 -- 172.21.15.98:0/3500119925 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f79440bbd50 con 0x7f79500cf2f0 2024-09-17T05:22:47.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.140+0000 7f794ed9d640 1 --2- 172.21.15.98:0/3500119925 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f793c078b90 0x7f793c07b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:47.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.140+0000 7f794ed9d640 1 --2- 172.21.15.98:0/3500119925 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f793c078b90 0x7f793c07b050 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7940007fd0 tx=0x7f7940001370 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:47.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.144+0000 7f79377fe640 1 -- 172.21.15.98:0/3500119925 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f79440bf030 con 0x7f79500cf2f0 2024-09-17T05:22:47.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.344+0000 7f7955001640 1 -- 172.21.15.98:0/3500119925 --> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol89542", "group_name": "subvol_grp29590", "target": ["mon-mgr", ""]}) -- 0x7f79500cd190 con 0x7f793c078b90 2024-09-17T05:22:47.369 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.369+0000 7f79377fe640 1 -- 172.21.15.98:0/3500119925 <== mgr.4103 v2:172.21.15.167:6800/610796449 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f79500cd190 con 0x7f793c078b90 2024-09-17T05:22:47.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.371+0000 7f7955001640 1 -- 172.21.15.98:0/3500119925 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f793c078b90 msgr2=0x7f793c07b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:47.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.371+0000 7f7955001640 1 --2- 172.21.15.98:0/3500119925 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f793c078b90 0x7f793c07b050 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7940007fd0 tx=0x7f7940001370 comp rx=0 tx=0).stop 2024-09-17T05:22:47.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.371+0000 7f7955001640 1 -- 172.21.15.98:0/3500119925 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79500cf2f0 msgr2=0x7f7950157300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:47.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.371+0000 7f7955001640 1 --2- 172.21.15.98:0/3500119925 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79500cf2f0 0x7f7950157300 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f794402aa70 tx=0x7f7944032c10 comp rx=0 tx=0).stop 2024-09-17T05:22:47.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.371+0000 7f7955001640 1 -- 172.21.15.98:0/3500119925 shutdown_connections 2024-09-17T05:22:47.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.371+0000 7f7955001640 1 --2- 172.21.15.98:0/3500119925 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f793c078b90 0x7f793c07b050 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:47.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.371+0000 7f7955001640 1 --2- 172.21.15.98:0/3500119925 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f795015ae70 0x7f795009cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:47.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.371+0000 7f7955001640 1 --2- 172.21.15.98:0/3500119925 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79500cf2f0 0x7f7950157300 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:47.373 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.371+0000 7f7955001640 1 --2- 172.21.15.98:0/3500119925 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f795006ffa0 0x7f795014b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:47.373 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.371+0000 7f7955001640 1 -- 172.21.15.98:0/3500119925 >> 172.21.15.98:0/3500119925 conn(0x7f79500b18e0 msgr2=0x7f79500cbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:47.373 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.371+0000 7f7955001640 1 -- 172.21.15.98:0/3500119925 shutdown_connections 2024-09-17T05:22:47.373 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.371+0000 7f7955001640 1 -- 172.21.15.98:0/3500119925 wait complete. 2024-09-17T05:22:47.382 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol28310 subvol_grp29590 2024-09-17T05:22:47.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.486+0000 7f0a5ea71640 1 -- 172.21.15.98:0/278426770 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a580b4ab0 msgr2=0x7f0a580ce8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:47.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.486+0000 7f0a5ea71640 1 --2- 172.21.15.98:0/278426770 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a580b4ab0 0x7f0a580ce8f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0a50005fd0 tx=0x7f0a5002a8b0 comp rx=0 tx=0).stop 2024-09-17T05:22:47.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.486+0000 7f0a5ea71640 1 -- 172.21.15.98:0/278426770 shutdown_connections 2024-09-17T05:22:47.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.486+0000 7f0a5ea71640 1 --2- 172.21.15.98:0/278426770 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a580b4ab0 0x7f0a580ce8f0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:47.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.486+0000 7f0a5ea71640 1 --2- 172.21.15.98:0/278426770 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a5815a660 0x7f0a580acd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:47.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.486+0000 7f0a5ea71640 1 -- 172.21.15.98:0/278426770 >> 172.21.15.98:0/278426770 conn(0x7f0a580b18e0 msgr2=0x7f0a580b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:47.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.486+0000 7f0a5ea71640 1 -- 172.21.15.98:0/278426770 shutdown_connections 2024-09-17T05:22:47.488 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.486+0000 7f0a5ea71640 1 -- 172.21.15.98:0/278426770 wait complete. 2024-09-17T05:22:47.488 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.487+0000 7f0a5ea71640 1 Processor -- start 2024-09-17T05:22:47.488 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.487+0000 7f0a5ea71640 1 -- start start 2024-09-17T05:22:47.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.488+0000 7f0a5ea71640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a580b2be0 0x7f0a58151e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:47.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.488+0000 7f0a5ea71640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a580b4ab0 0x7f0a5809b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:47.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.488+0000 7f0a5ea71640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a5815a660 0x7f0a5809bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:47.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.488+0000 7f0a5ea71640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0a580cc650 con 0x7f0a580b2be0 2024-09-17T05:22:47.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.488+0000 7f0a5ea71640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0a5806f910 con 0x7f0a5815a660 2024-09-17T05:22:47.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.488+0000 7f0a5ea71640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f0a580cc7d0 con 0x7f0a580b4ab0 2024-09-17T05:22:47.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.488+0000 7f0a5c80d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a580b2be0 0x7f0a58151e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:47.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.488+0000 7f0a5c80d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a580b2be0 0x7f0a58151e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:52002/0 (socket says 172.21.15.98:52002) 2024-09-17T05:22:47.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.488+0000 7f0a5c80d640 1 -- 172.21.15.98:0/158739074 learned_addr learned my addr 172.21.15.98:0/158739074 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:47.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.488+0000 7f0a5c80d640 1 -- 172.21.15.98:0/158739074 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a580b4ab0 msgr2=0x7f0a5809b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:47.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.488+0000 7f0a57fff640 1 --2- 172.21.15.98:0/158739074 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a580b4ab0 0x7f0a5809b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:47.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.488+0000 7f0a5d00e640 1 --2- 172.21.15.98:0/158739074 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a5815a660 0x7f0a5809bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:47.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.488+0000 7f0a5c80d640 1 --2- 172.21.15.98:0/158739074 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a580b4ab0 0x7f0a5809b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:47.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.488+0000 7f0a5c80d640 1 -- 172.21.15.98:0/158739074 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a5815a660 msgr2=0x7f0a5809bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:47.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.488+0000 7f0a5c80d640 1 --2- 172.21.15.98:0/158739074 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a5815a660 0x7f0a5809bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:47.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.488+0000 7f0a5c80d640 1 -- 172.21.15.98:0/158739074 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a581f9340 con 0x7f0a580b2be0 2024-09-17T05:22:47.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.488+0000 7f0a57fff640 1 --2- 172.21.15.98:0/158739074 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a580b4ab0 0x7f0a5809b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:22:47.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.489+0000 7f0a5c80d640 1 --2- 172.21.15.98:0/158739074 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a580b2be0 0x7f0a58151e20 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0a4800dbc0 tx=0x7f0a4800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:47.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.489+0000 7f0a557fa640 1 -- 172.21.15.98:0/158739074 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a4801b070 con 0x7f0a580b2be0 2024-09-17T05:22:47.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.489+0000 7f0a557fa640 1 -- 172.21.15.98:0/158739074 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0a4800ae50 con 0x7f0a580b2be0 2024-09-17T05:22:47.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.489+0000 7f0a5ea71640 1 -- 172.21.15.98:0/158739074 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a580ca020 con 0x7f0a580b2be0 2024-09-17T05:22:47.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.489+0000 7f0a557fa640 1 -- 172.21.15.98:0/158739074 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a4800e9e0 con 0x7f0a580b2be0 2024-09-17T05:22:47.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.489+0000 7f0a5ea71640 1 -- 172.21.15.98:0/158739074 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a581f8580 con 0x7f0a580b2be0 2024-09-17T05:22:47.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.490+0000 7f0a5ea71640 1 -- 172.21.15.98:0/158739074 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a58069360 con 0x7f0a580b2be0 2024-09-17T05:22:47.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.491+0000 7f0a557fa640 1 -- 172.21.15.98:0/158739074 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0a4801e070 con 0x7f0a580b2be0 2024-09-17T05:22:47.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.491+0000 7f0a557fa640 1 --2- 172.21.15.98:0/158739074 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f0a44078b90 0x7f0a4407b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:47.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.491+0000 7f0a557fa640 1 -- 172.21.15.98:0/158739074 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f0a4809b010 con 0x7f0a580b2be0 2024-09-17T05:22:47.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.491+0000 7f0a57fff640 1 --2- 172.21.15.98:0/158739074 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f0a44078b90 0x7f0a4407b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:47.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.492+0000 7f0a57fff640 1 --2- 172.21.15.98:0/158739074 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f0a44078b90 0x7f0a4407b050 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0a58074f80 tx=0x7f0a4c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:47.496 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.495+0000 7f0a557fa640 1 -- 172.21.15.98:0/158739074 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f0a48062f20 con 0x7f0a580b2be0 2024-09-17T05:22:47.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.696+0000 7f0a5ea71640 1 -- 172.21.15.98:0/158739074 --> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol28310", "group_name": "subvol_grp29590", "target": ["mon-mgr", ""]}) -- 0x7f0a580ccc60 con 0x7f0a44078b90 2024-09-17T05:22:47.709 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.709+0000 7f0a557fa640 1 -- 172.21.15.98:0/158739074 <== mgr.4103 v2:172.21.15.167:6800/610796449 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0a580ccc60 con 0x7f0a44078b90 2024-09-17T05:22:47.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.711+0000 7f0a5ea71640 1 -- 172.21.15.98:0/158739074 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f0a44078b90 msgr2=0x7f0a4407b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:47.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.711+0000 7f0a5ea71640 1 --2- 172.21.15.98:0/158739074 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f0a44078b90 0x7f0a4407b050 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0a58074f80 tx=0x7f0a4c009040 comp rx=0 tx=0).stop 2024-09-17T05:22:47.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.711+0000 7f0a5ea71640 1 -- 172.21.15.98:0/158739074 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a580b2be0 msgr2=0x7f0a58151e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:47.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.711+0000 7f0a5ea71640 1 --2- 172.21.15.98:0/158739074 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a580b2be0 0x7f0a58151e20 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0a4800dbc0 tx=0x7f0a4800a620 comp rx=0 tx=0).stop 2024-09-17T05:22:47.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.711+0000 7f0a5ea71640 1 -- 172.21.15.98:0/158739074 shutdown_connections 2024-09-17T05:22:47.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.711+0000 7f0a5ea71640 1 --2- 172.21.15.98:0/158739074 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f0a44078b90 0x7f0a4407b050 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:47.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.711+0000 7f0a5ea71640 1 --2- 172.21.15.98:0/158739074 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a5815a660 0x7f0a5809bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:47.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.711+0000 7f0a5ea71640 1 --2- 172.21.15.98:0/158739074 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a580b4ab0 0x7f0a5809b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:47.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.711+0000 7f0a5ea71640 1 --2- 172.21.15.98:0/158739074 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a580b2be0 0x7f0a58151e20 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:47.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.711+0000 7f0a5ea71640 1 -- 172.21.15.98:0/158739074 >> 172.21.15.98:0/158739074 conn(0x7f0a580b18e0 msgr2=0x7f0a58153b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:47.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.711+0000 7f0a5ea71640 1 -- 172.21.15.98:0/158739074 shutdown_connections 2024-09-17T05:22:47.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.711+0000 7f0a5ea71640 1 -- 172.21.15.98:0/158739074 wait complete. 2024-09-17T05:22:47.713 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-17T05:22:47.712+0000 7fdafb7e2640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:22:47.713 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-17T05:22:47.712+0000 7fdafb7e2640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:22:47.713 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-17T05:22:47.712+0000 7fdafb7e2640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:22:47.713 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-17T05:22:47.712+0000 7fdafb7e2640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:22:47.713 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-17T05:22:47.712+0000 7fdafb7e2640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:22:47.723 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol1651 subvol_grp29590 2024-09-17T05:22:47.728 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-17T05:22:47.726+0000 7fdafa7e0640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:22:47.728 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-17T05:22:47.726+0000 7fdafa7e0640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:22:47.728 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-17T05:22:47.726+0000 7fdafa7e0640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:22:47.728 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-17T05:22:47.726+0000 7fdafa7e0640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:22:47.728 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-17T05:22:47.726+0000 7fdafa7e0640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:22:47.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.827+0000 7f4c75b17640 1 -- 172.21.15.98:0/1492734143 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c70074630 msgr2=0x7f4c70070320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:47.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.827+0000 7f4c75b17640 1 --2- 172.21.15.98:0/1492734143 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c70074630 0x7f4c70070320 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f4c58005fd0 tx=0x7f4c5802a820 comp rx=0 tx=0).stop 2024-09-17T05:22:47.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.827+0000 7f4c75b17640 1 -- 172.21.15.98:0/1492734143 shutdown_connections 2024-09-17T05:22:47.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.827+0000 7f4c75b17640 1 --2- 172.21.15.98:0/1492734143 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c70074630 0x7f4c70070320 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:47.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.827+0000 7f4c75b17640 1 -- 172.21.15.98:0/1492734143 >> 172.21.15.98:0/1492734143 conn(0x7f4c700b18e0 msgr2=0x7f4c700b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:47.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.827+0000 7f4c75b17640 1 -- 172.21.15.98:0/1492734143 shutdown_connections 2024-09-17T05:22:47.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.827+0000 7f4c75b17640 1 -- 172.21.15.98:0/1492734143 wait complete. 2024-09-17T05:22:47.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.828+0000 7f4c75b17640 1 Processor -- start 2024-09-17T05:22:47.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.828+0000 7f4c75b17640 1 -- start start 2024-09-17T05:22:47.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.829+0000 7f4c75b17640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c70074630 0x7f4c700c6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:47.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.829+0000 7f4c75b17640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c700b4880 0x7f4c700ad540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:47.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.829+0000 7f4c75b17640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c7015a3b0 0x7f4c70150410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:47.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.829+0000 7f4c75b17640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4c700ce6b0 con 0x7f4c7015a3b0 2024-09-17T05:22:47.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.829+0000 7f4c75b17640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4c700ce530 con 0x7f4c700b4880 2024-09-17T05:22:47.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.829+0000 7f4c75b17640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f4c7015eb00 con 0x7f4c70074630 2024-09-17T05:22:47.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.829+0000 7f4c6ffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c7015a3b0 0x7f4c70150410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:47.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.829+0000 7f4c6ffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c7015a3b0 0x7f4c70150410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:52020/0 (socket says 172.21.15.98:52020) 2024-09-17T05:22:47.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.829+0000 7f4c6ffff640 1 -- 172.21.15.98:0/3209558834 learned_addr learned my addr 172.21.15.98:0/3209558834 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:47.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.829+0000 7f4c6effd640 1 --2- 172.21.15.98:0/3209558834 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c700b4880 0x7f4c700ad540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:47.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.829+0000 7f4c6ffff640 1 -- 172.21.15.98:0/3209558834 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c70074630 msgr2=0x7f4c700c6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:47.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.829+0000 7f4c6f7fe640 1 --2- 172.21.15.98:0/3209558834 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c70074630 0x7f4c700c6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:47.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.829+0000 7f4c6ffff640 1 --2- 172.21.15.98:0/3209558834 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c70074630 0x7f4c700c6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:47.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.829+0000 7f4c6ffff640 1 -- 172.21.15.98:0/3209558834 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c700b4880 msgr2=0x7f4c700ad540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:47.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.829+0000 7f4c6ffff640 1 --2- 172.21.15.98:0/3209558834 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c700b4880 0x7f4c700ad540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:47.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.829+0000 7f4c6ffff640 1 -- 172.21.15.98:0/3209558834 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c700c6e30 con 0x7f4c7015a3b0 2024-09-17T05:22:47.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.829+0000 7f4c6effd640 1 --2- 172.21.15.98:0/3209558834 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c700b4880 0x7f4c700ad540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:22:47.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.829+0000 7f4c6f7fe640 1 --2- 172.21.15.98:0/3209558834 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c70074630 0x7f4c700c6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:22:47.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.829+0000 7f4c6ffff640 1 --2- 172.21.15.98:0/3209558834 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c7015a3b0 0x7f4c70150410 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f4c6800c400 tx=0x7f4c6800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:47.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.829+0000 7f4c67fff640 1 -- 172.21.15.98:0/3209558834 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c68011790 con 0x7f4c7015a3b0 2024-09-17T05:22:47.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.830+0000 7f4c67fff640 1 -- 172.21.15.98:0/3209558834 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4c68017070 con 0x7f4c7015a3b0 2024-09-17T05:22:47.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.830+0000 7f4c75b17640 1 -- 172.21.15.98:0/3209558834 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c700c7110 con 0x7f4c7015a3b0 2024-09-17T05:22:47.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.830+0000 7f4c67fff640 1 -- 172.21.15.98:0/3209558834 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c68011d00 con 0x7f4c7015a3b0 2024-09-17T05:22:47.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.830+0000 7f4c75b17640 1 -- 172.21.15.98:0/3209558834 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c701f6f40 con 0x7f4c7015a3b0 2024-09-17T05:22:47.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.831+0000 7f4c75b17640 1 -- 172.21.15.98:0/3209558834 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c70069360 con 0x7f4c7015a3b0 2024-09-17T05:22:47.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.831+0000 7f4c67fff640 1 -- 172.21.15.98:0/3209558834 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4c6801c460 con 0x7f4c7015a3b0 2024-09-17T05:22:47.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.832+0000 7f4c67fff640 1 --2- 172.21.15.98:0/3209558834 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f4c50078b90 0x7f4c5007b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:47.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.832+0000 7f4c67fff640 1 -- 172.21.15.98:0/3209558834 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f4c6809ab50 con 0x7f4c7015a3b0 2024-09-17T05:22:47.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.832+0000 7f4c6f7fe640 1 --2- 172.21.15.98:0/3209558834 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f4c50078b90 0x7f4c5007b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:47.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.833+0000 7f4c6f7fe640 1 --2- 172.21.15.98:0/3209558834 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f4c50078b90 0x7f4c5007b050 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4c600016a0 tx=0x7f4c60009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:47.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:47.836+0000 7f4c67fff640 1 -- 172.21.15.98:0/3209558834 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f4c68001120 con 0x7f4c7015a3b0 2024-09-17T05:22:48.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:48.038+0000 7f4c75b17640 1 -- 172.21.15.98:0/3209558834 --> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol1651", "group_name": "subvol_grp29590", "target": ["mon-mgr", ""]}) -- 0x7f4c700b3790 con 0x7f4c50078b90 2024-09-17T05:22:48.344 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:48.343+0000 7f4c67fff640 1 -- 172.21.15.98:0/3209558834 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 6) ==== 101594+0+0 (secure 0 0 0) 0x7f4c6805eb90 con 0x7f4c7015a3b0 2024-09-17T05:22:51.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.125+0000 7f4c67fff640 1 -- 172.21.15.98:0/3209558834 <== mgr.4103 v2:172.21.15.167:6800/610796449 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f4c700b3790 con 0x7f4c50078b90 2024-09-17T05:22:51.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.127+0000 7f4c75b17640 1 -- 172.21.15.98:0/3209558834 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f4c50078b90 msgr2=0x7f4c5007b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:51.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.127+0000 7f4c75b17640 1 --2- 172.21.15.98:0/3209558834 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f4c50078b90 0x7f4c5007b050 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4c600016a0 tx=0x7f4c60009040 comp rx=0 tx=0).stop 2024-09-17T05:22:51.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.127+0000 7f4c75b17640 1 -- 172.21.15.98:0/3209558834 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c7015a3b0 msgr2=0x7f4c70150410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:51.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.127+0000 7f4c75b17640 1 --2- 172.21.15.98:0/3209558834 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c7015a3b0 0x7f4c70150410 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f4c6800c400 tx=0x7f4c6800c8c0 comp rx=0 tx=0).stop 2024-09-17T05:22:51.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.128+0000 7f4c75b17640 1 -- 172.21.15.98:0/3209558834 shutdown_connections 2024-09-17T05:22:51.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.128+0000 7f4c75b17640 1 --2- 172.21.15.98:0/3209558834 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f4c50078b90 0x7f4c5007b050 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:51.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.128+0000 7f4c75b17640 1 --2- 172.21.15.98:0/3209558834 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c7015a3b0 0x7f4c70150410 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:51.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.128+0000 7f4c75b17640 1 --2- 172.21.15.98:0/3209558834 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c700b4880 0x7f4c700ad540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:51.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.128+0000 7f4c75b17640 1 --2- 172.21.15.98:0/3209558834 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c70074630 0x7f4c700c6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:51.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.128+0000 7f4c75b17640 1 -- 172.21.15.98:0/3209558834 >> 172.21.15.98:0/3209558834 conn(0x7f4c700b18e0 msgr2=0x7f4c700cdad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:51.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.128+0000 7f4c75b17640 1 -- 172.21.15.98:0/3209558834 shutdown_connections 2024-09-17T05:22:51.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.128+0000 7f4c75b17640 1 -- 172.21.15.98:0/3209558834 wait complete. 2024-09-17T05:22:51.144 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol89542 subvol_grp29590 2024-09-17T05:22:51.255 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.253+0000 7faffc7cd640 1 -- 172.21.15.98:0/3750363349 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafe0004800 msgr2=0x7fafe0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:51.256 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.253+0000 7faffc7cd640 1 --2- 172.21.15.98:0/3750363349 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafe0004800 0x7fafe0004c80 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fafe400c310 tx=0x7fafe0005830 comp rx=0 tx=0).stop 2024-09-17T05:22:51.256 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.253+0000 7faffc7cd640 1 -- 172.21.15.98:0/3750363349 shutdown_connections 2024-09-17T05:22:51.256 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.253+0000 7faffc7cd640 1 --2- 172.21.15.98:0/3750363349 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafe0004800 0x7fafe0004c80 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:51.256 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.253+0000 7faffc7cd640 1 -- 172.21.15.98:0/3750363349 >> 172.21.15.98:0/3750363349 conn(0x7faff40b18e0 msgr2=0x7faff40b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:51.256 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.253+0000 7faffc7cd640 1 -- 172.21.15.98:0/3750363349 shutdown_connections 2024-09-17T05:22:51.256 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.253+0000 7faffc7cd640 1 -- 172.21.15.98:0/3750363349 wait complete. 2024-09-17T05:22:51.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.254+0000 7faffc7cd640 1 Processor -- start 2024-09-17T05:22:51.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.254+0000 7faffc7cd640 1 -- start start 2024-09-17T05:22:51.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.255+0000 7faffc7cd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fafe0004800 0x7faff41482d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:51.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.255+0000 7faffc7cd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faff41530c0 0x7faff4144d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:51.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.255+0000 7faffc7cd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faff4145290 0x7faff415cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:51.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.255+0000 7faffc7cd640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7faff406ee60 con 0x7faff4145290 2024-09-17T05:22:51.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.255+0000 7faffc7cd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7faff415bcc0 con 0x7fafe0004800 2024-09-17T05:22:51.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.255+0000 7faffc7cd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7faff4152c40 con 0x7faff41530c0 2024-09-17T05:22:51.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.255+0000 7faffad6a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faff4145290 0x7faff415cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:51.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.255+0000 7faffad6a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faff4145290 0x7faff415cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:52040/0 (socket says 172.21.15.98:52040) 2024-09-17T05:22:51.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.255+0000 7faffad6a640 1 -- 172.21.15.98:0/3489116046 learned_addr learned my addr 172.21.15.98:0/3489116046 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:51.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.255+0000 7faffa569640 1 --2- 172.21.15.98:0/3489116046 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fafe0004800 0x7faff41482d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:51.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.255+0000 7faff9d68640 1 --2- 172.21.15.98:0/3489116046 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faff41530c0 0x7faff4144d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:51.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.256+0000 7faffad6a640 1 -- 172.21.15.98:0/3489116046 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faff41530c0 msgr2=0x7faff4144d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:51.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.256+0000 7faffad6a640 1 --2- 172.21.15.98:0/3489116046 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faff41530c0 0x7faff4144d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:51.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.256+0000 7faffad6a640 1 -- 172.21.15.98:0/3489116046 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fafe0004800 msgr2=0x7faff41482d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:51.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.256+0000 7faffad6a640 1 --2- 172.21.15.98:0/3489116046 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fafe0004800 0x7faff41482d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:51.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.256+0000 7faffad6a640 1 -- 172.21.15.98:0/3489116046 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faff4148810 con 0x7faff4145290 2024-09-17T05:22:51.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.256+0000 7faffad6a640 1 --2- 172.21.15.98:0/3489116046 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faff4145290 0x7faff415cc10 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7faff40af580 tx=0x7fafec001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:51.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.256+0000 7fafeaffd640 1 -- 172.21.15.98:0/3489116046 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafec015020 con 0x7faff4145290 2024-09-17T05:22:51.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.256+0000 7fafeaffd640 1 -- 172.21.15.98:0/3489116046 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fafec011960 con 0x7faff4145290 2024-09-17T05:22:51.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.256+0000 7faffc7cd640 1 -- 172.21.15.98:0/3489116046 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faff41f6370 con 0x7faff4145290 2024-09-17T05:22:51.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.256+0000 7fafeaffd640 1 -- 172.21.15.98:0/3489116046 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafec011db0 con 0x7faff4145290 2024-09-17T05:22:51.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.256+0000 7faffc7cd640 1 -- 172.21.15.98:0/3489116046 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faff41f6930 con 0x7faff4145290 2024-09-17T05:22:51.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.257+0000 7faffc7cd640 1 -- 172.21.15.98:0/3489116046 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faff4069360 con 0x7faff4145290 2024-09-17T05:22:51.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.257+0000 7fafeaffd640 1 -- 172.21.15.98:0/3489116046 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 6) ==== 101594+0+0 (secure 0 0 0) 0x7fafec018020 con 0x7faff4145290 2024-09-17T05:22:51.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.258+0000 7fafeaffd640 1 --2- 172.21.15.98:0/3489116046 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fafd8078d70 0x7fafd807b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:51.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.258+0000 7fafeaffd640 1 -- 172.21.15.98:0/3489116046 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fafec09b980 con 0x7faff4145290 2024-09-17T05:22:51.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.258+0000 7faffa569640 1 --2- 172.21.15.98:0/3489116046 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fafd8078d70 0x7fafd807b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:51.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.259+0000 7faffa569640 1 --2- 172.21.15.98:0/3489116046 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fafd8078d70 0x7fafd807b230 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7faff00058c0 tx=0x7faff000d390 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:51.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.262+0000 7fafeaffd640 1 -- 172.21.15.98:0/3489116046 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fafec01f020 con 0x7faff4145290 2024-09-17T05:22:51.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.463+0000 7faffc7cd640 1 -- 172.21.15.98:0/3489116046 --> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol89542", "group_name": "subvol_grp29590", "target": ["mon-mgr", ""]}) -- 0x7faff41f6b70 con 0x7fafd8078d70 2024-09-17T05:22:51.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.481+0000 7fafeaffd640 1 -- 172.21.15.98:0/3489116046 <== mgr.4103 v2:172.21.15.167:6800/610796449 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7faff001b440 con 0x7fafd8078d70 2024-09-17T05:22:51.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.483+0000 7faffc7cd640 1 -- 172.21.15.98:0/3489116046 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fafd8078d70 msgr2=0x7fafd807b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:51.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.483+0000 7faffc7cd640 1 --2- 172.21.15.98:0/3489116046 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fafd8078d70 0x7fafd807b230 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7faff00058c0 tx=0x7faff000d390 comp rx=0 tx=0).stop 2024-09-17T05:22:51.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.483+0000 7faffc7cd640 1 -- 172.21.15.98:0/3489116046 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faff4145290 msgr2=0x7faff415cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:51.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.483+0000 7faffc7cd640 1 --2- 172.21.15.98:0/3489116046 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faff4145290 0x7faff415cc10 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7faff40af580 tx=0x7fafec001a70 comp rx=0 tx=0).stop 2024-09-17T05:22:51.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.483+0000 7faffc7cd640 1 -- 172.21.15.98:0/3489116046 shutdown_connections 2024-09-17T05:22:51.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.483+0000 7faffc7cd640 1 --2- 172.21.15.98:0/3489116046 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fafd8078d70 0x7fafd807b230 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:51.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.483+0000 7faffc7cd640 1 --2- 172.21.15.98:0/3489116046 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faff4145290 0x7faff415cc10 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:51.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.483+0000 7faffc7cd640 1 --2- 172.21.15.98:0/3489116046 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faff41530c0 0x7faff4144d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:51.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.483+0000 7faffc7cd640 1 --2- 172.21.15.98:0/3489116046 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fafe0004800 0x7faff41482d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:51.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.483+0000 7faffc7cd640 1 -- 172.21.15.98:0/3489116046 >> 172.21.15.98:0/3489116046 conn(0x7faff40b18e0 msgr2=0x7faff415c430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:51.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.483+0000 7faffc7cd640 1 -- 172.21.15.98:0/3489116046 shutdown_connections 2024-09-17T05:22:51.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.483+0000 7faffc7cd640 1 -- 172.21.15.98:0/3489116046 wait complete. 2024-09-17T05:22:51.496 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup rm cephfs subvol_grp29590 2024-09-17T05:22:51.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.600+0000 7ff28edad640 1 -- 172.21.15.98:0/2164220938 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff278004800 msgr2=0x7ff278004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:51.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.600+0000 7ff28edad640 1 --2- 172.21.15.98:0/2164220938 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff278004800 0x7ff278004c80 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff274009b50 tx=0x7ff278005830 comp rx=0 tx=0).stop 2024-09-17T05:22:51.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.600+0000 7ff28d34a640 1 -- 172.21.15.98:0/2164220938 reap_dead start 2024-09-17T05:22:51.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.600+0000 7ff28edad640 1 -- 172.21.15.98:0/2164220938 shutdown_connections 2024-09-17T05:22:51.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.600+0000 7ff28edad640 1 -- 172.21.15.98:0/2164220938 >> 172.21.15.98:0/2164220938 conn(0x7ff2880b1840 msgr2=0x7ff2880b1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:51.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.600+0000 7ff28edad640 1 -- 172.21.15.98:0/2164220938 shutdown_connections 2024-09-17T05:22:51.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.600+0000 7ff28edad640 1 -- 172.21.15.98:0/2164220938 wait complete. 2024-09-17T05:22:51.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.601+0000 7ff28edad640 1 Processor -- start 2024-09-17T05:22:51.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.601+0000 7ff28edad640 1 -- start start 2024-09-17T05:22:51.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.602+0000 7ff28edad640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff278004800 0x7ff288153740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:51.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.602+0000 7ff28edad640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff288162550 0x7ff2881f2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:51.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.602+0000 7ff28edad640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2881f2ec0 0x7ff2880afe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:51.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.602+0000 7ff28edad640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff28815f470 con 0x7ff2881f2ec0 2024-09-17T05:22:51.609 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.602+0000 7ff28edad640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff28815f2f0 con 0x7ff288162550 2024-09-17T05:22:51.609 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.602+0000 7ff28edad640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7ff288162a80 con 0x7ff278004800 2024-09-17T05:22:51.609 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.602+0000 7ff28d34a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2881f2ec0 0x7ff2880afe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:51.609 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.602+0000 7ff28d34a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2881f2ec0 0x7ff2880afe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:52050/0 (socket says 172.21.15.98:52050) 2024-09-17T05:22:51.609 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.602+0000 7ff28d34a640 1 -- 172.21.15.98:0/3966549372 learned_addr learned my addr 172.21.15.98:0/3966549372 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:51.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.602+0000 7ff28d34a640 1 -- 172.21.15.98:0/3966549372 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff278004800 msgr2=0x7ff288153740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:51.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.602+0000 7ff28d34a640 1 --2- 172.21.15.98:0/3966549372 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff278004800 0x7ff288153740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:51.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.602+0000 7ff28d34a640 1 -- 172.21.15.98:0/3966549372 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff288162550 msgr2=0x7ff2881f2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:51.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.602+0000 7ff28d34a640 1 --2- 172.21.15.98:0/3966549372 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff288162550 0x7ff2881f2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:51.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.602+0000 7ff28d34a640 1 -- 172.21.15.98:0/3966549372 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2881f3490 con 0x7ff2881f2ec0 2024-09-17T05:22:51.611 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.603+0000 7ff28d34a640 1 --2- 172.21.15.98:0/3966549372 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2881f2ec0 0x7ff2880afe10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff2880b27b0 tx=0x7ff280010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:51.611 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.603+0000 7ff2857fa640 1 -- 172.21.15.98:0/3966549372 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff28000ee50 con 0x7ff2881f2ec0 2024-09-17T05:22:51.611 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.603+0000 7ff2857fa640 1 -- 172.21.15.98:0/3966549372 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff280015070 con 0x7ff2881f2ec0 2024-09-17T05:22:51.611 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.603+0000 7ff2857fa640 1 -- 172.21.15.98:0/3966549372 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff280003d00 con 0x7ff2881f2ec0 2024-09-17T05:22:51.611 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.603+0000 7ff28edad640 1 -- 172.21.15.98:0/3966549372 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2881f3770 con 0x7ff2881f2ec0 2024-09-17T05:22:51.612 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.603+0000 7ff28edad640 1 -- 172.21.15.98:0/3966549372 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2881f61a0 con 0x7ff2881f2ec0 2024-09-17T05:22:51.612 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.604+0000 7ff28edad640 1 -- 172.21.15.98:0/3966549372 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff288152d30 con 0x7ff2881f2ec0 2024-09-17T05:22:51.612 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.604+0000 7ff2857fa640 1 -- 172.21.15.98:0/3966549372 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 6) ==== 101594+0+0 (secure 0 0 0) 0x7ff280004030 con 0x7ff2881f2ec0 2024-09-17T05:22:51.612 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.605+0000 7ff2857fa640 1 --2- 172.21.15.98:0/3966549372 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7ff26c078d70 0x7ff26c07b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:51.612 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.605+0000 7ff2857fa640 1 -- 172.21.15.98:0/3966549372 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7ff28009ba50 con 0x7ff2881f2ec0 2024-09-17T05:22:51.613 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.605+0000 7ff28cb49640 1 --2- 172.21.15.98:0/3966549372 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7ff26c078d70 0x7ff26c07b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:51.613 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.606+0000 7ff28cb49640 1 --2- 172.21.15.98:0/3966549372 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7ff26c078d70 0x7ff26c07b230 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff27c001010 tx=0x7ff27c000f80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:51.613 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.609+0000 7ff2857fa640 1 -- 172.21.15.98:0/3966549372 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7ff280063b90 con 0x7ff2881f2ec0 2024-09-17T05:22:51.810 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.809+0000 7ff28edad640 1 -- 172.21.15.98:0/3966549372 --> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup rm", "vol_name": "cephfs", "group_name": "subvol_grp29590", "target": ["mon-mgr", ""]}) -- 0x7ff2881f3940 con 0x7ff26c078d70 2024-09-17T05:22:51.818 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.817+0000 7ff2857fa640 1 -- 172.21.15.98:0/3966549372 <== mgr.4103 v2:172.21.15.167:6800/610796449 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff2881f3940 con 0x7ff26c078d70 2024-09-17T05:22:51.820 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.818+0000 7ff28edad640 1 -- 172.21.15.98:0/3966549372 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7ff26c078d70 msgr2=0x7ff26c07b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:51.820 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.818+0000 7ff28edad640 1 --2- 172.21.15.98:0/3966549372 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7ff26c078d70 0x7ff26c07b230 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff27c001010 tx=0x7ff27c000f80 comp rx=0 tx=0).stop 2024-09-17T05:22:51.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.818+0000 7ff28edad640 1 -- 172.21.15.98:0/3966549372 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2881f2ec0 msgr2=0x7ff2880afe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:51.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.818+0000 7ff28edad640 1 --2- 172.21.15.98:0/3966549372 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2881f2ec0 0x7ff2880afe10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff2880b27b0 tx=0x7ff280010f40 comp rx=0 tx=0).stop 2024-09-17T05:22:51.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.818+0000 7ff28edad640 1 -- 172.21.15.98:0/3966549372 shutdown_connections 2024-09-17T05:22:51.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.818+0000 7ff28edad640 1 --2- 172.21.15.98:0/3966549372 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7ff26c078d70 0x7ff26c07b230 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:51.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.818+0000 7ff28edad640 1 --2- 172.21.15.98:0/3966549372 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2881f2ec0 0x7ff2880afe10 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:51.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.818+0000 7ff28edad640 1 --2- 172.21.15.98:0/3966549372 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff288162550 0x7ff2881f2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:51.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.818+0000 7ff28edad640 1 --2- 172.21.15.98:0/3966549372 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff278004800 0x7ff288153740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:51.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.818+0000 7ff28edad640 1 -- 172.21.15.98:0/3966549372 >> 172.21.15.98:0/3966549372 conn(0x7ff2880b1840 msgr2=0x7ff28813bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:51.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.818+0000 7ff28edad640 1 -- 172.21.15.98:0/3966549372 shutdown_connections 2024-09-17T05:22:51.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51.818+0000 7ff28edad640 1 -- 172.21.15.98:0/3966549372 wait complete. 2024-09-17T05:22:51.832 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-09-17T05:22:51.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:22:51.887 INFO:teuthology.orchestra.run.smithi098.stdout:2 2024-09-17T05:22:51.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:22:51.894 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:22:51.894 DEBUG:teuthology.orchestra.run.smithi098:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:22:51.950 DEBUG:teuthology.orchestra.run.smithi167:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:22:51.997 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:22:51.997 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:22:51.997 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T05:22:51.998 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:22:52.014 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T05:22:52.014 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:22:52.042 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:22:52.058 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:22:52.071 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:22:52.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.242+0000 7f117d248640 1 -- 172.21.15.98:0/472163202 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f117815e0d0 msgr2=0x7f11780d09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:52.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.242+0000 7f117d248640 1 --2- 172.21.15.98:0/472163202 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f117815e0d0 0x7f11780d09c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f11780d4f60 tx=0x7f116002a530 comp rx=0 tx=0).stop 2024-09-17T05:22:52.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.242+0000 7f117d248640 1 -- 172.21.15.98:0/472163202 shutdown_connections 2024-09-17T05:22:52.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.242+0000 7f117d248640 1 --2- 172.21.15.98:0/472163202 >> v2:172.21.15.167:3300/0 conn(0x7f11780d2050 0x7f11780d0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:52.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.242+0000 7f117d248640 1 --2- 172.21.15.98:0/472163202 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f117815e0d0 0x7f11780d09c0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:52.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.242+0000 7f117d248640 1 -- 172.21.15.98:0/472163202 >> 172.21.15.98:0/472163202 conn(0x7f11780d3fe0 msgr2=0x7f11780d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:52.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.242+0000 7f117d248640 1 -- 172.21.15.98:0/472163202 shutdown_connections 2024-09-17T05:22:52.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.242+0000 7f117d248640 1 -- 172.21.15.98:0/472163202 wait complete. 2024-09-17T05:22:52.246 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.244+0000 7f117d248640 1 Processor -- start 2024-09-17T05:22:52.246 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.244+0000 7f117d248640 1 -- start start 2024-09-17T05:22:52.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.244+0000 7f117d248640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11780d1440 0x7f11781f5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:52.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.244+0000 7f117d248640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11780d2050 0x7f11780b6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:52.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.244+0000 7f117d248640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f117815e0d0 0x7f11780b4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:52.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.244+0000 7f117d248640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f117815ebc0 con 0x7f11780d1440 2024-09-17T05:22:52.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.244+0000 7f117d248640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f11780cff60 con 0x7f11780d2050 2024-09-17T05:22:52.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.244+0000 7f117d248640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f117815ed40 con 0x7f117815e0d0 2024-09-17T05:22:52.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.245+0000 7f1176d9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11780d1440 0x7f11781f5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:52.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.245+0000 7f1176d9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11780d1440 0x7f11781f5370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:52068/0 (socket says 172.21.15.98:52068) 2024-09-17T05:22:52.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.245+0000 7f1176d9d640 1 -- 172.21.15.98:0/3589925948 learned_addr learned my addr 172.21.15.98:0/3589925948 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:52.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.245+0000 7f117659c640 1 --2- 172.21.15.98:0/3589925948 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11780d2050 0x7f11780b6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:52.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.245+0000 7f117759e640 1 --2- 172.21.15.98:0/3589925948 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f117815e0d0 0x7f11780b4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:52.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.245+0000 7f1176d9d640 1 -- 172.21.15.98:0/3589925948 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f117815e0d0 msgr2=0x7f11780b4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:52.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.245+0000 7f1176d9d640 1 --2- 172.21.15.98:0/3589925948 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f117815e0d0 0x7f11780b4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:52.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.245+0000 7f1176d9d640 1 -- 172.21.15.98:0/3589925948 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11780d2050 msgr2=0x7f11780b6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:52.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.245+0000 7f1176d9d640 1 --2- 172.21.15.98:0/3589925948 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11780d2050 0x7f11780b6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:52.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.245+0000 7f1176d9d640 1 -- 172.21.15.98:0/3589925948 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11780b7510 con 0x7f11780d1440 2024-09-17T05:22:52.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.245+0000 7f117659c640 1 --2- 172.21.15.98:0/3589925948 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11780d2050 0x7f11780b6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:22:52.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.245+0000 7f1176d9d640 1 --2- 172.21.15.98:0/3589925948 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11780d1440 0x7f11781f5370 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f11600098f0 tx=0x7f1160033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:52.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.245+0000 7f116f7fe640 1 -- 172.21.15.98:0/3589925948 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1160005c90 con 0x7f11780d1440 2024-09-17T05:22:52.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.245+0000 7f116f7fe640 1 -- 172.21.15.98:0/3589925948 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1160031e50 con 0x7f11780d1440 2024-09-17T05:22:52.250 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.245+0000 7f117d248640 1 -- 172.21.15.98:0/3589925948 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11780b77f0 con 0x7f11780d1440 2024-09-17T05:22:52.250 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.245+0000 7f116f7fe640 1 -- 172.21.15.98:0/3589925948 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1160005260 con 0x7f11780d1440 2024-09-17T05:22:52.250 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.245+0000 7f117d248640 1 -- 172.21.15.98:0/3589925948 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11780b87f0 con 0x7f11780d1440 2024-09-17T05:22:52.250 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.246+0000 7f117d248640 1 -- 172.21.15.98:0/3589925948 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f117806e250 con 0x7f11780d1440 2024-09-17T05:22:52.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.247+0000 7f116f7fe640 1 -- 172.21.15.98:0/3589925948 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 6) ==== 101594+0+0 (secure 0 0 0) 0x7f1160005400 con 0x7f11780d1440 2024-09-17T05:22:52.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.247+0000 7f116f7fe640 1 --2- 172.21.15.98:0/3589925948 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f1158078d40 0x7f115807b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:52.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.247+0000 7f116f7fe640 1 -- 172.21.15.98:0/3589925948 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f11600bc080 con 0x7f11780d1440 2024-09-17T05:22:52.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.248+0000 7f117659c640 1 --2- 172.21.15.98:0/3589925948 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f1158078d40 0x7f115807b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:52.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.248+0000 7f117659c640 1 --2- 172.21.15.98:0/3589925948 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f1158078d40 0x7f115807b200 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f11680058c0 tx=0x7f1168005850 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:52.253 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.251+0000 7f116f7fe640 1 -- 172.21.15.98:0/3589925948 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f116003f030 con 0x7f11780d1440 2024-09-17T05:22:52.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.442+0000 7f117d248640 1 -- 172.21.15.98:0/3589925948 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f11780d47d0 con 0x7f11780d1440 2024-09-17T05:22:52.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.443+0000 7f116f7fe640 1 -- 172.21.15.98:0/3589925948 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v32) ==== 80+0+0 (secure 0 0 0) 0x7f1160084250 con 0x7f11780d1440 2024-09-17T05:22:52.445 INFO:teuthology.orchestra.run.smithi098.stderr:listed 0 entries 2024-09-17T05:22:52.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.445+0000 7f117d248640 1 -- 172.21.15.98:0/3589925948 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f1158078d40 msgr2=0x7f115807b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:52.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.445+0000 7f117d248640 1 --2- 172.21.15.98:0/3589925948 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f1158078d40 0x7f115807b200 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f11680058c0 tx=0x7f1168005850 comp rx=0 tx=0).stop 2024-09-17T05:22:52.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.445+0000 7f117d248640 1 -- 172.21.15.98:0/3589925948 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11780d1440 msgr2=0x7f11781f5370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:52.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.445+0000 7f117d248640 1 --2- 172.21.15.98:0/3589925948 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11780d1440 0x7f11781f5370 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f11600098f0 tx=0x7f1160033c20 comp rx=0 tx=0).stop 2024-09-17T05:22:52.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.445+0000 7f117d248640 1 -- 172.21.15.98:0/3589925948 shutdown_connections 2024-09-17T05:22:52.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.445+0000 7f117d248640 1 --2- 172.21.15.98:0/3589925948 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f1158078d40 0x7f115807b200 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:52.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.445+0000 7f117d248640 1 --2- 172.21.15.98:0/3589925948 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f117815e0d0 0x7f11780b4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:52.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.445+0000 7f117d248640 1 --2- 172.21.15.98:0/3589925948 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11780d2050 0x7f11780b6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:52.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.445+0000 7f117d248640 1 --2- 172.21.15.98:0/3589925948 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11780d1440 0x7f11781f5370 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:52.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.445+0000 7f117d248640 1 -- 172.21.15.98:0/3589925948 >> 172.21.15.98:0/3589925948 conn(0x7f11780d3fe0 msgr2=0x7f11780b3450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:52.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.445+0000 7f117d248640 1 -- 172.21.15.98:0/3589925948 shutdown_connections 2024-09-17T05:22:52.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.445+0000 7f117d248640 1 -- 172.21.15.98:0/3589925948 wait complete. 2024-09-17T05:22:52.458 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T05:22:52.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:52.458 DEBUG:teuthology.orchestra.run.smithi098:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T05:22:52.486 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi098.front.sepia.ceph.com 2024-09-17T05:22:52.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:52.486 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T05:22:52.542 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:22:52.542 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-17T05:22:52.542 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:22:52.563 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-17T05:22:52.563 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:22:52.622 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:22:52.724 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.722+0000 7f4c1e30e640 1 -- 172.21.15.98:0/1948747991 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c180746a0 msgr2=0x7f4c180732b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:52.724 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.722+0000 7f4c1e30e640 1 --2- 172.21.15.98:0/1948747991 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c180746a0 0x7f4c180732b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f4c10009be0 tx=0x7f4c1002a7c0 comp rx=0 tx=0).stop 2024-09-17T05:22:52.724 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.722+0000 7f4c1e30e640 1 -- 172.21.15.98:0/1948747991 shutdown_connections 2024-09-17T05:22:52.724 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.722+0000 7f4c1e30e640 1 --2- 172.21.15.98:0/1948747991 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c180746a0 0x7f4c180732b0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:52.724 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.722+0000 7f4c1e30e640 1 -- 172.21.15.98:0/1948747991 >> 172.21.15.98:0/1948747991 conn(0x7f4c180b1950 msgr2=0x7f4c180b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:52.725 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.722+0000 7f4c1e30e640 1 -- 172.21.15.98:0/1948747991 shutdown_connections 2024-09-17T05:22:52.725 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.722+0000 7f4c1e30e640 1 -- 172.21.15.98:0/1948747991 wait complete. 2024-09-17T05:22:52.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.723+0000 7f4c1e30e640 1 Processor -- start 2024-09-17T05:22:52.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.723+0000 7f4c1e30e640 1 -- start start 2024-09-17T05:22:52.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.724+0000 7f4c1e30e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c18074150 0x7f4c18147c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:52.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.724+0000 7f4c1e30e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c180746a0 0x7f4c18155880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:52.728 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.724+0000 7f4c1e30e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c180b43f0 0x7f4c1809cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:52.728 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.724+0000 7f4c1e30e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4c18073970 con 0x7f4c18074150 2024-09-17T05:22:52.728 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.724+0000 7f4c1e30e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4c180737f0 con 0x7f4c180b43f0 2024-09-17T05:22:52.728 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.724+0000 7f4c1e30e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f4c18073af0 con 0x7f4c180746a0 2024-09-17T05:22:52.728 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.724+0000 7f4c17fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c18074150 0x7f4c18147c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:52.728 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.724+0000 7f4c17fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c18074150 0x7f4c18147c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:52088/0 (socket says 172.21.15.98:52088) 2024-09-17T05:22:52.728 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.724+0000 7f4c17fff640 1 -- 172.21.15.98:0/2325395763 learned_addr learned my addr 172.21.15.98:0/2325395763 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:52.728 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.724+0000 7f4c1c8ab640 1 --2- 172.21.15.98:0/2325395763 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c180b43f0 0x7f4c1809cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:52.728 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.724+0000 7f4c177fe640 1 --2- 172.21.15.98:0/2325395763 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c180746a0 0x7f4c18155880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:52.728 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.724+0000 7f4c17fff640 1 -- 172.21.15.98:0/2325395763 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c180746a0 msgr2=0x7f4c18155880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:52.728 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.724+0000 7f4c17fff640 1 --2- 172.21.15.98:0/2325395763 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c180746a0 0x7f4c18155880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:52.728 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.724+0000 7f4c17fff640 1 -- 172.21.15.98:0/2325395763 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c180b43f0 msgr2=0x7f4c1809cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:52.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.724+0000 7f4c17fff640 1 --2- 172.21.15.98:0/2325395763 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c180b43f0 0x7f4c1809cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:52.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.724+0000 7f4c17fff640 1 -- 172.21.15.98:0/2325395763 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c1809c170 con 0x7f4c18074150 2024-09-17T05:22:52.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.725+0000 7f4c17fff640 1 --2- 172.21.15.98:0/2325395763 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c18074150 0x7f4c18147c30 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4c0800b3f0 tx=0x7f4c0800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:52.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.725+0000 7f4c14ff9640 1 -- 172.21.15.98:0/2325395763 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c08015020 con 0x7f4c18074150 2024-09-17T05:22:52.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.725+0000 7f4c14ff9640 1 -- 172.21.15.98:0/2325395763 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4c08011920 con 0x7f4c18074150 2024-09-17T05:22:52.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.725+0000 7f4c1e30e640 1 -- 172.21.15.98:0/2325395763 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c1809c450 con 0x7f4c18074150 2024-09-17T05:22:52.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.725+0000 7f4c14ff9640 1 -- 172.21.15.98:0/2325395763 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c08011d70 con 0x7f4c18074150 2024-09-17T05:22:52.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.725+0000 7f4c1e30e640 1 -- 172.21.15.98:0/2325395763 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c1809ca10 con 0x7f4c18074150 2024-09-17T05:22:52.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.726+0000 7f4c1e30e640 1 -- 172.21.15.98:0/2325395763 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c1809cc10 con 0x7f4c18074150 2024-09-17T05:22:52.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.727+0000 7f4c14ff9640 1 -- 172.21.15.98:0/2325395763 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 6) ==== 101594+0+0 (secure 0 0 0) 0x7f4c08018020 con 0x7f4c18074150 2024-09-17T05:22:52.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.727+0000 7f4c14ff9640 1 --2- 172.21.15.98:0/2325395763 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f4c04078d40 0x7f4c0407b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:52.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.727+0000 7f4c14ff9640 1 -- 172.21.15.98:0/2325395763 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f4c0809aed0 con 0x7f4c18074150 2024-09-17T05:22:52.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.727+0000 7f4c177fe640 1 --2- 172.21.15.98:0/2325395763 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f4c04078d40 0x7f4c0407b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:52.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.728+0000 7f4c177fe640 1 --2- 172.21.15.98:0/2325395763 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f4c04078d40 0x7f4c0407b200 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4c18151d00 tx=0x7f4c0c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:52.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.731+0000 7f4c14ff9640 1 -- 172.21.15.98:0/2325395763 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f4c0801f030 con 0x7f4c18074150 2024-09-17T05:22:52.919 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.917+0000 7f4c1e30e640 1 -- 172.21.15.98:0/2325395763 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4c180b47d0 con 0x7f4c18074150 2024-09-17T05:22:52.919 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.917+0000 7f4c14ff9640 1 -- 172.21.15.98:0/2325395763 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v32) ==== 80+0+0 (secure 0 0 0) 0x7f4c08062f70 con 0x7f4c18074150 2024-09-17T05:22:52.919 INFO:teuthology.orchestra.run.smithi098.stderr:listed 0 entries 2024-09-17T05:22:52.922 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.920+0000 7f4c1e30e640 1 -- 172.21.15.98:0/2325395763 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f4c04078d40 msgr2=0x7f4c0407b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:52.922 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.920+0000 7f4c1e30e640 1 --2- 172.21.15.98:0/2325395763 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f4c04078d40 0x7f4c0407b200 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4c18151d00 tx=0x7f4c0c009040 comp rx=0 tx=0).stop 2024-09-17T05:22:52.922 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.920+0000 7f4c1e30e640 1 -- 172.21.15.98:0/2325395763 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c18074150 msgr2=0x7f4c18147c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:52.922 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.920+0000 7f4c1e30e640 1 --2- 172.21.15.98:0/2325395763 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c18074150 0x7f4c18147c30 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4c0800b3f0 tx=0x7f4c0800b8b0 comp rx=0 tx=0).stop 2024-09-17T05:22:52.922 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.920+0000 7f4c1e30e640 1 -- 172.21.15.98:0/2325395763 shutdown_connections 2024-09-17T05:22:52.922 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.920+0000 7f4c1e30e640 1 --2- 172.21.15.98:0/2325395763 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f4c04078d40 0x7f4c0407b200 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:52.922 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.920+0000 7f4c1e30e640 1 --2- 172.21.15.98:0/2325395763 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c180b43f0 0x7f4c1809cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:52.922 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.920+0000 7f4c1e30e640 1 --2- 172.21.15.98:0/2325395763 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c180746a0 0x7f4c18155880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:52.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.920+0000 7f4c1e30e640 1 --2- 172.21.15.98:0/2325395763 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c18074150 0x7f4c18147c30 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:52.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.920+0000 7f4c1e30e640 1 -- 172.21.15.98:0/2325395763 >> 172.21.15.98:0/2325395763 conn(0x7f4c180b1950 msgr2=0x7f4c180cc550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:52.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.920+0000 7f4c1e30e640 1 -- 172.21.15.98:0/2325395763 shutdown_connections 2024-09-17T05:22:52.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:52.920+0000 7f4c1e30e640 1 -- 172.21.15.98:0/2325395763 wait complete. 2024-09-17T05:22:52.933 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-17T05:22:52.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:52.933 DEBUG:teuthology.orchestra.run.smithi167:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-17T05:22:52.967 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi167.front.sepia.ceph.com 2024-09-17T05:22:52.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:52.968 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-17T05:22:53.027 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:22:53.027 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T05:22:53.027 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:22:53.044 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18775 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:22:53.044 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:22:53.044 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-17T05:22:53.044 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:22:53.085 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056027,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16784 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:22:53.085 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:22:53.186 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.184+0000 7fb49f36b640 1 -- 172.21.15.98:0/3055415479 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb4980746a0 msgr2=0x7fb4980732b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:53.186 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.184+0000 7fb49f36b640 1 --2- 172.21.15.98:0/3055415479 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb4980746a0 0x7fb4980732b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fb49000aa10 tx=0x7fb49002b8b0 comp rx=0 tx=0).stop 2024-09-17T05:22:53.186 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.184+0000 7fb49f36b640 1 -- 172.21.15.98:0/3055415479 shutdown_connections 2024-09-17T05:22:53.186 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.184+0000 7fb49f36b640 1 --2- 172.21.15.98:0/3055415479 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb4980746a0 0x7fb4980732b0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:53.186 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.184+0000 7fb49f36b640 1 -- 172.21.15.98:0/3055415479 >> 172.21.15.98:0/3055415479 conn(0x7fb4980b1950 msgr2=0x7fb4980b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:53.186 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.184+0000 7fb49f36b640 1 -- 172.21.15.98:0/3055415479 shutdown_connections 2024-09-17T05:22:53.186 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.184+0000 7fb49f36b640 1 -- 172.21.15.98:0/3055415479 wait complete. 2024-09-17T05:22:53.187 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.185+0000 7fb49f36b640 1 Processor -- start 2024-09-17T05:22:53.187 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.185+0000 7fb49f36b640 1 -- start start 2024-09-17T05:22:53.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.186+0000 7fb49f36b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb498074150 0x7fb4981f4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:53.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.186+0000 7fb49f36b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb4980746a0 0x7fb498159a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:53.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.186+0000 7fb49f36b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb4980b43f0 0x7fb498151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:53.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.186+0000 7fb49f36b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb498073970 con 0x7fb4980b43f0 2024-09-17T05:22:53.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.186+0000 7fb49f36b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb4980737f0 con 0x7fb498074150 2024-09-17T05:22:53.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.186+0000 7fb49f36b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fb498073af0 con 0x7fb4980746a0 2024-09-17T05:22:53.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.186+0000 7fb49d908640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb4980b43f0 0x7fb498151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:53.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.186+0000 7fb49d908640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb4980b43f0 0x7fb498151200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:52104/0 (socket says 172.21.15.98:52104) 2024-09-17T05:22:53.190 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.186+0000 7fb49d908640 1 -- 172.21.15.98:0/2014932670 learned_addr learned my addr 172.21.15.98:0/2014932670 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:53.190 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.186+0000 7fb49d107640 1 --2- 172.21.15.98:0/2014932670 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb498074150 0x7fb4981f4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:53.190 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.186+0000 7fb49c906640 1 --2- 172.21.15.98:0/2014932670 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb4980746a0 0x7fb498159a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:53.190 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.186+0000 7fb49d908640 1 -- 172.21.15.98:0/2014932670 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb4980746a0 msgr2=0x7fb498159a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:53.190 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.186+0000 7fb49d908640 1 --2- 172.21.15.98:0/2014932670 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb4980746a0 0x7fb498159a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:53.190 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.186+0000 7fb49d908640 1 -- 172.21.15.98:0/2014932670 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb498074150 msgr2=0x7fb4981f4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:53.190 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.186+0000 7fb49d908640 1 --2- 172.21.15.98:0/2014932670 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb498074150 0x7fb4981f4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:53.190 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.186+0000 7fb49d908640 1 -- 172.21.15.98:0/2014932670 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4981f50d0 con 0x7fb4980b43f0 2024-09-17T05:22:53.190 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.186+0000 7fb49d107640 1 --2- 172.21.15.98:0/2014932670 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb498074150 0x7fb4981f4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:22:53.190 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.186+0000 7fb49d908640 1 --2- 172.21.15.98:0/2014932670 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb4980b43f0 0x7fb498151200 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb49000a340 tx=0x7fb490003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:53.190 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.187+0000 7fb495ffb640 1 -- 172.21.15.98:0/2014932670 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb490040070 con 0x7fb4980b43f0 2024-09-17T05:22:53.190 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.187+0000 7fb495ffb640 1 -- 172.21.15.98:0/2014932670 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb4900047a0 con 0x7fb4980b43f0 2024-09-17T05:22:53.190 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.187+0000 7fb49f36b640 1 -- 172.21.15.98:0/2014932670 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4981e4590 con 0x7fb4980b43f0 2024-09-17T05:22:53.191 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.187+0000 7fb495ffb640 1 -- 172.21.15.98:0/2014932670 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb490004b90 con 0x7fb4980b43f0 2024-09-17T05:22:53.191 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.187+0000 7fb49f36b640 1 -- 172.21.15.98:0/2014932670 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4981e3130 con 0x7fb4980b43f0 2024-09-17T05:22:53.191 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.188+0000 7fb49f36b640 1 -- 172.21.15.98:0/2014932670 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4980b47d0 con 0x7fb4980b43f0 2024-09-17T05:22:53.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.188+0000 7fb495ffb640 1 -- 172.21.15.98:0/2014932670 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 6) ==== 101594+0+0 (secure 0 0 0) 0x7fb490039040 con 0x7fb4980b43f0 2024-09-17T05:22:53.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.189+0000 7fb495ffb640 1 --2- 172.21.15.98:0/2014932670 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fb484078d40 0x7fb48407b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:53.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.189+0000 7fb495ffb640 1 -- 172.21.15.98:0/2014932670 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fb4900bd4e0 con 0x7fb4980b43f0 2024-09-17T05:22:53.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.189+0000 7fb49d107640 1 --2- 172.21.15.98:0/2014932670 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fb484078d40 0x7fb48407b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:53.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.190+0000 7fb49d107640 1 --2- 172.21.15.98:0/2014932670 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fb484078d40 0x7fb48407b200 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb4880012e0 tx=0x7fb488009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:53.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.193+0000 7fb495ffb640 1 -- 172.21.15.98:0/2014932670 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fb4981f50d0 con 0x7fb4980b43f0 2024-09-17T05:22:53.408 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.406+0000 7fb49f36b640 1 -- 172.21.15.98:0/2014932670 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb4980ad950 con 0x7fb4980b43f0 2024-09-17T05:22:53.408 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.407+0000 7fb495ffb640 1 -- 172.21.15.98:0/2014932670 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5226 (secure 0 0 0) 0x7fb490085620 con 0x7fb4980b43f0 2024-09-17T05:22:53.409 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:22:53.409 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":15,"btime":"2024-09-17T05:22:45:321886+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4771,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/387934311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":387934311},{"type":"v1","addr":"172.21.15.167:6836","nonce":387934311}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4878,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6834/2571517660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2571517660},{"type":"v1","addr":"172.21.15.98:6834","nonce":2571517660}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4881,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/1837285444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6833","nonce":1837285444},{"type":"v1","addr":"172.21.15.98:6835","nonce":1837285444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:22:32.448852+0000","modified":"2024-09-17T05:22:34.449535+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4890},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4890":{"gid":4890,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6837/3889162905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":3889162905},{"type":"v1","addr":"172.21.15.167:6837","nonce":3889162905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4890,"qdb_cluster":[4890]},"id":2}]} 2024-09-17T05:22:53.409 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 15 2024-09-17T05:22:53.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.409+0000 7fb49f36b640 1 -- 172.21.15.98:0/2014932670 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fb484078d40 msgr2=0x7fb48407b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:53.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.409+0000 7fb49f36b640 1 --2- 172.21.15.98:0/2014932670 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fb484078d40 0x7fb48407b200 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb4880012e0 tx=0x7fb488009040 comp rx=0 tx=0).stop 2024-09-17T05:22:53.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.409+0000 7fb49f36b640 1 -- 172.21.15.98:0/2014932670 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb4980b43f0 msgr2=0x7fb498151200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:53.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.409+0000 7fb49f36b640 1 --2- 172.21.15.98:0/2014932670 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb4980b43f0 0x7fb498151200 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb49000a340 tx=0x7fb490003b90 comp rx=0 tx=0).stop 2024-09-17T05:22:53.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.409+0000 7fb49f36b640 1 -- 172.21.15.98:0/2014932670 shutdown_connections 2024-09-17T05:22:53.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.409+0000 7fb49f36b640 1 --2- 172.21.15.98:0/2014932670 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fb484078d40 0x7fb48407b200 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:53.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.409+0000 7fb49f36b640 1 --2- 172.21.15.98:0/2014932670 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb4980b43f0 0x7fb498151200 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:53.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.409+0000 7fb49f36b640 1 --2- 172.21.15.98:0/2014932670 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb4980746a0 0x7fb498159a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:53.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.409+0000 7fb49f36b640 1 --2- 172.21.15.98:0/2014932670 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb498074150 0x7fb4981f4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:53.412 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.409+0000 7fb49f36b640 1 -- 172.21.15.98:0/2014932670 >> 172.21.15.98:0/2014932670 conn(0x7fb4980b1950 msgr2=0x7fb4980ae6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:53.412 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.409+0000 7fb49f36b640 1 -- 172.21.15.98:0/2014932670 shutdown_connections 2024-09-17T05:22:53.412 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.409+0000 7fb49f36b640 1 -- 172.21.15.98:0/2014932670 wait complete. 2024-09-17T05:22:53.422 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:22:53.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.521+0000 7fcad0ae6640 1 -- 172.21.15.98:0/243342041 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcacc0b4ca0 msgr2=0x7fcacc15e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:53.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.521+0000 7fcad0ae6640 1 --2- 172.21.15.98:0/243342041 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcacc0b4ca0 0x7fcacc15e970 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fcac4005fd0 tx=0x7fcac402aa50 comp rx=0 tx=0).stop 2024-09-17T05:22:53.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.521+0000 7fcad0ae6640 1 -- 172.21.15.98:0/243342041 shutdown_connections 2024-09-17T05:22:53.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.521+0000 7fcad0ae6640 1 --2- 172.21.15.98:0/243342041 >> v2:172.21.15.167:3300/0 conn(0x7fcacc0ccfd0 0x7fcacc0cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:53.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.521+0000 7fcad0ae6640 1 --2- 172.21.15.98:0/243342041 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcacc0b4ca0 0x7fcacc15e970 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:53.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.521+0000 7fcad0ae6640 1 --2- 172.21.15.98:0/243342041 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcacc1445d0 0x7fcacc0cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:53.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.521+0000 7fcad0ae6640 1 -- 172.21.15.98:0/243342041 >> 172.21.15.98:0/243342041 conn(0x7fcacc0b1950 msgr2=0x7fcacc0b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:53.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.521+0000 7fcad0ae6640 1 -- 172.21.15.98:0/243342041 shutdown_connections 2024-09-17T05:22:53.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.521+0000 7fcad0ae6640 1 -- 172.21.15.98:0/243342041 wait complete. 2024-09-17T05:22:53.528 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.522+0000 7fcad0ae6640 1 Processor -- start 2024-09-17T05:22:53.528 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.523+0000 7fcad0ae6640 1 -- start start 2024-09-17T05:22:53.528 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.523+0000 7fcad0ae6640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcacc0b4ca0 0x7fcacc13ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:53.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.523+0000 7fcad0ae6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcacc0ccfd0 0x7fcacc13f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:53.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.523+0000 7fcad0ae6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcacc1445d0 0x7fcacc1f64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:53.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.523+0000 7fcad0ae6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fcacc15f240 con 0x7fcacc0ccfd0 2024-09-17T05:22:53.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.523+0000 7fcad0ae6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fcacc15f0c0 con 0x7fcacc1445d0 2024-09-17T05:22:53.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.523+0000 7fcad0ae6640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fcacc15f3c0 con 0x7fcacc0b4ca0 2024-09-17T05:22:53.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.523+0000 7fcac9d9b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcacc0ccfd0 0x7fcacc13f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:53.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.523+0000 7fcac9d9b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcacc0ccfd0 0x7fcacc13f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:52130/0 (socket says 172.21.15.98:52130) 2024-09-17T05:22:53.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.523+0000 7fcac9d9b640 1 -- 172.21.15.98:0/4207612297 learned_addr learned my addr 172.21.15.98:0/4207612297 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:53.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.523+0000 7fcaca59c640 1 --2- 172.21.15.98:0/4207612297 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcacc0b4ca0 0x7fcacc13ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:53.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.523+0000 7fcacad9d640 1 --2- 172.21.15.98:0/4207612297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcacc1445d0 0x7fcacc1f64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:53.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.524+0000 7fcac9d9b640 1 -- 172.21.15.98:0/4207612297 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcacc0b4ca0 msgr2=0x7fcacc13ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:53.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.524+0000 7fcac9d9b640 1 --2- 172.21.15.98:0/4207612297 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcacc0b4ca0 0x7fcacc13ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:53.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.524+0000 7fcac9d9b640 1 -- 172.21.15.98:0/4207612297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcacc1445d0 msgr2=0x7fcacc1f64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:53.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.524+0000 7fcac9d9b640 1 --2- 172.21.15.98:0/4207612297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcacc1445d0 0x7fcacc1f64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:53.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.524+0000 7fcac9d9b640 1 -- 172.21.15.98:0/4207612297 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcacc140d10 con 0x7fcacc0ccfd0 2024-09-17T05:22:53.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.524+0000 7fcac9d9b640 1 --2- 172.21.15.98:0/4207612297 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcacc0ccfd0 0x7fcacc13f220 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fcac0005940 tx=0x7fcac000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:53.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.524+0000 7fcabaffd640 1 -- 172.21.15.98:0/4207612297 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac0007bb0 con 0x7fcacc0ccfd0 2024-09-17T05:22:53.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.524+0000 7fcabaffd640 1 -- 172.21.15.98:0/4207612297 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcac0007e40 con 0x7fcacc0ccfd0 2024-09-17T05:22:53.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.524+0000 7fcad0ae6640 1 -- 172.21.15.98:0/4207612297 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcacc140f90 con 0x7fcacc0ccfd0 2024-09-17T05:22:53.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.524+0000 7fcabaffd640 1 -- 172.21.15.98:0/4207612297 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac000f6b0 con 0x7fcacc0ccfd0 2024-09-17T05:22:53.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.524+0000 7fcad0ae6640 1 -- 172.21.15.98:0/4207612297 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcacc141530 con 0x7fcacc0ccfd0 2024-09-17T05:22:53.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.525+0000 7fcad0ae6640 1 -- 172.21.15.98:0/4207612297 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcacc143e10 con 0x7fcacc0ccfd0 2024-09-17T05:22:53.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.526+0000 7fcabaffd640 1 -- 172.21.15.98:0/4207612297 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 6) ==== 101594+0+0 (secure 0 0 0) 0x7fcac000f850 con 0x7fcacc0ccfd0 2024-09-17T05:22:53.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.526+0000 7fcabaffd640 1 --2- 172.21.15.98:0/4207612297 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fcaac078d40 0x7fcaac07b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:53.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.526+0000 7fcabaffd640 1 -- 172.21.15.98:0/4207612297 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fcac009b7e0 con 0x7fcacc0ccfd0 2024-09-17T05:22:53.531 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.526+0000 7fcaca59c640 1 --2- 172.21.15.98:0/4207612297 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fcaac078d40 0x7fcaac07b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:53.531 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.527+0000 7fcaca59c640 1 --2- 172.21.15.98:0/4207612297 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fcaac078d40 0x7fcaac07b200 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcabc0058c0 tx=0x7fcabc005f60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:53.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.530+0000 7fcabaffd640 1 -- 172.21.15.98:0/4207612297 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fcacc143e10 con 0x7fcacc0ccfd0 2024-09-17T05:22:53.747 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.745+0000 7fcad0ae6640 1 -- 172.21.15.98:0/4207612297 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcacc070a20 con 0x7fcacc0ccfd0 2024-09-17T05:22:53.747 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.745+0000 7fcabaffd640 1 -- 172.21.15.98:0/4207612297 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5226 (secure 0 0 0) 0x7fcacc140d10 con 0x7fcacc0ccfd0 2024-09-17T05:22:53.747 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:22:53.748 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":15,"btime":"2024-09-17T05:22:45:321886+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4771,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/387934311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":387934311},{"type":"v1","addr":"172.21.15.167:6836","nonce":387934311}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4878,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6834/2571517660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2571517660},{"type":"v1","addr":"172.21.15.98:6834","nonce":2571517660}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4881,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/1837285444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6833","nonce":1837285444},{"type":"v1","addr":"172.21.15.98:6835","nonce":1837285444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:22:32.448852+0000","modified":"2024-09-17T05:22:34.449535+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4890},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4890":{"gid":4890,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6837/3889162905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":3889162905},{"type":"v1","addr":"172.21.15.167:6837","nonce":3889162905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4890,"qdb_cluster":[4890]},"id":2}]} 2024-09-17T05:22:53.748 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 15 2024-09-17T05:22:53.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.747+0000 7fcad0ae6640 1 -- 172.21.15.98:0/4207612297 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fcaac078d40 msgr2=0x7fcaac07b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:53.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.747+0000 7fcad0ae6640 1 --2- 172.21.15.98:0/4207612297 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fcaac078d40 0x7fcaac07b200 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcabc0058c0 tx=0x7fcabc005f60 comp rx=0 tx=0).stop 2024-09-17T05:22:53.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.747+0000 7fcad0ae6640 1 -- 172.21.15.98:0/4207612297 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcacc0ccfd0 msgr2=0x7fcacc13f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:53.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.747+0000 7fcad0ae6640 1 --2- 172.21.15.98:0/4207612297 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcacc0ccfd0 0x7fcacc13f220 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fcac0005940 tx=0x7fcac000cd60 comp rx=0 tx=0).stop 2024-09-17T05:22:53.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.748+0000 7fcad0ae6640 1 -- 172.21.15.98:0/4207612297 shutdown_connections 2024-09-17T05:22:53.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.748+0000 7fcad0ae6640 1 --2- 172.21.15.98:0/4207612297 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fcaac078d40 0x7fcaac07b200 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:53.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.748+0000 7fcad0ae6640 1 --2- 172.21.15.98:0/4207612297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcacc1445d0 0x7fcacc1f64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:53.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.748+0000 7fcad0ae6640 1 --2- 172.21.15.98:0/4207612297 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcacc0ccfd0 0x7fcacc13f220 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:53.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.748+0000 7fcad0ae6640 1 --2- 172.21.15.98:0/4207612297 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcacc0b4ca0 0x7fcacc13ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:53.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.748+0000 7fcad0ae6640 1 -- 172.21.15.98:0/4207612297 >> 172.21.15.98:0/4207612297 conn(0x7fcacc0b1950 msgr2=0x7fcacc0cdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:53.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.748+0000 7fcad0ae6640 1 -- 172.21.15.98:0/4207612297 shutdown_connections 2024-09-17T05:22:53.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.748+0000 7fcad0ae6640 1 -- 172.21.15.98:0/4207612297 wait complete. 2024-09-17T05:22:53.760 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:22:53.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.860+0000 7f1bf8390640 1 -- 172.21.15.98:0/3739085607 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1bf00ccfd0 msgr2=0x7f1bf00cf130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:53.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.860+0000 7f1bf8390640 1 --2- 172.21.15.98:0/3739085607 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1bf00ccfd0 0x7f1bf00cf130 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f1be0005fd0 tx=0x7f1be002a6c0 comp rx=0 tx=0).stop 2024-09-17T05:22:53.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.860+0000 7f1bf8390640 1 -- 172.21.15.98:0/3739085607 shutdown_connections 2024-09-17T05:22:53.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.860+0000 7f1bf8390640 1 --2- 172.21.15.98:0/3739085607 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1bf00ccfd0 0x7f1bf00cf130 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:53.863 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.860+0000 7f1bf8390640 1 --2- 172.21.15.98:0/3739085607 >> v2:172.21.15.167:3300/0 conn(0x7f1bf01445d0 0x7f1bf00cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:53.863 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.860+0000 7f1bf8390640 1 -- 172.21.15.98:0/3739085607 >> 172.21.15.98:0/3739085607 conn(0x7f1bf00b1950 msgr2=0x7f1bf00b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:53.863 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.860+0000 7f1bf8390640 1 -- 172.21.15.98:0/3739085607 shutdown_connections 2024-09-17T05:22:53.863 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.860+0000 7f1bf8390640 1 -- 172.21.15.98:0/3739085607 wait complete. 2024-09-17T05:22:53.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.861+0000 7f1bf8390640 1 Processor -- start 2024-09-17T05:22:53.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.861+0000 7f1bf8390640 1 -- start start 2024-09-17T05:22:53.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.862+0000 7f1bf8390640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1bf00b4ca0 0x7f1bf00cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:53.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.862+0000 7f1bf8390640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1bf00ccfd0 0x7f1bf00cb380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:53.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.862+0000 7f1bf8390640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1bf01445d0 0x7f1bf00cb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:53.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.862+0000 7f1bf8390640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1bf015f080 con 0x7f1bf01445d0 2024-09-17T05:22:53.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.862+0000 7f1bf8390640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1bf0073bc0 con 0x7f1bf00b4ca0 2024-09-17T05:22:53.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.862+0000 7f1bf8390640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f1bf015f200 con 0x7f1bf00ccfd0 2024-09-17T05:22:53.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.862+0000 7f1bf692d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1bf01445d0 0x7f1bf00cb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:53.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.862+0000 7f1bf692d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1bf01445d0 0x7f1bf00cb8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:52154/0 (socket says 172.21.15.98:52154) 2024-09-17T05:22:53.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.862+0000 7f1bf692d640 1 -- 172.21.15.98:0/3130959340 learned_addr learned my addr 172.21.15.98:0/3130959340 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:53.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.862+0000 7f1bf612c640 1 --2- 172.21.15.98:0/3130959340 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1bf00b4ca0 0x7f1bf00cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:53.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.862+0000 7f1bf592b640 1 --2- 172.21.15.98:0/3130959340 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1bf00ccfd0 0x7f1bf00cb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:53.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.862+0000 7f1bf692d640 1 -- 172.21.15.98:0/3130959340 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1bf00ccfd0 msgr2=0x7f1bf00cb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:53.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.862+0000 7f1bf692d640 1 --2- 172.21.15.98:0/3130959340 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1bf00ccfd0 0x7f1bf00cb380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:53.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.862+0000 7f1bf692d640 1 -- 172.21.15.98:0/3130959340 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1bf00b4ca0 msgr2=0x7f1bf00cdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:53.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.862+0000 7f1bf692d640 1 --2- 172.21.15.98:0/3130959340 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1bf00b4ca0 0x7f1bf00cdae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:53.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.862+0000 7f1bf692d640 1 -- 172.21.15.98:0/3130959340 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bf00ce410 con 0x7f1bf01445d0 2024-09-17T05:22:53.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.863+0000 7f1bf692d640 1 --2- 172.21.15.98:0/3130959340 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1bf01445d0 0x7f1bf00cb8c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f1be800c7d0 tx=0x7f1be800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:53.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.863+0000 7f1be6ffd640 1 -- 172.21.15.98:0/3130959340 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be8003b70 con 0x7f1bf01445d0 2024-09-17T05:22:53.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.863+0000 7f1be6ffd640 1 -- 172.21.15.98:0/3130959340 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1be8003d10 con 0x7f1bf01445d0 2024-09-17T05:22:53.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.863+0000 7f1bf8390640 1 -- 172.21.15.98:0/3130959340 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bf01f54d0 con 0x7f1bf01445d0 2024-09-17T05:22:53.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.863+0000 7f1be6ffd640 1 -- 172.21.15.98:0/3130959340 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be800aab0 con 0x7f1bf01445d0 2024-09-17T05:22:53.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.863+0000 7f1bf8390640 1 -- 172.21.15.98:0/3130959340 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bf01f5180 con 0x7f1bf01445d0 2024-09-17T05:22:53.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.864+0000 7f1bf8390640 1 -- 172.21.15.98:0/3130959340 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bf015f720 con 0x7f1bf01445d0 2024-09-17T05:22:53.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.864+0000 7f1be6ffd640 1 -- 172.21.15.98:0/3130959340 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 6) ==== 101594+0+0 (secure 0 0 0) 0x7f1be800ac70 con 0x7f1bf01445d0 2024-09-17T05:22:53.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.865+0000 7f1be6ffd640 1 --2- 172.21.15.98:0/3130959340 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f1bd4078d40 0x7f1bd407b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:53.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.865+0000 7f1be6ffd640 1 -- 172.21.15.98:0/3130959340 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f1be809ae70 con 0x7f1bf01445d0 2024-09-17T05:22:53.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.865+0000 7f1bf612c640 1 --2- 172.21.15.98:0/3130959340 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f1bd4078d40 0x7f1bd407b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:53.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.865+0000 7f1bf612c640 1 --2- 172.21.15.98:0/3130959340 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f1bd4078d40 0x7f1bd407b200 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1bec009b30 tx=0x7f1bec005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:53.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:53.869+0000 7f1be6ffd640 1 -- 172.21.15.98:0/3130959340 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f1be8062960 con 0x7f1bf01445d0 2024-09-17T05:22:54.046 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.044+0000 7f1bf8390640 1 -- 172.21.15.98:0/3130959340 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1bf0070a20 con 0x7f1bf01445d0 2024-09-17T05:22:54.047 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.045+0000 7f1be6ffd640 1 -- 172.21.15.98:0/3130959340 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16717 (secure 0 0 0) 0x7f1be8067390 con 0x7f1bf01445d0 2024-09-17T05:22:54.047 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:22:54.047 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":32,"fsid":"fcbf5a43-b3d8-497c-b15d-3cc022477cf0","created":"2024-09-17T05:21:29.852143+0000","modified":"2024-09-17T05:22:34.108589+0000","last_up_change":"2024-09-17T05:21:42.925756+0000","last_in_change":"2024-09-17T05:21:32.893880+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:21:42.263011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:22:30.174068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-17T05:22:31.410605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ad711a-df74-438b-b0dc-1499d685c958","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6825","nonce":3644101529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6827","nonce":3644101529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6831","nonce":3644101529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6829","nonce":3644101529}]},"public_addr":"172.21.15.98:6825/3644101529","cluster_addr":"172.21.15.98:6827/3644101529","heartbeat_back_addr":"172.21.15.98:6831/3644101529","heartbeat_front_addr":"172.21.15.98:6829/3644101529","state":["exists","up"]},{"osd":1,"uuid":"f0ccb08d-4d8d-47b8-9320-8c372a6605b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6817","nonce":3902180920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6819","nonce":3902180920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6823","nonce":3902180920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6821","nonce":3902180920}]},"public_addr":"172.21.15.98:6817/3902180920","cluster_addr":"172.21.15.98:6819/3902180920","heartbeat_back_addr":"172.21.15.98:6823/3902180920","heartbeat_front_addr":"172.21.15.98:6821/3902180920","state":["exists","up"]},{"osd":2,"uuid":"a0985398-5e5f-494f-8abf-f785f19e94ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6801","nonce":1518887101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6803","nonce":1518887101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6807","nonce":1518887101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6805","nonce":1518887101}]},"public_addr":"172.21.15.98:6801/1518887101","cluster_addr":"172.21.15.98:6803/1518887101","heartbeat_back_addr":"172.21.15.98:6807/1518887101","heartbeat_front_addr":"172.21.15.98:6805/1518887101","state":["exists","up"]},{"osd":3,"uuid":"e960be2e-0c3a-426e-9507-d3be5895f9e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6809","nonce":4125246091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6811","nonce":4125246091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6815","nonce":4125246091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6813","nonce":4125246091}]},"public_addr":"172.21.15.98:6809/4125246091","cluster_addr":"172.21.15.98:6811/4125246091","heartbeat_back_addr":"172.21.15.98:6815/4125246091","heartbeat_front_addr":"172.21.15.98:6813/4125246091","state":["exists","up"]},{"osd":4,"uuid":"49118c00-3dc1-43ef-8ed4-aca61e56a507","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6811","nonce":765789888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6813","nonce":765789888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6817","nonce":765789888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6815","nonce":765789888}]},"public_addr":"172.21.15.167:6811/765789888","cluster_addr":"172.21.15.167:6813/765789888","heartbeat_back_addr":"172.21.15.167:6817/765789888","heartbeat_front_addr":"172.21.15.167:6815/765789888","state":["exists","up"]},{"osd":5,"uuid":"9f4e0143-2b3d-40e4-bfb5-043d9a9f4ba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6803","nonce":2567019914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6805","nonce":2567019914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6809","nonce":2567019914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6807","nonce":2567019914}]},"public_addr":"172.21.15.167:6803/2567019914","cluster_addr":"172.21.15.167:6805/2567019914","heartbeat_back_addr":"172.21.15.167:6809/2567019914","heartbeat_front_addr":"172.21.15.167:6807/2567019914","state":["exists","up"]},{"osd":6,"uuid":"28720514-e627-4dea-8f4d-bd311ec31361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6819","nonce":96262631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6821","nonce":96262631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6825","nonce":96262631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6823","nonce":96262631}]},"public_addr":"172.21.15.167:6819/96262631","cluster_addr":"172.21.15.167:6821/96262631","heartbeat_back_addr":"172.21.15.167:6825/96262631","heartbeat_front_addr":"172.21.15.167:6823/96262631","state":["exists","up"]},{"osd":7,"uuid":"01edaf9c-3898-406e-85b0-774cfda60adf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6827","nonce":4169560909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6829","nonce":4169560909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6833","nonce":4169560909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6831","nonce":4169560909}]},"public_addr":"172.21.15.167:6827/4169560909","cluster_addr":"172.21.15.167:6829/4169560909","heartbeat_back_addr":"172.21.15.167:6833/4169560909","heartbeat_front_addr":"172.21.15.167:6831/4169560909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:40.054920+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.177110+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.749278+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.400155+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.503576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.196417+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.371063+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.212852+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:22:54.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.048+0000 7f1bf8390640 1 -- 172.21.15.98:0/3130959340 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f1bd4078d40 msgr2=0x7f1bd407b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:54.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.048+0000 7f1bf8390640 1 --2- 172.21.15.98:0/3130959340 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f1bd4078d40 0x7f1bd407b200 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1bec009b30 tx=0x7f1bec005f90 comp rx=0 tx=0).stop 2024-09-17T05:22:54.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.048+0000 7f1bf8390640 1 -- 172.21.15.98:0/3130959340 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1bf01445d0 msgr2=0x7f1bf00cb8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:54.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.048+0000 7f1bf8390640 1 --2- 172.21.15.98:0/3130959340 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1bf01445d0 0x7f1bf00cb8c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f1be800c7d0 tx=0x7f1be800cc90 comp rx=0 tx=0).stop 2024-09-17T05:22:54.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.048+0000 7f1bf8390640 1 -- 172.21.15.98:0/3130959340 shutdown_connections 2024-09-17T05:22:54.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.048+0000 7f1bf8390640 1 --2- 172.21.15.98:0/3130959340 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f1bd4078d40 0x7f1bd407b200 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:54.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.048+0000 7f1bf8390640 1 --2- 172.21.15.98:0/3130959340 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1bf01445d0 0x7f1bf00cb8c0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:54.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.048+0000 7f1bf8390640 1 --2- 172.21.15.98:0/3130959340 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1bf00ccfd0 0x7f1bf00cb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:54.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.048+0000 7f1bf8390640 1 --2- 172.21.15.98:0/3130959340 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1bf00b4ca0 0x7f1bf00cdae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:54.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.048+0000 7f1bf8390640 1 -- 172.21.15.98:0/3130959340 >> 172.21.15.98:0/3130959340 conn(0x7f1bf00b1950 msgr2=0x7f1bf00b1070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:54.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.048+0000 7f1bf8390640 1 -- 172.21.15.98:0/3130959340 shutdown_connections 2024-09-17T05:22:54.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.048+0000 7f1bf8390640 1 -- 172.21.15.98:0/3130959340 wait complete. 2024-09-17T05:22:54.061 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T05:22:54.061 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:22:54.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.162+0000 7f2901375640 1 -- 172.21.15.98:0/371404519 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28fc0d1610 msgr2=0x7f28fc0cecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:54.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.162+0000 7f2901375640 1 --2- 172.21.15.98:0/371404519 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28fc0d1610 0x7f28fc0cecc0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f28fc0d4f60 tx=0x7f28f402a8b0 comp rx=0 tx=0).stop 2024-09-17T05:22:54.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.162+0000 7f2901375640 1 -- 172.21.15.98:0/371404519 shutdown_connections 2024-09-17T05:22:54.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.162+0000 7f2901375640 1 --2- 172.21.15.98:0/371404519 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28fc0d1610 0x7f28fc0cecc0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:54.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.162+0000 7f2901375640 1 --2- 172.21.15.98:0/371404519 >> v2:172.21.15.167:3300/0 conn(0x7f28fc0d2050 0x7f28fc0d10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:54.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.162+0000 7f2901375640 1 -- 172.21.15.98:0/371404519 >> 172.21.15.98:0/371404519 conn(0x7f28fc0d3fe0 msgr2=0x7f28fc0d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:54.172 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.163+0000 7f2901375640 1 -- 172.21.15.98:0/371404519 shutdown_connections 2024-09-17T05:22:54.172 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.163+0000 7f2901375640 1 -- 172.21.15.98:0/371404519 wait complete. 2024-09-17T05:22:54.172 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.164+0000 7f2901375640 1 Processor -- start 2024-09-17T05:22:54.172 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.164+0000 7f2901375640 1 -- start start 2024-09-17T05:22:54.172 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.164+0000 7f2901375640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28fc0d1610 0x7f28fc0cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:54.173 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.164+0000 7f2901375640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28fc0d2050 0x7f28fc159d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:54.173 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.164+0000 7f2901375640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28fc15e0d0 0x7f28fc15a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:54.173 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.164+0000 7f2901375640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f28fc0cf610 con 0x7f28fc15e0d0 2024-09-17T05:22:54.173 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.164+0000 7f2901375640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f28fc0cf490 con 0x7f28fc0d1610 2024-09-17T05:22:54.173 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.164+0000 7f2901375640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f28fc0cf790 con 0x7f28fc0d2050 2024-09-17T05:22:54.173 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.165+0000 7f28fb7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28fc15e0d0 0x7f28fc15a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:54.174 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.165+0000 7f28fb7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28fc15e0d0 0x7f28fc15a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:52172/0 (socket says 172.21.15.98:52172) 2024-09-17T05:22:54.174 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.165+0000 7f28fb7fe640 1 -- 172.21.15.98:0/2001514453 learned_addr learned my addr 172.21.15.98:0/2001514453 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:54.174 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.165+0000 7f28faffd640 1 --2- 172.21.15.98:0/2001514453 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28fc0d1610 0x7f28fc0cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:54.174 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.165+0000 7f28f3fff640 1 --2- 172.21.15.98:0/2001514453 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28fc0d2050 0x7f28fc159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:54.174 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.165+0000 7f28fb7fe640 1 -- 172.21.15.98:0/2001514453 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28fc0d2050 msgr2=0x7f28fc159d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:54.174 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.165+0000 7f28fb7fe640 1 --2- 172.21.15.98:0/2001514453 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28fc0d2050 0x7f28fc159d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:54.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.165+0000 7f28fb7fe640 1 -- 172.21.15.98:0/2001514453 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28fc0d1610 msgr2=0x7f28fc0cb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:54.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.165+0000 7f28fb7fe640 1 --2- 172.21.15.98:0/2001514453 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28fc0d1610 0x7f28fc0cb0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:54.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.165+0000 7f28fb7fe640 1 -- 172.21.15.98:0/2001514453 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28fc15bd30 con 0x7f28fc15e0d0 2024-09-17T05:22:54.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.165+0000 7f28f3fff640 1 --2- 172.21.15.98:0/2001514453 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28fc0d2050 0x7f28fc159d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:22:54.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.165+0000 7f28fb7fe640 1 --2- 172.21.15.98:0/2001514453 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28fc15e0d0 0x7f28fc15a250 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f28f4009ca0 tx=0x7f28f4003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:54.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.165+0000 7f28f37fe640 1 -- 172.21.15.98:0/2001514453 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f4040070 con 0x7f28fc15e0d0 2024-09-17T05:22:54.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.165+0000 7f28f37fe640 1 -- 172.21.15.98:0/2001514453 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f28f4004130 con 0x7f28fc15e0d0 2024-09-17T05:22:54.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.165+0000 7f2901375640 1 -- 172.21.15.98:0/2001514453 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28fc15ac90 con 0x7f28fc15e0d0 2024-09-17T05:22:54.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.165+0000 7f28f37fe640 1 -- 172.21.15.98:0/2001514453 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f4004560 con 0x7f28fc15e0d0 2024-09-17T05:22:54.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.165+0000 7f2901375640 1 -- 172.21.15.98:0/2001514453 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28fc15b250 con 0x7f28fc15e0d0 2024-09-17T05:22:54.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.166+0000 7f2901375640 1 -- 172.21.15.98:0/2001514453 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28fc0cfcb0 con 0x7f28fc15e0d0 2024-09-17T05:22:54.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.167+0000 7f28f37fe640 1 -- 172.21.15.98:0/2001514453 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 6) ==== 101594+0+0 (secure 0 0 0) 0x7f28f4039040 con 0x7f28fc15e0d0 2024-09-17T05:22:54.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.167+0000 7f28f37fe640 1 --2- 172.21.15.98:0/2001514453 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f28dc078d40 0x7f28dc07b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:54.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.168+0000 7f28f37fe640 1 -- 172.21.15.98:0/2001514453 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f28f40bc590 con 0x7f28fc15e0d0 2024-09-17T05:22:54.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.168+0000 7f28faffd640 1 --2- 172.21.15.98:0/2001514453 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f28dc078d40 0x7f28dc07b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:54.178 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.168+0000 7f28faffd640 1 --2- 172.21.15.98:0/2001514453 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f28dc078d40 0x7f28dc07b200 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f28ec000f60 tx=0x7f28ec009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:54.178 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.172+0000 7f28f37fe640 1 -- 172.21.15.98:0/2001514453 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f28f4084760 con 0x7f28fc15e0d0 2024-09-17T05:22:54.386 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.384+0000 7f2901375640 1 -- 172.21.15.98:0/2001514453 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f28fc0cefe0 con 0x7f28fc15e0d0 2024-09-17T05:22:54.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.385+0000 7f28f37fe640 1 -- 172.21.15.98:0/2001514453 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5226 (secure 0 0 0) 0x7f28f4084060 con 0x7f28fc15e0d0 2024-09-17T05:22:54.387 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:22:54.387 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":15,"btime":"2024-09-17T05:22:45:321886+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4771,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/387934311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":387934311},{"type":"v1","addr":"172.21.15.167:6836","nonce":387934311}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4878,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6834/2571517660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2571517660},{"type":"v1","addr":"172.21.15.98:6834","nonce":2571517660}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4881,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/1837285444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6833","nonce":1837285444},{"type":"v1","addr":"172.21.15.98:6835","nonce":1837285444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:22:32.448852+0000","modified":"2024-09-17T05:22:34.449535+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4890},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4890":{"gid":4890,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6837/3889162905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":3889162905},{"type":"v1","addr":"172.21.15.167:6837","nonce":3889162905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4890,"qdb_cluster":[4890]},"id":2}]} 2024-09-17T05:22:54.387 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 15 2024-09-17T05:22:54.389 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.387+0000 7f2901375640 1 -- 172.21.15.98:0/2001514453 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f28dc078d40 msgr2=0x7f28dc07b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:54.389 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.387+0000 7f2901375640 1 --2- 172.21.15.98:0/2001514453 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f28dc078d40 0x7f28dc07b200 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f28ec000f60 tx=0x7f28ec009040 comp rx=0 tx=0).stop 2024-09-17T05:22:54.389 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.387+0000 7f2901375640 1 -- 172.21.15.98:0/2001514453 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28fc15e0d0 msgr2=0x7f28fc15a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:54.390 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.387+0000 7f2901375640 1 --2- 172.21.15.98:0/2001514453 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28fc15e0d0 0x7f28fc15a250 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f28f4009ca0 tx=0x7f28f4003970 comp rx=0 tx=0).stop 2024-09-17T05:22:54.390 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.387+0000 7f2901375640 1 -- 172.21.15.98:0/2001514453 shutdown_connections 2024-09-17T05:22:54.390 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.387+0000 7f2901375640 1 --2- 172.21.15.98:0/2001514453 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f28dc078d40 0x7f28dc07b200 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:54.390 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.387+0000 7f2901375640 1 --2- 172.21.15.98:0/2001514453 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28fc15e0d0 0x7f28fc15a250 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:54.390 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.387+0000 7f2901375640 1 --2- 172.21.15.98:0/2001514453 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28fc0d2050 0x7f28fc159d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:54.390 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.387+0000 7f2901375640 1 --2- 172.21.15.98:0/2001514453 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28fc0d1610 0x7f28fc0cb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:54.390 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.387+0000 7f2901375640 1 -- 172.21.15.98:0/2001514453 >> 172.21.15.98:0/2001514453 conn(0x7f28fc0d3fe0 msgr2=0x7f28fc15fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:54.390 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.387+0000 7f2901375640 1 -- 172.21.15.98:0/2001514453 shutdown_connections 2024-09-17T05:22:54.390 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.387+0000 7f2901375640 1 -- 172.21.15.98:0/2001514453 wait complete. 2024-09-17T05:22:54.400 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:22:54.502 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.500+0000 7f044056b640 1 -- 172.21.15.98:0/2807521218 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f04380cf300 msgr2=0x7f04380729a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:54.502 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.500+0000 7f044056b640 1 --2- 172.21.15.98:0/2807521218 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f04380cf300 0x7f04380729a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0428005fd0 tx=0x7f042802a670 comp rx=0 tx=0).stop 2024-09-17T05:22:54.502 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.500+0000 7f044056b640 1 -- 172.21.15.98:0/2807521218 shutdown_connections 2024-09-17T05:22:54.502 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.500+0000 7f044056b640 1 --2- 172.21.15.98:0/2807521218 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f04380ccfd0 0x7f0438072ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:54.502 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.500+0000 7f044056b640 1 --2- 172.21.15.98:0/2807521218 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f04380cf300 0x7f04380729a0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:54.502 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.500+0000 7f044056b640 1 -- 172.21.15.98:0/2807521218 >> 172.21.15.98:0/2807521218 conn(0x7f04380b1950 msgr2=0x7f04380b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:54.502 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.500+0000 7f044056b640 1 -- 172.21.15.98:0/2807521218 shutdown_connections 2024-09-17T05:22:54.502 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.500+0000 7f044056b640 1 -- 172.21.15.98:0/2807521218 wait complete. 2024-09-17T05:22:54.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.501+0000 7f044056b640 1 Processor -- start 2024-09-17T05:22:54.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.501+0000 7f044056b640 1 -- start start 2024-09-17T05:22:54.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.502+0000 7f044056b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f04380ccfd0 0x7f04380acd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:54.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.502+0000 7f044056b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f04380cf300 0x7f043815ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:54.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.502+0000 7f044056b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04381445d0 0x7f0438132890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:54.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.502+0000 7f044056b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0438073420 con 0x7f04380ccfd0 2024-09-17T05:22:54.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.502+0000 7f044056b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f04380b4eb0 con 0x7f04381445d0 2024-09-17T05:22:54.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.502+0000 7f044056b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f04380735a0 con 0x7f04380cf300 2024-09-17T05:22:54.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.502+0000 7f043e307640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f04380ccfd0 0x7f04380acd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:54.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.502+0000 7f043e307640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f04380ccfd0 0x7f04380acd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:52180/0 (socket says 172.21.15.98:52180) 2024-09-17T05:22:54.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.502+0000 7f043e307640 1 -- 172.21.15.98:0/3165092036 learned_addr learned my addr 172.21.15.98:0/3165092036 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:54.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.502+0000 7f043e307640 1 -- 172.21.15.98:0/3165092036 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f04380cf300 msgr2=0x7f043815ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:54.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.502+0000 7f043e307640 1 --2- 172.21.15.98:0/3165092036 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f04380cf300 0x7f043815ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:54.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.502+0000 7f043e307640 1 -- 172.21.15.98:0/3165092036 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04381445d0 msgr2=0x7f0438132890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:54.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.502+0000 7f043e307640 1 --2- 172.21.15.98:0/3165092036 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04381445d0 0x7f0438132890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:54.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.502+0000 7f043e307640 1 -- 172.21.15.98:0/3165092036 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04380ad560 con 0x7f04380ccfd0 2024-09-17T05:22:54.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.502+0000 7f043e307640 1 --2- 172.21.15.98:0/3165092036 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f04380ccfd0 0x7f04380acd30 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f043400c3f0 tx=0x7f043400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:54.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.502+0000 7f042effd640 1 -- 172.21.15.98:0/3165092036 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0434017070 con 0x7f04380ccfd0 2024-09-17T05:22:54.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.502+0000 7f042effd640 1 -- 172.21.15.98:0/3165092036 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f04340035f0 con 0x7f04380ccfd0 2024-09-17T05:22:54.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.502+0000 7f044056b640 1 -- 172.21.15.98:0/3165092036 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04380ad840 con 0x7f04380ccfd0 2024-09-17T05:22:54.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.502+0000 7f042effd640 1 -- 172.21.15.98:0/3165092036 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0434003a40 con 0x7f04380ccfd0 2024-09-17T05:22:54.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.502+0000 7f044056b640 1 -- 172.21.15.98:0/3165092036 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04380ad270 con 0x7f04380ccfd0 2024-09-17T05:22:54.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.503+0000 7f044056b640 1 -- 172.21.15.98:0/3165092036 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0438073aa0 con 0x7f04380ccfd0 2024-09-17T05:22:54.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.504+0000 7f042effd640 1 -- 172.21.15.98:0/3165092036 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 6) ==== 101594+0+0 (secure 0 0 0) 0x7f043401a070 con 0x7f04380ccfd0 2024-09-17T05:22:54.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.504+0000 7f042effd640 1 --2- 172.21.15.98:0/3165092036 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f041c078d70 0x7f041c07b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:54.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.504+0000 7f042effd640 1 -- 172.21.15.98:0/3165092036 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f043409a4b0 con 0x7f04380ccfd0 2024-09-17T05:22:54.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.505+0000 7f043db06640 1 --2- 172.21.15.98:0/3165092036 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f041c078d70 0x7f041c07b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:54.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.505+0000 7f043db06640 1 --2- 172.21.15.98:0/3165092036 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f041c078d70 0x7f041c07b230 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0428033000 tx=0x7f04280046c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:54.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.508+0000 7f042effd640 1 -- 172.21.15.98:0/3165092036 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f0434062560 con 0x7f04380ccfd0 2024-09-17T05:22:54.724 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.722+0000 7f044056b640 1 -- 172.21.15.98:0/3165092036 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f04380ae1a0 con 0x7f04380ccfd0 2024-09-17T05:22:54.724 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.722+0000 7f042effd640 1 -- 172.21.15.98:0/3165092036 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5226 (secure 0 0 0) 0x7f0434061e60 con 0x7f04380ccfd0 2024-09-17T05:22:54.725 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:22:54.725 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":15,"btime":"2024-09-17T05:22:45:321886+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4771,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/387934311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":387934311},{"type":"v1","addr":"172.21.15.167:6836","nonce":387934311}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4878,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6834/2571517660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2571517660},{"type":"v1","addr":"172.21.15.98:6834","nonce":2571517660}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4881,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/1837285444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6833","nonce":1837285444},{"type":"v1","addr":"172.21.15.98:6835","nonce":1837285444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:22:32.448852+0000","modified":"2024-09-17T05:22:34.449535+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4890},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4890":{"gid":4890,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6837/3889162905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":3889162905},{"type":"v1","addr":"172.21.15.167:6837","nonce":3889162905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4890,"qdb_cluster":[4890]},"id":2}]} 2024-09-17T05:22:54.725 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 15 2024-09-17T05:22:54.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.724+0000 7f044056b640 1 -- 172.21.15.98:0/3165092036 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f041c078d70 msgr2=0x7f041c07b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:54.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.724+0000 7f044056b640 1 --2- 172.21.15.98:0/3165092036 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f041c078d70 0x7f041c07b230 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0428033000 tx=0x7f04280046c0 comp rx=0 tx=0).stop 2024-09-17T05:22:54.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.724+0000 7f044056b640 1 -- 172.21.15.98:0/3165092036 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f04380ccfd0 msgr2=0x7f04380acd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:54.728 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.724+0000 7f044056b640 1 --2- 172.21.15.98:0/3165092036 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f04380ccfd0 0x7f04380acd30 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f043400c3f0 tx=0x7f043400c8b0 comp rx=0 tx=0).stop 2024-09-17T05:22:54.728 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.724+0000 7f044056b640 1 -- 172.21.15.98:0/3165092036 shutdown_connections 2024-09-17T05:22:54.728 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.724+0000 7f044056b640 1 --2- 172.21.15.98:0/3165092036 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f041c078d70 0x7f041c07b230 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:54.728 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.724+0000 7f044056b640 1 --2- 172.21.15.98:0/3165092036 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04381445d0 0x7f0438132890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:54.728 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.724+0000 7f044056b640 1 --2- 172.21.15.98:0/3165092036 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f04380cf300 0x7f043815ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:54.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.724+0000 7f044056b640 1 --2- 172.21.15.98:0/3165092036 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f04380ccfd0 0x7f04380acd30 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:54.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.724+0000 7f044056b640 1 -- 172.21.15.98:0/3165092036 >> 172.21.15.98:0/3165092036 conn(0x7f04380b1950 msgr2=0x7f0438070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:54.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.725+0000 7f044056b640 1 -- 172.21.15.98:0/3165092036 shutdown_connections 2024-09-17T05:22:54.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.725+0000 7f044056b640 1 -- 172.21.15.98:0/3165092036 wait complete. 2024-09-17T05:22:54.737 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:22:54.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.835+0000 7f86c69b4640 1 -- 172.21.15.98:0/2203004825 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f86c00d2050 msgr2=0x7f86c00d10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:54.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.835+0000 7f86c69b4640 1 --2- 172.21.15.98:0/2203004825 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f86c00d2050 0x7f86c00d10d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f86a8009830 tx=0x7f86a802a5c0 comp rx=0 tx=0).stop 2024-09-17T05:22:54.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.835+0000 7f86c69b4640 1 -- 172.21.15.98:0/2203004825 shutdown_connections 2024-09-17T05:22:54.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.835+0000 7f86c69b4640 1 --2- 172.21.15.98:0/2203004825 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f86c00d2050 0x7f86c00d10d0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:54.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.835+0000 7f86c69b4640 1 -- 172.21.15.98:0/2203004825 >> 172.21.15.98:0/2203004825 conn(0x7f86c00d3fe0 msgr2=0x7f86c00d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:54.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.835+0000 7f86c69b4640 1 -- 172.21.15.98:0/2203004825 shutdown_connections 2024-09-17T05:22:54.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.835+0000 7f86c69b4640 1 -- 172.21.15.98:0/2203004825 wait complete. 2024-09-17T05:22:54.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.836+0000 7f86c69b4640 1 Processor -- start 2024-09-17T05:22:54.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.837+0000 7f86c69b4640 1 -- start start 2024-09-17T05:22:54.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.837+0000 7f86c69b4640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f86c00d1610 0x7f86c01f4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:54.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.837+0000 7f86c69b4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86c00d2050 0x7f86c01f58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:54.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.837+0000 7f86c69b4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f86c015e0d0 0x7f86c00cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:54.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.837+0000 7f86c69b4640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f86c00cf870 con 0x7f86c015e0d0 2024-09-17T05:22:54.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.837+0000 7f86c69b4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f86c00cf6f0 con 0x7f86c00d2050 2024-09-17T05:22:54.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.837+0000 7f86c69b4640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f86c00cf9f0 con 0x7f86c00d1610 2024-09-17T05:22:54.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.837+0000 7f86c4f51640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f86c015e0d0 0x7f86c00cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:54.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.837+0000 7f86c4f51640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f86c015e0d0 0x7f86c00cb0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:52200/0 (socket says 172.21.15.98:52200) 2024-09-17T05:22:54.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.837+0000 7f86c4f51640 1 -- 172.21.15.98:0/2699940906 learned_addr learned my addr 172.21.15.98:0/2699940906 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:54.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.838+0000 7f86bf7fe640 1 --2- 172.21.15.98:0/2699940906 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86c00d2050 0x7f86c01f58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:54.842 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.838+0000 7f86bffff640 1 --2- 172.21.15.98:0/2699940906 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f86c00d1610 0x7f86c01f4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:54.842 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.838+0000 7f86c4f51640 1 -- 172.21.15.98:0/2699940906 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f86c00d1610 msgr2=0x7f86c01f4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:54.842 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.838+0000 7f86c4f51640 1 --2- 172.21.15.98:0/2699940906 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f86c00d1610 0x7f86c01f4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:54.842 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.838+0000 7f86c4f51640 1 -- 172.21.15.98:0/2699940906 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86c00d2050 msgr2=0x7f86c01f58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:54.842 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.838+0000 7f86c4f51640 1 --2- 172.21.15.98:0/2699940906 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86c00d2050 0x7f86c01f58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:54.842 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.838+0000 7f86c4f51640 1 -- 172.21.15.98:0/2699940906 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86c00cb790 con 0x7f86c015e0d0 2024-09-17T05:22:54.842 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.838+0000 7f86c4f51640 1 --2- 172.21.15.98:0/2699940906 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f86c015e0d0 0x7f86c00cb0b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f86b800cb50 tx=0x7f86b800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:54.842 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.838+0000 7f86bcff9640 1 -- 172.21.15.98:0/2699940906 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b8016020 con 0x7f86c015e0d0 2024-09-17T05:22:54.842 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.838+0000 7f86bcff9640 1 -- 172.21.15.98:0/2699940906 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f86b800ae30 con 0x7f86c015e0d0 2024-09-17T05:22:54.843 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.838+0000 7f86c69b4640 1 -- 172.21.15.98:0/2699940906 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86c00cba70 con 0x7f86c015e0d0 2024-09-17T05:22:54.843 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.838+0000 7f86bcff9640 1 -- 172.21.15.98:0/2699940906 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b8012680 con 0x7f86c015e0d0 2024-09-17T05:22:54.843 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.838+0000 7f86c69b4640 1 -- 172.21.15.98:0/2699940906 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86c00cd120 con 0x7f86c015e0d0 2024-09-17T05:22:54.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.839+0000 7f86c69b4640 1 -- 172.21.15.98:0/2699940906 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86c00cff10 con 0x7f86c015e0d0 2024-09-17T05:22:54.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.840+0000 7f86bcff9640 1 -- 172.21.15.98:0/2699940906 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 6) ==== 101594+0+0 (secure 0 0 0) 0x7f86b8019020 con 0x7f86c015e0d0 2024-09-17T05:22:54.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.840+0000 7f86bcff9640 1 --2- 172.21.15.98:0/2699940906 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f86a0078d40 0x7f86a007b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:54.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.840+0000 7f86bcff9640 1 -- 172.21.15.98:0/2699940906 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f86b809b350 con 0x7f86c015e0d0 2024-09-17T05:22:54.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.840+0000 7f86bffff640 1 --2- 172.21.15.98:0/2699940906 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f86a0078d40 0x7f86a007b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:54.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.841+0000 7f86bffff640 1 --2- 172.21.15.98:0/2699940906 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f86a0078d40 0x7f86a007b200 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f86c00ccb00 tx=0x7f86b0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:54.846 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:54.844+0000 7f86bcff9640 1 -- 172.21.15.98:0/2699940906 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f86b8020030 con 0x7f86c015e0d0 2024-09-17T05:22:55.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.019+0000 7f86c69b4640 1 -- 172.21.15.98:0/2699940906 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f86c00b5230 con 0x7f86c015e0d0 2024-09-17T05:22:55.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.020+0000 7f86bcff9640 1 -- 172.21.15.98:0/2699940906 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16717 (secure 0 0 0) 0x7f86b8062e50 con 0x7f86c015e0d0 2024-09-17T05:22:55.022 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:22:55.022 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":32,"fsid":"fcbf5a43-b3d8-497c-b15d-3cc022477cf0","created":"2024-09-17T05:21:29.852143+0000","modified":"2024-09-17T05:22:34.108589+0000","last_up_change":"2024-09-17T05:21:42.925756+0000","last_in_change":"2024-09-17T05:21:32.893880+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:21:42.263011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:22:30.174068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-17T05:22:31.410605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ad711a-df74-438b-b0dc-1499d685c958","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6825","nonce":3644101529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6827","nonce":3644101529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6831","nonce":3644101529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6829","nonce":3644101529}]},"public_addr":"172.21.15.98:6825/3644101529","cluster_addr":"172.21.15.98:6827/3644101529","heartbeat_back_addr":"172.21.15.98:6831/3644101529","heartbeat_front_addr":"172.21.15.98:6829/3644101529","state":["exists","up"]},{"osd":1,"uuid":"f0ccb08d-4d8d-47b8-9320-8c372a6605b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6817","nonce":3902180920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6819","nonce":3902180920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6823","nonce":3902180920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6821","nonce":3902180920}]},"public_addr":"172.21.15.98:6817/3902180920","cluster_addr":"172.21.15.98:6819/3902180920","heartbeat_back_addr":"172.21.15.98:6823/3902180920","heartbeat_front_addr":"172.21.15.98:6821/3902180920","state":["exists","up"]},{"osd":2,"uuid":"a0985398-5e5f-494f-8abf-f785f19e94ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6801","nonce":1518887101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6803","nonce":1518887101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6807","nonce":1518887101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6805","nonce":1518887101}]},"public_addr":"172.21.15.98:6801/1518887101","cluster_addr":"172.21.15.98:6803/1518887101","heartbeat_back_addr":"172.21.15.98:6807/1518887101","heartbeat_front_addr":"172.21.15.98:6805/1518887101","state":["exists","up"]},{"osd":3,"uuid":"e960be2e-0c3a-426e-9507-d3be5895f9e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6809","nonce":4125246091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6811","nonce":4125246091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6815","nonce":4125246091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6813","nonce":4125246091}]},"public_addr":"172.21.15.98:6809/4125246091","cluster_addr":"172.21.15.98:6811/4125246091","heartbeat_back_addr":"172.21.15.98:6815/4125246091","heartbeat_front_addr":"172.21.15.98:6813/4125246091","state":["exists","up"]},{"osd":4,"uuid":"49118c00-3dc1-43ef-8ed4-aca61e56a507","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6811","nonce":765789888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6813","nonce":765789888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6817","nonce":765789888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6815","nonce":765789888}]},"public_addr":"172.21.15.167:6811/765789888","cluster_addr":"172.21.15.167:6813/765789888","heartbeat_back_addr":"172.21.15.167:6817/765789888","heartbeat_front_addr":"172.21.15.167:6815/765789888","state":["exists","up"]},{"osd":5,"uuid":"9f4e0143-2b3d-40e4-bfb5-043d9a9f4ba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6803","nonce":2567019914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6805","nonce":2567019914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6809","nonce":2567019914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6807","nonce":2567019914}]},"public_addr":"172.21.15.167:6803/2567019914","cluster_addr":"172.21.15.167:6805/2567019914","heartbeat_back_addr":"172.21.15.167:6809/2567019914","heartbeat_front_addr":"172.21.15.167:6807/2567019914","state":["exists","up"]},{"osd":6,"uuid":"28720514-e627-4dea-8f4d-bd311ec31361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6819","nonce":96262631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6821","nonce":96262631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6825","nonce":96262631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6823","nonce":96262631}]},"public_addr":"172.21.15.167:6819/96262631","cluster_addr":"172.21.15.167:6821/96262631","heartbeat_back_addr":"172.21.15.167:6825/96262631","heartbeat_front_addr":"172.21.15.167:6823/96262631","state":["exists","up"]},{"osd":7,"uuid":"01edaf9c-3898-406e-85b0-774cfda60adf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6827","nonce":4169560909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6829","nonce":4169560909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6833","nonce":4169560909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6831","nonce":4169560909}]},"public_addr":"172.21.15.167:6827/4169560909","cluster_addr":"172.21.15.167:6829/4169560909","heartbeat_back_addr":"172.21.15.167:6833/4169560909","heartbeat_front_addr":"172.21.15.167:6831/4169560909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:40.054920+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.177110+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.749278+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.400155+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.503576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.196417+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.371063+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.212852+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:22:55.024 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.022+0000 7f86c69b4640 1 -- 172.21.15.98:0/2699940906 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f86a0078d40 msgr2=0x7f86a007b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:55.024 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.022+0000 7f86c69b4640 1 --2- 172.21.15.98:0/2699940906 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f86a0078d40 0x7f86a007b200 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f86c00ccb00 tx=0x7f86b0009040 comp rx=0 tx=0).stop 2024-09-17T05:22:55.024 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.022+0000 7f86c69b4640 1 -- 172.21.15.98:0/2699940906 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f86c015e0d0 msgr2=0x7f86c00cb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:55.024 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.022+0000 7f86c69b4640 1 --2- 172.21.15.98:0/2699940906 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f86c015e0d0 0x7f86c00cb0b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f86b800cb50 tx=0x7f86b800a430 comp rx=0 tx=0).stop 2024-09-17T05:22:55.025 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.022+0000 7f86c69b4640 1 -- 172.21.15.98:0/2699940906 shutdown_connections 2024-09-17T05:22:55.025 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.022+0000 7f86c69b4640 1 --2- 172.21.15.98:0/2699940906 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f86a0078d40 0x7f86a007b200 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:55.025 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.022+0000 7f86c69b4640 1 --2- 172.21.15.98:0/2699940906 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f86c015e0d0 0x7f86c00cb0b0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:55.025 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.022+0000 7f86c69b4640 1 --2- 172.21.15.98:0/2699940906 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86c00d2050 0x7f86c01f58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:55.025 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.022+0000 7f86c69b4640 1 --2- 172.21.15.98:0/2699940906 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f86c00d1610 0x7f86c01f4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:55.025 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.022+0000 7f86c69b4640 1 -- 172.21.15.98:0/2699940906 >> 172.21.15.98:0/2699940906 conn(0x7f86c00d3fe0 msgr2=0x7f86c0160220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:55.025 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.022+0000 7f86c69b4640 1 -- 172.21.15.98:0/2699940906 shutdown_connections 2024-09-17T05:22:55.025 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.022+0000 7f86c69b4640 1 -- 172.21.15.98:0/2699940906 wait complete. 2024-09-17T05:22:55.035 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T05:22:55.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.136+0000 7fd1fd885640 1 -- 172.21.15.98:0/3303218226 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd1f80d2050 msgr2=0x7fd1f80d10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:55.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.136+0000 7fd1fd885640 1 --2- 172.21.15.98:0/3303218226 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd1f80d2050 0x7fd1f80d10d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec009860 tx=0x7fd1ec02a530 comp rx=0 tx=0).stop 2024-09-17T05:22:55.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.136+0000 7fd1fd885640 1 -- 172.21.15.98:0/3303218226 shutdown_connections 2024-09-17T05:22:55.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.136+0000 7fd1fd885640 1 --2- 172.21.15.98:0/3303218226 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd1f80d2050 0x7fd1f80d10d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:55.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.136+0000 7fd1fd885640 1 -- 172.21.15.98:0/3303218226 >> 172.21.15.98:0/3303218226 conn(0x7fd1f80d3fe0 msgr2=0x7fd1f80d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:55.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.136+0000 7fd1fd885640 1 -- 172.21.15.98:0/3303218226 shutdown_connections 2024-09-17T05:22:55.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.136+0000 7fd1fd885640 1 -- 172.21.15.98:0/3303218226 wait complete. 2024-09-17T05:22:55.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.137+0000 7fd1fd885640 1 Processor -- start 2024-09-17T05:22:55.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.137+0000 7fd1fd885640 1 -- start start 2024-09-17T05:22:55.141 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.138+0000 7fd1fd885640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1f80d1610 0x7fd1f80a1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:55.141 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.138+0000 7fd1fd885640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd1f80d2050 0x7fd1f815d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:55.141 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.138+0000 7fd1fd885640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1f815e0d0 0x7fd1f809ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:55.141 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.138+0000 7fd1fd885640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd1f80cf840 con 0x7fd1f815e0d0 2024-09-17T05:22:55.141 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.138+0000 7fd1fd885640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd1f80cf6c0 con 0x7fd1f80d1610 2024-09-17T05:22:55.141 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.138+0000 7fd1fd885640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fd1f80cf9c0 con 0x7fd1f80d2050 2024-09-17T05:22:55.141 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.138+0000 7fd1f77fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1f815e0d0 0x7fd1f809ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:55.141 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.138+0000 7fd1f77fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1f815e0d0 0x7fd1f809ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:52204/0 (socket says 172.21.15.98:52204) 2024-09-17T05:22:55.142 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.138+0000 7fd1f77fe640 1 -- 172.21.15.98:0/4112033464 learned_addr learned my addr 172.21.15.98:0/4112033464 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:55.142 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.138+0000 7fd1f6ffd640 1 --2- 172.21.15.98:0/4112033464 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1f80d1610 0x7fd1f80a1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:55.142 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.138+0000 7fd1f67fc640 1 --2- 172.21.15.98:0/4112033464 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd1f80d2050 0x7fd1f815d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:55.142 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.139+0000 7fd1f77fe640 1 -- 172.21.15.98:0/4112033464 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd1f80d2050 msgr2=0x7fd1f815d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:55.142 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.139+0000 7fd1f77fe640 1 --2- 172.21.15.98:0/4112033464 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd1f80d2050 0x7fd1f815d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:55.142 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.139+0000 7fd1f77fe640 1 -- 172.21.15.98:0/4112033464 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1f80d1610 msgr2=0x7fd1f80a1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:55.142 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.139+0000 7fd1f77fe640 1 --2- 172.21.15.98:0/4112033464 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1f80d1610 0x7fd1f80a1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:55.142 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.139+0000 7fd1f77fe640 1 -- 172.21.15.98:0/4112033464 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1f81f5c10 con 0x7fd1f815e0d0 2024-09-17T05:22:55.142 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.139+0000 7fd1f77fe640 1 --2- 172.21.15.98:0/4112033464 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1f815e0d0 0x7fd1f809ed10 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fd1f000c410 tx=0x7fd1f000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:55.142 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.139+0000 7fd1dffff640 1 -- 172.21.15.98:0/4112033464 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f0017070 con 0x7fd1f815e0d0 2024-09-17T05:22:55.142 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.139+0000 7fd1dffff640 1 -- 172.21.15.98:0/4112033464 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd1f00053c0 con 0x7fd1f815e0d0 2024-09-17T05:22:55.142 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.139+0000 7fd1fd885640 1 -- 172.21.15.98:0/4112033464 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1f809df50 con 0x7fd1f815e0d0 2024-09-17T05:22:55.142 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.139+0000 7fd1dffff640 1 -- 172.21.15.98:0/4112033464 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f0003850 con 0x7fd1f815e0d0 2024-09-17T05:22:55.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.139+0000 7fd1fd885640 1 -- 172.21.15.98:0/4112033464 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1f809e510 con 0x7fd1f815e0d0 2024-09-17T05:22:55.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.140+0000 7fd1fd885640 1 -- 172.21.15.98:0/4112033464 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1f80cfee0 con 0x7fd1f815e0d0 2024-09-17T05:22:55.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.141+0000 7fd1dffff640 1 -- 172.21.15.98:0/4112033464 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 6) ==== 101594+0+0 (secure 0 0 0) 0x7fd1f001a070 con 0x7fd1f815e0d0 2024-09-17T05:22:55.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.141+0000 7fd1dffff640 1 --2- 172.21.15.98:0/4112033464 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fd1e4078d40 0x7fd1e407b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:55.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.141+0000 7fd1dffff640 1 -- 172.21.15.98:0/4112033464 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fd1f009a2e0 con 0x7fd1f815e0d0 2024-09-17T05:22:55.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.141+0000 7fd1f6ffd640 1 --2- 172.21.15.98:0/4112033464 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fd1e4078d40 0x7fd1e407b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:55.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.142+0000 7fd1f6ffd640 1 --2- 172.21.15.98:0/4112033464 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fd1e4078d40 0x7fd1e407b200 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd1f80ca020 tx=0x7fd1e8001a50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:55.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.145+0000 7fd1dffff640 1 -- 172.21.15.98:0/4112033464 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fd1f0061f10 con 0x7fd1f815e0d0 2024-09-17T05:22:55.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.359+0000 7fd1fd885640 1 -- 172.21.15.98:0/4112033464 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fd1f80b70f0 con 0x7fd1f815e0d0 2024-09-17T05:22:55.361 INFO:tasks.ceph.mon.a.smithi098.stderr:2024-09-17T05:22:55.359+0000 7fd8a3957640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T05:22:55.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.360+0000 7fd1dffff640 1 -- 172.21.15.98:0/4112033464 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v16) ==== 161+0+0 (secure 0 0 0) 0x7fd1f0066940 con 0x7fd1f815e0d0 2024-09-17T05:22:55.362 INFO:teuthology.orchestra.run.smithi098.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T05:22:55.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.363+0000 7fd1fd885640 1 -- 172.21.15.98:0/4112033464 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fd1e4078d40 msgr2=0x7fd1e407b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:55.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.363+0000 7fd1fd885640 1 --2- 172.21.15.98:0/4112033464 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fd1e4078d40 0x7fd1e407b200 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd1f80ca020 tx=0x7fd1e8001a50 comp rx=0 tx=0).stop 2024-09-17T05:22:55.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.363+0000 7fd1fd885640 1 -- 172.21.15.98:0/4112033464 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1f815e0d0 msgr2=0x7fd1f809ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:55.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.363+0000 7fd1fd885640 1 --2- 172.21.15.98:0/4112033464 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1f815e0d0 0x7fd1f809ed10 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fd1f000c410 tx=0x7fd1f000c8d0 comp rx=0 tx=0).stop 2024-09-17T05:22:55.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.363+0000 7fd1fd885640 1 -- 172.21.15.98:0/4112033464 shutdown_connections 2024-09-17T05:22:55.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.363+0000 7fd1fd885640 1 --2- 172.21.15.98:0/4112033464 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fd1e4078d40 0x7fd1e407b200 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:55.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.363+0000 7fd1fd885640 1 --2- 172.21.15.98:0/4112033464 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1f815e0d0 0x7fd1f809ed10 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:55.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.363+0000 7fd1fd885640 1 --2- 172.21.15.98:0/4112033464 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd1f80d2050 0x7fd1f815d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:55.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.363+0000 7fd1fd885640 1 --2- 172.21.15.98:0/4112033464 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1f80d1610 0x7fd1f80a1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:55.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.363+0000 7fd1fd885640 1 -- 172.21.15.98:0/4112033464 >> 172.21.15.98:0/4112033464 conn(0x7fd1f80d3fe0 msgr2=0x7fd1f80cd0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:55.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.363+0000 7fd1fd885640 1 -- 172.21.15.98:0/4112033464 shutdown_connections 2024-09-17T05:22:55.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.363+0000 7fd1fd885640 1 -- 172.21.15.98:0/4112033464 wait complete. 2024-09-17T05:22:55.376 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T05:22:55.401 INFO:tasks.ceph.mds.b.smithi167.stdout:starting mds.b at 2024-09-17T05:22:55.480 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.478+0000 7fa46a047640 1 -- 172.21.15.98:0/1430948075 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa46415f090 msgr2=0x7fa4640cf120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:55.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.478+0000 7fa46a047640 1 --2- 172.21.15.98:0/1430948075 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa46415f090 0x7fa4640cf120 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa46406db10 tx=0x7fa45c02a5f0 comp rx=0 tx=0).stop 2024-09-17T05:22:55.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.478+0000 7fa46a047640 1 -- 172.21.15.98:0/1430948075 shutdown_connections 2024-09-17T05:22:55.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.478+0000 7fa46a047640 1 --2- 172.21.15.98:0/1430948075 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa46415f090 0x7fa4640cf120 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:55.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.478+0000 7fa46a047640 1 --2- 172.21.15.98:0/1430948075 >> v2:172.21.15.167:3300/0 conn(0x7fa4640b3370 0x7fa4640cebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:55.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.478+0000 7fa46a047640 1 -- 172.21.15.98:0/1430948075 >> 172.21.15.98:0/1430948075 conn(0x7fa4640b1840 msgr2=0x7fa4640b1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:55.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.478+0000 7fa46a047640 1 -- 172.21.15.98:0/1430948075 shutdown_connections 2024-09-17T05:22:55.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.478+0000 7fa46a047640 1 -- 172.21.15.98:0/1430948075 wait complete. 2024-09-17T05:22:55.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.479+0000 7fa46a047640 1 Processor -- start 2024-09-17T05:22:55.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.480+0000 7fa46a047640 1 -- start start 2024-09-17T05:22:55.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.480+0000 7fa46a047640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4640b3370 0x7fa4641f68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:55.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.480+0000 7fa46a047640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa46415c080 0x7fa464138f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:55.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.480+0000 7fa46a047640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa46415f090 0x7fa46413e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:55.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.480+0000 7fa46a047640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa464164e20 con 0x7fa46415c080 2024-09-17T05:22:55.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.480+0000 7fa46a047640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa464164ca0 con 0x7fa46415f090 2024-09-17T05:22:55.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.480+0000 7fa46a047640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fa464164fa0 con 0x7fa4640b3370 2024-09-17T05:22:55.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.480+0000 7fa462ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa46415c080 0x7fa464138f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:55.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.480+0000 7fa462ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa46415c080 0x7fa464138f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:52214/0 (socket says 172.21.15.98:52214) 2024-09-17T05:22:55.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.480+0000 7fa462ffd640 1 -- 172.21.15.98:0/1977097451 learned_addr learned my addr 172.21.15.98:0/1977097451 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:55.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.481+0000 7fa463fff640 1 --2- 172.21.15.98:0/1977097451 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa46415f090 0x7fa46413e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:55.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.481+0000 7fa4637fe640 1 --2- 172.21.15.98:0/1977097451 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4640b3370 0x7fa4641f68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:55.485 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.481+0000 7fa462ffd640 1 -- 172.21.15.98:0/1977097451 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4640b3370 msgr2=0x7fa4641f68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:55.485 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.481+0000 7fa462ffd640 1 --2- 172.21.15.98:0/1977097451 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4640b3370 0x7fa4641f68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:55.485 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.481+0000 7fa462ffd640 1 -- 172.21.15.98:0/1977097451 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa46415f090 msgr2=0x7fa46413e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:55.485 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.481+0000 7fa462ffd640 1 --2- 172.21.15.98:0/1977097451 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa46415f090 0x7fa46413e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:55.485 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.481+0000 7fa462ffd640 1 -- 172.21.15.98:0/1977097451 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa46413eb00 con 0x7fa46415c080 2024-09-17T05:22:55.485 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.481+0000 7fa462ffd640 1 --2- 172.21.15.98:0/1977097451 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa46415c080 0x7fa464138f10 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa45800c450 tx=0x7fa45800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:55.485 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.481+0000 7fa44bfff640 1 -- 172.21.15.98:0/1977097451 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4580052d0 con 0x7fa46415c080 2024-09-17T05:22:55.485 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.481+0000 7fa44bfff640 1 -- 172.21.15.98:0/1977097451 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa458005470 con 0x7fa46415c080 2024-09-17T05:22:55.485 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.481+0000 7fa44bfff640 1 -- 172.21.15.98:0/1977097451 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa458012890 con 0x7fa46415c080 2024-09-17T05:22:55.485 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.481+0000 7fa46a047640 1 -- 172.21.15.98:0/1977097451 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa46413ede0 con 0x7fa46415c080 2024-09-17T05:22:55.485 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.481+0000 7fa46a047640 1 -- 172.21.15.98:0/1977097451 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa46413fe90 con 0x7fa46415c080 2024-09-17T05:22:55.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.482+0000 7fa46a047640 1 -- 172.21.15.98:0/1977097451 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa46415e980 con 0x7fa46415c080 2024-09-17T05:22:55.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.483+0000 7fa44bfff640 1 -- 172.21.15.98:0/1977097451 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 6) ==== 101594+0+0 (secure 0 0 0) 0x7fa4580035f0 con 0x7fa46415c080 2024-09-17T05:22:55.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.483+0000 7fa44bfff640 1 --2- 172.21.15.98:0/1977097451 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fa450078d70 0x7fa45007b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:55.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.483+0000 7fa44bfff640 1 -- 172.21.15.98:0/1977097451 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7fa45809aa90 con 0x7fa46415c080 2024-09-17T05:22:55.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.483+0000 7fa4637fe640 1 --2- 172.21.15.98:0/1977097451 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fa450078d70 0x7fa45007b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:55.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.484+0000 7fa4637fe640 1 --2- 172.21.15.98:0/1977097451 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fa450078d70 0x7fa45007b230 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa454005fd0 tx=0x7fa454010860 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:55.489 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.487+0000 7fa44bfff640 1 -- 172.21.15.98:0/1977097451 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fa46415b320 con 0x7fa46415c080 2024-09-17T05:22:55.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:55.699+0000 7fa46a047640 1 -- 172.21.15.98:0/1977097451 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fa46415d450 con 0x7fa46415c080 2024-09-17T05:22:56.369 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:56.367+0000 7fa44bfff640 1 -- 172.21.15.98:0/1977097451 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v17) ==== 104+0+0 (secure 0 0 0) 0x7fa4580625b0 con 0x7fa46415c080 2024-09-17T05:22:56.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:56.369+0000 7fa46a047640 1 -- 172.21.15.98:0/1977097451 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fa450078d70 msgr2=0x7fa45007b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:56.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:56.369+0000 7fa46a047640 1 --2- 172.21.15.98:0/1977097451 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fa450078d70 0x7fa45007b230 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa454005fd0 tx=0x7fa454010860 comp rx=0 tx=0).stop 2024-09-17T05:22:56.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:56.369+0000 7fa46a047640 1 -- 172.21.15.98:0/1977097451 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa46415c080 msgr2=0x7fa464138f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:56.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:56.370+0000 7fa46a047640 1 --2- 172.21.15.98:0/1977097451 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa46415c080 0x7fa464138f10 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa45800c450 tx=0x7fa45800c910 comp rx=0 tx=0).stop 2024-09-17T05:22:56.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:56.370+0000 7fa46a047640 1 -- 172.21.15.98:0/1977097451 shutdown_connections 2024-09-17T05:22:56.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:56.370+0000 7fa46a047640 1 --2- 172.21.15.98:0/1977097451 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fa450078d70 0x7fa45007b230 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:56.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:56.370+0000 7fa46a047640 1 --2- 172.21.15.98:0/1977097451 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa46415f090 0x7fa46413e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:56.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:56.370+0000 7fa46a047640 1 --2- 172.21.15.98:0/1977097451 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa46415c080 0x7fa464138f10 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:56.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:56.370+0000 7fa46a047640 1 --2- 172.21.15.98:0/1977097451 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4640b3370 0x7fa4641f68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:56.373 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:56.370+0000 7fa46a047640 1 -- 172.21.15.98:0/1977097451 >> 172.21.15.98:0/1977097451 conn(0x7fa4640b1840 msgr2=0x7fa46413c340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:56.373 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:56.370+0000 7fa46a047640 1 -- 172.21.15.98:0/1977097451 shutdown_connections 2024-09-17T05:22:56.373 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:56.370+0000 7fa46a047640 1 -- 172.21.15.98:0/1977097451 wait complete. 2024-09-17T05:22:56.385 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T05:22:56.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:56.493+0000 7f986badd640 1 -- 172.21.15.98:0/4114232 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f984c005020 msgr2=0x7f984c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:56.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:56.493+0000 7f986badd640 1 --2- 172.21.15.98:0/4114232 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f984c005020 0x7f984c00b9c0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f985c001700 tx=0x7f984c005830 comp rx=0 tx=0).stop 2024-09-17T05:22:56.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:56.493+0000 7f986a07a640 1 -- 172.21.15.98:0/4114232 reap_dead start 2024-09-17T05:22:56.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:56.493+0000 7f986badd640 1 -- 172.21.15.98:0/4114232 shutdown_connections 2024-09-17T05:22:56.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:56.493+0000 7f986badd640 1 -- 172.21.15.98:0/4114232 >> 172.21.15.98:0/4114232 conn(0x7f98640d4050 msgr2=0x7f98640d4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:56.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:56.493+0000 7f986badd640 1 -- 172.21.15.98:0/4114232 shutdown_connections 2024-09-17T05:22:56.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:56.493+0000 7f986badd640 1 -- 172.21.15.98:0/4114232 wait complete. 2024-09-17T05:22:56.496 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:56.494+0000 7f986badd640 1 Processor -- start 2024-09-17T05:22:56.496 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:56.494+0000 7f986badd640 1 -- start start 2024-09-17T05:22:56.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:56.495+0000 7f986badd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f984c005020 0x7f98640c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:56.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:56.495+0000 7f986badd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98640ca680 0x7f98640c9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:56.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:56.495+0000 7f986badd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f98641f7bb0 0x7f98641f8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:56.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:56.495+0000 7f986badd640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f98640d4f00 con 0x7f98641f7bb0 2024-09-17T05:22:56.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:56.495+0000 7f986badd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f98640d4d80 con 0x7f984c005020 2024-09-17T05:22:56.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:56.495+0000 7f986badd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f98640b78f0 con 0x7f98640ca680 2024-09-17T05:22:56.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:56.495+0000 7f986a07a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f98641f7bb0 0x7f98641f8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:56.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:56.495+0000 7f986a07a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f98641f7bb0 0x7f98641f8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48534/0 (socket says 172.21.15.98:48534) 2024-09-17T05:22:56.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:56.495+0000 7f986a07a640 1 -- 172.21.15.98:0/3547181633 learned_addr learned my addr 172.21.15.98:0/3547181633 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:56.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:56.495+0000 7f9869879640 1 --2- 172.21.15.98:0/3547181633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f984c005020 0x7f98640c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:56.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:56.495+0000 7f9869078640 1 --2- 172.21.15.98:0/3547181633 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98640ca680 0x7f98640c9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:56.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:56.495+0000 7f986a07a640 1 -- 172.21.15.98:0/3547181633 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98640ca680 msgr2=0x7f98640c9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:56.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:56.495+0000 7f986a07a640 1 --2- 172.21.15.98:0/3547181633 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98640ca680 0x7f98640c9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:56.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:56.495+0000 7f986a07a640 1 -- 172.21.15.98:0/3547181633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f984c005020 msgr2=0x7f98640c81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:56.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:56.495+0000 7f986a07a640 1 --2- 172.21.15.98:0/3547181633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f984c005020 0x7f98640c81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:56.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:56.495+0000 7f986a07a640 1 -- 172.21.15.98:0/3547181633 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98640cb2c0 con 0x7f98641f7bb0 2024-09-17T05:22:56.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:56.495+0000 7f986a07a640 1 --2- 172.21.15.98:0/3547181633 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f98641f7bb0 0x7f98641f8040 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f985c001820 tx=0x7f985c02cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:56.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:56.496+0000 7f98627fc640 1 -- 172.21.15.98:0/3547181633 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f985c038070 con 0x7f98641f7bb0 2024-09-17T05:22:56.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:56.496+0000 7f98627fc640 1 -- 172.21.15.98:0/3547181633 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f985c003af0 con 0x7f98641f7bb0 2024-09-17T05:22:56.500 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:56.496+0000 7f986badd640 1 -- 172.21.15.98:0/3547181633 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98640cdc80 con 0x7f98641f7bb0 2024-09-17T05:22:56.500 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:56.496+0000 7f98627fc640 1 -- 172.21.15.98:0/3547181633 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f985c0068c0 con 0x7f98641f7bb0 2024-09-17T05:22:56.500 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:56.496+0000 7f986badd640 1 -- 172.21.15.98:0/3547181633 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98640cb5a0 con 0x7f98641f7bb0 2024-09-17T05:22:56.500 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:56.497+0000 7f986badd640 1 -- 172.21.15.98:0/3547181633 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98640b5ff0 con 0x7f98641f7bb0 2024-09-17T05:22:56.501 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:56.497+0000 7f98627fc640 1 -- 172.21.15.98:0/3547181633 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 6) ==== 101594+0+0 (secure 0 0 0) 0x7f985c033470 con 0x7f98641f7bb0 2024-09-17T05:22:56.501 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:56.498+0000 7f98627fc640 1 --2- 172.21.15.98:0/3547181633 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f9850078d40 0x7f985007b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:56.501 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:56.498+0000 7f98627fc640 1 -- 172.21.15.98:0/3547181633 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7f985c0ba7e0 con 0x7f98641f7bb0 2024-09-17T05:22:56.501 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:56.498+0000 7f9869879640 1 --2- 172.21.15.98:0/3547181633 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f9850078d40 0x7f985007b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:56.501 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:56.498+0000 7f9869879640 1 --2- 172.21.15.98:0/3547181633 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f9850078d40 0x7f985007b200 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9854006fd0 tx=0x7f9854006f60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:56.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:56.502+0000 7f98627fc640 1 -- 172.21.15.98:0/3547181633 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f985c082980 con 0x7f98641f7bb0 2024-09-17T05:22:56.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:56.680+0000 7f986badd640 1 -- 172.21.15.98:0/3547181633 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f98640b5d10 con 0x7f98641f7bb0 2024-09-17T05:22:57.370 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:57.368+0000 7f98627fc640 1 -- 172.21.15.98:0/3547181633 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v34) ==== 181+0+0 (secure 0 0 0) 0x7f985c082280 con 0x7f98641f7bb0 2024-09-17T05:22:57.371 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_metadata' removed 2024-09-17T05:22:57.373 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:57.371+0000 7f986badd640 1 -- 172.21.15.98:0/3547181633 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f9850078d40 msgr2=0x7f985007b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:57.373 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:57.371+0000 7f986badd640 1 --2- 172.21.15.98:0/3547181633 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f9850078d40 0x7f985007b200 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9854006fd0 tx=0x7f9854006f60 comp rx=0 tx=0).stop 2024-09-17T05:22:57.373 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:57.371+0000 7f986badd640 1 -- 172.21.15.98:0/3547181633 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f98641f7bb0 msgr2=0x7f98641f8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:57.373 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:57.371+0000 7f986badd640 1 --2- 172.21.15.98:0/3547181633 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f98641f7bb0 0x7f98641f8040 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f985c001820 tx=0x7f985c02cf50 comp rx=0 tx=0).stop 2024-09-17T05:22:57.373 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:57.371+0000 7f986badd640 1 -- 172.21.15.98:0/3547181633 shutdown_connections 2024-09-17T05:22:57.373 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:57.371+0000 7f986badd640 1 --2- 172.21.15.98:0/3547181633 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f9850078d40 0x7f985007b200 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:57.373 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:57.371+0000 7f986badd640 1 --2- 172.21.15.98:0/3547181633 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f98641f7bb0 0x7f98641f8040 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:57.373 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:57.371+0000 7f986badd640 1 --2- 172.21.15.98:0/3547181633 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f98640ca680 0x7f98640c9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:57.373 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:57.371+0000 7f986badd640 1 --2- 172.21.15.98:0/3547181633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f984c005020 0x7f98640c81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:57.373 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:57.371+0000 7f986badd640 1 -- 172.21.15.98:0/3547181633 >> 172.21.15.98:0/3547181633 conn(0x7f98640d4050 msgr2=0x7f98641574a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:57.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:57.371+0000 7f986badd640 1 -- 172.21.15.98:0/3547181633 shutdown_connections 2024-09-17T05:22:57.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:57.371+0000 7f986badd640 1 -- 172.21.15.98:0/3547181633 wait complete. 2024-09-17T05:22:57.391 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T05:22:57.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:57.496+0000 7f6661c16640 1 -- 172.21.15.98:0/2950317487 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6644003aa0 msgr2=0x7f6644003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:57.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:57.496+0000 7f6661c16640 1 --2- 172.21.15.98:0/2950317487 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6644003aa0 0x7f6644003ec0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f664c001d90 tx=0x7f6644005830 comp rx=0 tx=0).stop 2024-09-17T05:22:57.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:57.496+0000 7f6661c16640 1 -- 172.21.15.98:0/2950317487 shutdown_connections 2024-09-17T05:22:57.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:57.496+0000 7f6661c16640 1 --2- 172.21.15.98:0/2950317487 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6644003aa0 0x7f6644003ec0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:57.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:57.496+0000 7f6661c16640 1 -- 172.21.15.98:0/2950317487 >> 172.21.15.98:0/2950317487 conn(0x7f665c0d4050 msgr2=0x7f665c0d4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:57.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:57.496+0000 7f6661c16640 1 -- 172.21.15.98:0/2950317487 shutdown_connections 2024-09-17T05:22:57.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:57.496+0000 7f6661c16640 1 -- 172.21.15.98:0/2950317487 wait complete. 2024-09-17T05:22:57.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:57.497+0000 7f6661c16640 1 Processor -- start 2024-09-17T05:22:57.501 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:57.497+0000 7f6661c16640 1 -- start start 2024-09-17T05:22:57.501 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:57.498+0000 7f6661c16640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6644003aa0 0x7f665c15e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:57.501 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:57.498+0000 7f6661c16640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f665c15ff30 0x7f665c1540a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:57.501 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:57.498+0000 7f6661c16640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f665c1575a0 0x7f665c161030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:57.501 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:57.498+0000 7f6661c16640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f665c0d0b90 con 0x7f6644003aa0 2024-09-17T05:22:57.501 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:57.498+0000 7f6661c16640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f665c0d0a10 con 0x7f665c15ff30 2024-09-17T05:22:57.502 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:57.498+0000 7f6661c16640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f665c0d0d10 con 0x7f665c1575a0 2024-09-17T05:22:57.502 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:57.498+0000 7f665b7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6644003aa0 0x7f665c15e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:57.502 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:57.498+0000 7f665b7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6644003aa0 0x7f665c15e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48558/0 (socket says 172.21.15.98:48558) 2024-09-17T05:22:57.502 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:57.498+0000 7f665b7fe640 1 -- 172.21.15.98:0/1784698744 learned_addr learned my addr 172.21.15.98:0/1784698744 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:57.502 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:57.498+0000 7f665bfff640 1 --2- 172.21.15.98:0/1784698744 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f665c1575a0 0x7f665c161030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:57.502 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:57.498+0000 7f665affd640 1 --2- 172.21.15.98:0/1784698744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f665c15ff30 0x7f665c1540a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:57.502 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:57.498+0000 7f665b7fe640 1 -- 172.21.15.98:0/1784698744 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f665c1575a0 msgr2=0x7f665c161030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:57.502 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:57.498+0000 7f665b7fe640 1 --2- 172.21.15.98:0/1784698744 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f665c1575a0 0x7f665c161030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:57.502 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:57.498+0000 7f665b7fe640 1 -- 172.21.15.98:0/1784698744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f665c15ff30 msgr2=0x7f665c1540a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:57.502 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:57.498+0000 7f665b7fe640 1 --2- 172.21.15.98:0/1784698744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f665c15ff30 0x7f665c1540a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:57.502 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:57.498+0000 7f665b7fe640 1 -- 172.21.15.98:0/1784698744 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f665c15ee90 con 0x7f6644003aa0 2024-09-17T05:22:57.502 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:57.498+0000 7f665b7fe640 1 --2- 172.21.15.98:0/1784698744 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6644003aa0 0x7f665c15e820 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f664c000f80 tx=0x7f664c003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:57.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:57.499+0000 7f6643fff640 1 -- 172.21.15.98:0/1784698744 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f664c006460 con 0x7f6644003aa0 2024-09-17T05:22:57.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:57.499+0000 7f6643fff640 1 -- 172.21.15.98:0/1784698744 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f664c006710 con 0x7f6644003aa0 2024-09-17T05:22:57.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:57.499+0000 7f6661c16640 1 -- 172.21.15.98:0/1784698744 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f665c15f170 con 0x7f6644003aa0 2024-09-17T05:22:57.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:57.499+0000 7f6643fff640 1 -- 172.21.15.98:0/1784698744 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f664c0336e0 con 0x7f6644003aa0 2024-09-17T05:22:57.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:57.499+0000 7f6661c16640 1 -- 172.21.15.98:0/1784698744 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f665c15f730 con 0x7f6644003aa0 2024-09-17T05:22:57.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:57.500+0000 7f6661c16640 1 -- 172.21.15.98:0/1784698744 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f665c0d1ec0 con 0x7f6644003aa0 2024-09-17T05:22:57.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:57.500+0000 7f6643fff640 1 -- 172.21.15.98:0/1784698744 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 6) ==== 101594+0+0 (secure 0 0 0) 0x7f664c033880 con 0x7f6644003aa0 2024-09-17T05:22:57.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:57.501+0000 7f6643fff640 1 --2- 172.21.15.98:0/1784698744 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f6648078d40 0x7f664807b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:57.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:57.501+0000 7f6643fff640 1 -- 172.21.15.98:0/1784698744 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5357+0+0 (secure 0 0 0) 0x7f664c0bae60 con 0x7f6644003aa0 2024-09-17T05:22:57.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:57.501+0000 7f665affd640 1 --2- 172.21.15.98:0/1784698744 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f6648078d40 0x7f664807b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:57.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:57.502+0000 7f665affd640 1 --2- 172.21.15.98:0/1784698744 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f6648078d40 0x7f664807b200 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f665c160330 tx=0x7f6650005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:57.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:57.505+0000 7f6643fff640 1 -- 172.21.15.98:0/1784698744 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f664c083190 con 0x7f6644003aa0 2024-09-17T05:22:57.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:57.687+0000 7f6661c16640 1 -- 172.21.15.98:0/1784698744 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f665c0b8290 con 0x7f6644003aa0 2024-09-17T05:22:58.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.375+0000 7f6643fff640 1 -- 172.21.15.98:0/1784698744 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v35) ==== 169+0+0 (secure 0 0 0) 0x7f664c082a90 con 0x7f6644003aa0 2024-09-17T05:22:58.377 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_data' removed 2024-09-17T05:22:58.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.378+0000 7f6661c16640 1 -- 172.21.15.98:0/1784698744 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f6648078d40 msgr2=0x7f664807b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:58.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.378+0000 7f6661c16640 1 --2- 172.21.15.98:0/1784698744 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f6648078d40 0x7f664807b200 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f665c160330 tx=0x7f6650005f90 comp rx=0 tx=0).stop 2024-09-17T05:22:58.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.378+0000 7f6661c16640 1 -- 172.21.15.98:0/1784698744 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6644003aa0 msgr2=0x7f665c15e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:58.381 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.378+0000 7f6661c16640 1 --2- 172.21.15.98:0/1784698744 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6644003aa0 0x7f665c15e820 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f664c000f80 tx=0x7f664c003d40 comp rx=0 tx=0).stop 2024-09-17T05:22:58.381 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.378+0000 7f6661c16640 1 -- 172.21.15.98:0/1784698744 shutdown_connections 2024-09-17T05:22:58.381 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.378+0000 7f6661c16640 1 --2- 172.21.15.98:0/1784698744 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f6648078d40 0x7f664807b200 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:58.381 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.378+0000 7f6661c16640 1 --2- 172.21.15.98:0/1784698744 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f665c1575a0 0x7f665c161030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:58.381 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.378+0000 7f6661c16640 1 --2- 172.21.15.98:0/1784698744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f665c15ff30 0x7f665c1540a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:58.381 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.378+0000 7f6661c16640 1 --2- 172.21.15.98:0/1784698744 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6644003aa0 0x7f665c15e820 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:58.381 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.378+0000 7f6661c16640 1 -- 172.21.15.98:0/1784698744 >> 172.21.15.98:0/1784698744 conn(0x7f665c0d4050 msgr2=0x7f665c0cd130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:58.381 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.378+0000 7f6661c16640 1 -- 172.21.15.98:0/1784698744 shutdown_connections 2024-09-17T05:22:58.381 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.378+0000 7f6661c16640 1 -- 172.21.15.98:0/1784698744 wait complete. 2024-09-17T05:22:58.393 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-17T05:22:58.500 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.498+0000 7f278d6e2640 1 -- 172.21.15.98:0/754713257 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27880d28c0 msgr2=0x7f27880ce9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:58.501 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.498+0000 7f278d6e2640 1 --2- 172.21.15.98:0/754713257 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27880d28c0 0x7f27880ce9e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f2770005fd0 tx=0x7f277002a5d0 comp rx=0 tx=0).stop 2024-09-17T05:22:58.501 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.498+0000 7f278d6e2640 1 -- 172.21.15.98:0/754713257 shutdown_connections 2024-09-17T05:22:58.501 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.498+0000 7f278d6e2640 1 --2- 172.21.15.98:0/754713257 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27880d28c0 0x7f27880ce9e0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:58.501 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.498+0000 7f278d6e2640 1 --2- 172.21.15.98:0/754713257 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f278815c040 0x7f27880ce4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:58.501 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.498+0000 7f278d6e2640 1 -- 172.21.15.98:0/754713257 >> 172.21.15.98:0/754713257 conn(0x7f27880d1da0 msgr2=0x7f27880d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:58.501 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.498+0000 7f278d6e2640 1 -- 172.21.15.98:0/754713257 shutdown_connections 2024-09-17T05:22:58.501 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.498+0000 7f278d6e2640 1 -- 172.21.15.98:0/754713257 wait complete. 2024-09-17T05:22:58.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.500+0000 7f278d6e2640 1 Processor -- start 2024-09-17T05:22:58.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.500+0000 7f278d6e2640 1 -- start start 2024-09-17T05:22:58.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.500+0000 7f278d6e2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27880cef20 0x7f27881f88c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:58.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.500+0000 7f278d6e2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27880d28c0 0x7f2788155f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:58.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.500+0000 7f278d6e2640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f278815c040 0x7f27880c97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:58.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.500+0000 7f278d6e2640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f27880ccf80 con 0x7f27880cef20 2024-09-17T05:22:58.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.500+0000 7f278d6e2640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f27880b2c20 con 0x7f27880d28c0 2024-09-17T05:22:58.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.500+0000 7f278d6e2640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f27880cd100 con 0x7f278815c040 2024-09-17T05:22:58.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.500+0000 7f2786ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27880cef20 0x7f27881f88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:58.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.501+0000 7f2786ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27880cef20 0x7f27881f88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48564/0 (socket says 172.21.15.98:48564) 2024-09-17T05:22:58.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.501+0000 7f2786ffd640 1 -- 172.21.15.98:0/4074804552 learned_addr learned my addr 172.21.15.98:0/4074804552 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:58.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.501+0000 7f27867fc640 1 --2- 172.21.15.98:0/4074804552 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27880d28c0 0x7f2788155f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:58.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.501+0000 7f27877fe640 1 --2- 172.21.15.98:0/4074804552 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f278815c040 0x7f27880c97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:58.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.501+0000 7f2786ffd640 1 -- 172.21.15.98:0/4074804552 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f278815c040 msgr2=0x7f27880c97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:58.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.501+0000 7f2786ffd640 1 --2- 172.21.15.98:0/4074804552 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f278815c040 0x7f27880c97f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:58.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.501+0000 7f2786ffd640 1 -- 172.21.15.98:0/4074804552 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27880d28c0 msgr2=0x7f2788155f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:58.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.501+0000 7f2786ffd640 1 --2- 172.21.15.98:0/4074804552 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27880d28c0 0x7f2788155f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:58.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.501+0000 7f2786ffd640 1 -- 172.21.15.98:0/4074804552 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27881f8e00 con 0x7f27880cef20 2024-09-17T05:22:58.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.501+0000 7f27867fc640 1 --2- 172.21.15.98:0/4074804552 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27880d28c0 0x7f2788155f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:22:58.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.501+0000 7f2786ffd640 1 --2- 172.21.15.98:0/4074804552 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27880cef20 0x7f27881f88c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f278000eb30 tx=0x7f278000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:58.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.501+0000 7f277f7fe640 1 -- 172.21.15.98:0/4074804552 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2780010430 con 0x7f27880cef20 2024-09-17T05:22:58.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.501+0000 7f277f7fe640 1 -- 172.21.15.98:0/4074804552 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f27800105d0 con 0x7f27880cef20 2024-09-17T05:22:58.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.501+0000 7f278d6e2640 1 -- 172.21.15.98:0/4074804552 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f278806df10 con 0x7f27880cef20 2024-09-17T05:22:58.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.501+0000 7f277f7fe640 1 -- 172.21.15.98:0/4074804552 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2780010a20 con 0x7f27880cef20 2024-09-17T05:22:58.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.501+0000 7f278d6e2640 1 -- 172.21.15.98:0/4074804552 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f278806e1b0 con 0x7f27880cef20 2024-09-17T05:22:58.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.502+0000 7f278d6e2640 1 -- 172.21.15.98:0/4074804552 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27880cd690 con 0x7f27880cef20 2024-09-17T05:22:58.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.503+0000 7f277f7fe640 1 -- 172.21.15.98:0/4074804552 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 6) ==== 101594+0+0 (secure 0 0 0) 0x7f2780010bc0 con 0x7f27880cef20 2024-09-17T05:22:58.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.503+0000 7f277f7fe640 1 --2- 172.21.15.98:0/4074804552 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f276c078d40 0x7f276c07b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:58.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.503+0000 7f277f7fe640 1 -- 172.21.15.98:0/4074804552 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f278009bc30 con 0x7f27880cef20 2024-09-17T05:22:58.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.503+0000 7f27867fc640 1 --2- 172.21.15.98:0/4074804552 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f276c078d40 0x7f276c07b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:58.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.504+0000 7f27867fc640 1 --2- 172.21.15.98:0/4074804552 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f276c078d40 0x7f276c07b200 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2770033000 tx=0x7f2770004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:58.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.507+0000 7f277f7fe640 1 -- 172.21.15.98:0/4074804552 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f27881f8e00 con 0x7f27880cef20 2024-09-17T05:22:58.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.683+0000 7f278d6e2640 1 -- 172.21.15.98:0/4074804552 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7f2788156470 con 0x7f27880cef20 2024-09-17T05:22:58.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.686+0000 7f277f7fe640 1 -- 172.21.15.98:0/4074804552 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v29) ==== 71+0+0 (secure 0 0 0) 0x7f2780064070 con 0x7f27880cef20 2024-09-17T05:22:58.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.688+0000 7f278d6e2640 1 -- 172.21.15.98:0/4074804552 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f276c078d40 msgr2=0x7f276c07b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:58.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.688+0000 7f278d6e2640 1 --2- 172.21.15.98:0/4074804552 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f276c078d40 0x7f276c07b200 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2770033000 tx=0x7f2770004730 comp rx=0 tx=0).stop 2024-09-17T05:22:58.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.688+0000 7f278d6e2640 1 -- 172.21.15.98:0/4074804552 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27880cef20 msgr2=0x7f27881f88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:58.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.688+0000 7f278d6e2640 1 --2- 172.21.15.98:0/4074804552 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27880cef20 0x7f27881f88c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f278000eb30 tx=0x7f278000c2d0 comp rx=0 tx=0).stop 2024-09-17T05:22:58.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.689+0000 7f278d6e2640 1 -- 172.21.15.98:0/4074804552 shutdown_connections 2024-09-17T05:22:58.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.689+0000 7f278d6e2640 1 --2- 172.21.15.98:0/4074804552 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f276c078d40 0x7f276c07b200 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:58.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.689+0000 7f278d6e2640 1 --2- 172.21.15.98:0/4074804552 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f278815c040 0x7f27880c97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:58.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.689+0000 7f278d6e2640 1 --2- 172.21.15.98:0/4074804552 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27880d28c0 0x7f2788155f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:58.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.689+0000 7f278d6e2640 1 --2- 172.21.15.98:0/4074804552 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27880cef20 0x7f27881f88c0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:58.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.689+0000 7f278d6e2640 1 -- 172.21.15.98:0/4074804552 >> 172.21.15.98:0/4074804552 conn(0x7f27880d1da0 msgr2=0x7f27880c7db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:58.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.689+0000 7f278d6e2640 1 -- 172.21.15.98:0/4074804552 shutdown_connections 2024-09-17T05:22:58.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.689+0000 7f278d6e2640 1 -- 172.21.15.98:0/4074804552 wait complete. 2024-09-17T05:22:58.701 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread' 2024-09-17T05:22:58.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.800+0000 7fcc85117640 1 -- 172.21.15.98:0/1954173420 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcc800b43f0 msgr2=0x7fcc800b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:58.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.800+0000 7fcc85117640 1 --2- 172.21.15.98:0/1954173420 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcc800b43f0 0x7fcc800b47d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fcc70005fd0 tx=0x7fcc7002a4b0 comp rx=0 tx=0).stop 2024-09-17T05:22:58.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.800+0000 7fcc85117640 1 -- 172.21.15.98:0/1954173420 shutdown_connections 2024-09-17T05:22:58.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.800+0000 7fcc85117640 1 --2- 172.21.15.98:0/1954173420 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc80073bb0 0x7fcc8006ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:58.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.800+0000 7fcc85117640 1 --2- 172.21.15.98:0/1954173420 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcc800b43f0 0x7fcc800b47d0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:58.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.800+0000 7fcc85117640 1 -- 172.21.15.98:0/1954173420 >> 172.21.15.98:0/1954173420 conn(0x7fcc800b1950 msgr2=0x7fcc800b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:58.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.800+0000 7fcc85117640 1 -- 172.21.15.98:0/1954173420 shutdown_connections 2024-09-17T05:22:58.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.800+0000 7fcc85117640 1 -- 172.21.15.98:0/1954173420 wait complete. 2024-09-17T05:22:58.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.801+0000 7fcc85117640 1 Processor -- start 2024-09-17T05:22:58.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.801+0000 7fcc85117640 1 -- start start 2024-09-17T05:22:58.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.802+0000 7fcc85117640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc80073bb0 0x7fcc80156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:58.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.802+0000 7fcc85117640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcc80074150 0x7fcc801402f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:58.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.802+0000 7fcc85117640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc800b43f0 0x7fcc800ada20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:58.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.802+0000 7fcc85117640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fcc8006f3b0 con 0x7fcc80074150 2024-09-17T05:22:58.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.802+0000 7fcc85117640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fcc800704c0 con 0x7fcc80073bb0 2024-09-17T05:22:58.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.802+0000 7fcc85117640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fcc8006f530 con 0x7fcc800b43f0 2024-09-17T05:22:58.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.802+0000 7fcc7e59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcc80074150 0x7fcc801402f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:58.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.802+0000 7fcc7e59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcc80074150 0x7fcc801402f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48578/0 (socket says 172.21.15.98:48578) 2024-09-17T05:22:58.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.802+0000 7fcc7e59c640 1 -- 172.21.15.98:0/189014580 learned_addr learned my addr 172.21.15.98:0/189014580 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:58.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.802+0000 7fcc7ed9d640 1 --2- 172.21.15.98:0/189014580 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc80073bb0 0x7fcc80156ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:58.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.802+0000 7fcc7f59e640 1 --2- 172.21.15.98:0/189014580 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc800b43f0 0x7fcc800ada20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:58.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.803+0000 7fcc7e59c640 1 -- 172.21.15.98:0/189014580 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc800b43f0 msgr2=0x7fcc800ada20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:58.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.803+0000 7fcc7e59c640 1 --2- 172.21.15.98:0/189014580 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc800b43f0 0x7fcc800ada20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:58.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.803+0000 7fcc7e59c640 1 -- 172.21.15.98:0/189014580 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc80073bb0 msgr2=0x7fcc80156ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:58.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.803+0000 7fcc7e59c640 1 --2- 172.21.15.98:0/189014580 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc80073bb0 0x7fcc80156ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:58.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.803+0000 7fcc7e59c640 1 -- 172.21.15.98:0/189014580 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc800c9070 con 0x7fcc80074150 2024-09-17T05:22:58.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.803+0000 7fcc7f59e640 1 --2- 172.21.15.98:0/189014580 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc800b43f0 0x7fcc800ada20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:22:58.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.803+0000 7fcc7ed9d640 1 --2- 172.21.15.98:0/189014580 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc80073bb0 0x7fcc80156ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:22:58.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.803+0000 7fcc7e59c640 1 --2- 172.21.15.98:0/189014580 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcc80074150 0x7fcc801402f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fcc7400c500 tx=0x7fcc7400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:58.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.803+0000 7fcc677fe640 1 -- 172.21.15.98:0/189014580 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc740052d0 con 0x7fcc80074150 2024-09-17T05:22:58.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.803+0000 7fcc677fe640 1 -- 172.21.15.98:0/189014580 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcc74005470 con 0x7fcc80074150 2024-09-17T05:22:58.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.803+0000 7fcc677fe640 1 -- 172.21.15.98:0/189014580 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc74012870 con 0x7fcc80074150 2024-09-17T05:22:58.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.803+0000 7fcc85117640 1 -- 172.21.15.98:0/189014580 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc800c9350 con 0x7fcc80074150 2024-09-17T05:22:58.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.803+0000 7fcc85117640 1 -- 172.21.15.98:0/189014580 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc800cc070 con 0x7fcc80074150 2024-09-17T05:22:58.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.804+0000 7fcc85117640 1 -- 172.21.15.98:0/189014580 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc800760b0 con 0x7fcc80074150 2024-09-17T05:22:58.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.804+0000 7fcc677fe640 1 -- 172.21.15.98:0/189014580 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 6) ==== 101594+0+0 (secure 0 0 0) 0x7fcc740035f0 con 0x7fcc80074150 2024-09-17T05:22:58.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.805+0000 7fcc677fe640 1 --2- 172.21.15.98:0/189014580 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fcc6c078d40 0x7fcc6c07b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:58.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.805+0000 7fcc677fe640 1 -- 172.21.15.98:0/189014580 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fcc7409a9a0 con 0x7fcc80074150 2024-09-17T05:22:58.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.805+0000 7fcc7ed9d640 1 --2- 172.21.15.98:0/189014580 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fcc6c078d40 0x7fcc6c07b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:58.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.806+0000 7fcc7ed9d640 1 --2- 172.21.15.98:0/189014580 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fcc6c078d40 0x7fcc6c07b200 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fcc70033000 tx=0x7fcc70004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:58.811 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:58.809+0000 7fcc677fe640 1 -- 172.21.15.98:0/189014580 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fcc800cf9d0 con 0x7fcc80074150 2024-09-17T05:22:59.056 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.054+0000 7fcc85117640 1 -- 172.21.15.98:0/189014580 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread"]} v 0) -- 0x7fcc800749b0 con 0x7fcc80074150 2024-09-17T05:22:59.378 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.376+0000 7fcc677fe640 1 -- 172.21.15.98:0/189014580 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread"]}]=0 v85) ==== 167+0+0 (secure 0 0 0) 0x7fcc74062df0 con 0x7fcc80074150 2024-09-17T05:22:59.381 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.379+0000 7fcc85117640 1 -- 172.21.15.98:0/189014580 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fcc6c078d40 msgr2=0x7fcc6c07b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:59.381 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.379+0000 7fcc85117640 1 --2- 172.21.15.98:0/189014580 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fcc6c078d40 0x7fcc6c07b200 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fcc70033000 tx=0x7fcc70004730 comp rx=0 tx=0).stop 2024-09-17T05:22:59.381 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.379+0000 7fcc85117640 1 -- 172.21.15.98:0/189014580 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcc80074150 msgr2=0x7fcc801402f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:59.381 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.379+0000 7fcc85117640 1 --2- 172.21.15.98:0/189014580 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcc80074150 0x7fcc801402f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fcc7400c500 tx=0x7fcc7400c9c0 comp rx=0 tx=0).stop 2024-09-17T05:22:59.381 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.379+0000 7fcc85117640 1 -- 172.21.15.98:0/189014580 shutdown_connections 2024-09-17T05:22:59.381 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.379+0000 7fcc85117640 1 --2- 172.21.15.98:0/189014580 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fcc6c078d40 0x7fcc6c07b200 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:59.381 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.379+0000 7fcc85117640 1 --2- 172.21.15.98:0/189014580 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc800b43f0 0x7fcc800ada20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:59.381 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.379+0000 7fcc85117640 1 --2- 172.21.15.98:0/189014580 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcc80074150 0x7fcc801402f0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:59.381 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.379+0000 7fcc85117640 1 --2- 172.21.15.98:0/189014580 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc80073bb0 0x7fcc80156ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:59.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.379+0000 7fcc85117640 1 -- 172.21.15.98:0/189014580 >> 172.21.15.98:0/189014580 conn(0x7fcc800b1950 msgr2=0x7fcc8015cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:59.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.379+0000 7fcc85117640 1 -- 172.21.15.98:0/189014580 shutdown_connections 2024-09-17T05:22:59.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.379+0000 7fcc85117640 1 -- 172.21.15.98:0/189014580 wait complete. 2024-09-17T05:22:59.392 INFO:tasks.cephfs_test_runner:test_volumes_module_finisher_thread (tasks.cephfs.test_volumes.TestPerModuleFinsherThread) ... ok 2024-09-17T05:22:59.393 INFO:tasks.cephfs_test_runner: 2024-09-17T05:22:59.393 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-17T05:22:59.393 INFO:tasks.cephfs_test_runner:Ran 1 test in 43.798s 2024-09-17T05:22:59.393 INFO:tasks.cephfs_test_runner: 2024-09-17T05:22:59.393 INFO:tasks.cephfs_test_runner:OK 2024-09-17T05:22:59.393 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-17T05:22:59.409 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-17T05:22:59.442 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:22:59.545 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.543+0000 7fcc2d870640 1 -- 172.21.15.98:0/498842686 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcc28074150 msgr2=0x7fcc2806e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:59.545 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.543+0000 7fcc2d870640 1 --2- 172.21.15.98:0/498842686 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcc28074150 0x7fcc2806e760 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fcc28075310 tx=0x7fcc1c02a440 comp rx=0 tx=0).stop 2024-09-17T05:22:59.545 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.543+0000 7fcc2d870640 1 -- 172.21.15.98:0/498842686 shutdown_connections 2024-09-17T05:22:59.545 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.543+0000 7fcc2d870640 1 --2- 172.21.15.98:0/498842686 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc280746a0 0x7fcc2806eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:59.545 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.543+0000 7fcc2d870640 1 --2- 172.21.15.98:0/498842686 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcc28074150 0x7fcc2806e760 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:59.545 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.543+0000 7fcc2d870640 1 --2- 172.21.15.98:0/498842686 >> v2:172.21.15.167:3300/0 conn(0x7fcc280b43f0 0x7fcc280b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:59.546 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.543+0000 7fcc2d870640 1 -- 172.21.15.98:0/498842686 >> 172.21.15.98:0/498842686 conn(0x7fcc280b1950 msgr2=0x7fcc280b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:59.546 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.543+0000 7fcc2d870640 1 -- 172.21.15.98:0/498842686 shutdown_connections 2024-09-17T05:22:59.546 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.543+0000 7fcc2d870640 1 -- 172.21.15.98:0/498842686 wait complete. 2024-09-17T05:22:59.548 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.544+0000 7fcc2d870640 1 Processor -- start 2024-09-17T05:22:59.548 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.544+0000 7fcc2d870640 1 -- start start 2024-09-17T05:22:59.548 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.545+0000 7fcc2d870640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcc28074150 0x7fcc28157a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:59.548 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.545+0000 7fcc2d870640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc280746a0 0x7fcc28156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:59.548 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.545+0000 7fcc2d870640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc280b43f0 0x7fcc28150a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:59.548 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.545+0000 7fcc2d870640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fcc28073cb0 con 0x7fcc28074150 2024-09-17T05:22:59.548 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.545+0000 7fcc2d870640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fcc2815dd20 con 0x7fcc280b43f0 2024-09-17T05:22:59.548 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.545+0000 7fcc2d870640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fcc28073e30 con 0x7fcc280746a0 2024-09-17T05:22:59.548 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.545+0000 7fcc26ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcc28074150 0x7fcc28157a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:59.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.545+0000 7fcc26ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcc28074150 0x7fcc28157a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48604/0 (socket says 172.21.15.98:48604) 2024-09-17T05:22:59.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.545+0000 7fcc26ffd640 1 -- 172.21.15.98:0/4227225253 learned_addr learned my addr 172.21.15.98:0/4227225253 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:59.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.545+0000 7fcc267fc640 1 --2- 172.21.15.98:0/4227225253 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc280746a0 0x7fcc28156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:59.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.545+0000 7fcc277fe640 1 --2- 172.21.15.98:0/4227225253 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc280b43f0 0x7fcc28150a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:59.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.545+0000 7fcc26ffd640 1 -- 172.21.15.98:0/4227225253 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc280746a0 msgr2=0x7fcc28156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:59.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.545+0000 7fcc26ffd640 1 --2- 172.21.15.98:0/4227225253 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc280746a0 0x7fcc28156aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:59.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.545+0000 7fcc26ffd640 1 -- 172.21.15.98:0/4227225253 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc280b43f0 msgr2=0x7fcc28150a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:59.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.545+0000 7fcc26ffd640 1 --2- 172.21.15.98:0/4227225253 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc280b43f0 0x7fcc28150a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:59.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.545+0000 7fcc26ffd640 1 -- 172.21.15.98:0/4227225253 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc281580a0 con 0x7fcc28074150 2024-09-17T05:22:59.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.545+0000 7fcc277fe640 1 --2- 172.21.15.98:0/4227225253 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc280b43f0 0x7fcc28150a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:22:59.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.546+0000 7fcc26ffd640 1 --2- 172.21.15.98:0/4227225253 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcc28074150 0x7fcc28157a90 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fcc1800d740 tx=0x7fcc1800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:59.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.546+0000 7fcc0ffff640 1 -- 172.21.15.98:0/4227225253 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc18017070 con 0x7fcc28074150 2024-09-17T05:22:59.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.546+0000 7fcc0ffff640 1 -- 172.21.15.98:0/4227225253 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcc18009d20 con 0x7fcc28074150 2024-09-17T05:22:59.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.546+0000 7fcc2d870640 1 -- 172.21.15.98:0/4227225253 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc28158380 con 0x7fcc28074150 2024-09-17T05:22:59.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.546+0000 7fcc0ffff640 1 -- 172.21.15.98:0/4227225253 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc180106c0 con 0x7fcc28074150 2024-09-17T05:22:59.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.546+0000 7fcc2d870640 1 -- 172.21.15.98:0/4227225253 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc28158940 con 0x7fcc28074150 2024-09-17T05:22:59.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.547+0000 7fcc2d870640 1 -- 172.21.15.98:0/4227225253 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc2806f410 con 0x7fcc28074150 2024-09-17T05:22:59.551 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.547+0000 7fcc0ffff640 1 -- 172.21.15.98:0/4227225253 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 6) ==== 101594+0+0 (secure 0 0 0) 0x7fcc1801a070 con 0x7fcc28074150 2024-09-17T05:22:59.551 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.548+0000 7fcc0ffff640 1 --2- 172.21.15.98:0/4227225253 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fcc14078d40 0x7fcc1407b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:59.551 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.548+0000 7fcc0ffff640 1 -- 172.21.15.98:0/4227225253 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fcc1809af20 con 0x7fcc28074150 2024-09-17T05:22:59.551 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.548+0000 7fcc267fc640 1 --2- 172.21.15.98:0/4227225253 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fcc14078d40 0x7fcc1407b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:59.551 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.548+0000 7fcc267fc640 1 --2- 172.21.15.98:0/4227225253 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fcc14078d40 0x7fcc1407b200 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c033000 tx=0x7fcc1c004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:59.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.552+0000 7fcc0ffff640 1 -- 172.21.15.98:0/4227225253 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fcc180633f0 con 0x7fcc28074150 2024-09-17T05:22:59.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.728+0000 7fcc2d870640 1 -- 172.21.15.98:0/4227225253 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcc280aed40 con 0x7fcc28074150 2024-09-17T05:22:59.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.729+0000 7fcc0ffff640 1 -- 172.21.15.98:0/4227225253 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+13022 (secure 0 0 0) 0x7fcc18062cf0 con 0x7fcc28074150 2024-09-17T05:22:59.731 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:22:59.731 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":35,"fsid":"fcbf5a43-b3d8-497c-b15d-3cc022477cf0","created":"2024-09-17T05:21:29.852143+0000","modified":"2024-09-17T05:22:58.370617+0000","last_up_change":"2024-09-17T05:21:42.925756+0000","last_in_change":"2024-09-17T05:21:32.893880+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:21:42.263011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ad711a-df74-438b-b0dc-1499d685c958","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6825","nonce":3644101529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6827","nonce":3644101529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6831","nonce":3644101529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6829","nonce":3644101529}]},"public_addr":"172.21.15.98:6825/3644101529","cluster_addr":"172.21.15.98:6827/3644101529","heartbeat_back_addr":"172.21.15.98:6831/3644101529","heartbeat_front_addr":"172.21.15.98:6829/3644101529","state":["exists","up"]},{"osd":1,"uuid":"f0ccb08d-4d8d-47b8-9320-8c372a6605b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6817","nonce":3902180920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6819","nonce":3902180920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6823","nonce":3902180920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6821","nonce":3902180920}]},"public_addr":"172.21.15.98:6817/3902180920","cluster_addr":"172.21.15.98:6819/3902180920","heartbeat_back_addr":"172.21.15.98:6823/3902180920","heartbeat_front_addr":"172.21.15.98:6821/3902180920","state":["exists","up"]},{"osd":2,"uuid":"a0985398-5e5f-494f-8abf-f785f19e94ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6801","nonce":1518887101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6803","nonce":1518887101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6807","nonce":1518887101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6805","nonce":1518887101}]},"public_addr":"172.21.15.98:6801/1518887101","cluster_addr":"172.21.15.98:6803/1518887101","heartbeat_back_addr":"172.21.15.98:6807/1518887101","heartbeat_front_addr":"172.21.15.98:6805/1518887101","state":["exists","up"]},{"osd":3,"uuid":"e960be2e-0c3a-426e-9507-d3be5895f9e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6809","nonce":4125246091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6811","nonce":4125246091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6815","nonce":4125246091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6813","nonce":4125246091}]},"public_addr":"172.21.15.98:6809/4125246091","cluster_addr":"172.21.15.98:6811/4125246091","heartbeat_back_addr":"172.21.15.98:6815/4125246091","heartbeat_front_addr":"172.21.15.98:6813/4125246091","state":["exists","up"]},{"osd":4,"uuid":"49118c00-3dc1-43ef-8ed4-aca61e56a507","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6811","nonce":765789888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6813","nonce":765789888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6817","nonce":765789888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6815","nonce":765789888}]},"public_addr":"172.21.15.167:6811/765789888","cluster_addr":"172.21.15.167:6813/765789888","heartbeat_back_addr":"172.21.15.167:6817/765789888","heartbeat_front_addr":"172.21.15.167:6815/765789888","state":["exists","up"]},{"osd":5,"uuid":"9f4e0143-2b3d-40e4-bfb5-043d9a9f4ba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6803","nonce":2567019914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6805","nonce":2567019914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6809","nonce":2567019914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6807","nonce":2567019914}]},"public_addr":"172.21.15.167:6803/2567019914","cluster_addr":"172.21.15.167:6805/2567019914","heartbeat_back_addr":"172.21.15.167:6809/2567019914","heartbeat_front_addr":"172.21.15.167:6807/2567019914","state":["exists","up"]},{"osd":6,"uuid":"28720514-e627-4dea-8f4d-bd311ec31361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6819","nonce":96262631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6821","nonce":96262631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6825","nonce":96262631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6823","nonce":96262631}]},"public_addr":"172.21.15.167:6819/96262631","cluster_addr":"172.21.15.167:6821/96262631","heartbeat_back_addr":"172.21.15.167:6825/96262631","heartbeat_front_addr":"172.21.15.167:6823/96262631","state":["exists","up"]},{"osd":7,"uuid":"01edaf9c-3898-406e-85b0-774cfda60adf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6827","nonce":4169560909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6829","nonce":4169560909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6833","nonce":4169560909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6831","nonce":4169560909}]},"public_addr":"172.21.15.167:6827/4169560909","cluster_addr":"172.21.15.167:6829/4169560909","heartbeat_back_addr":"172.21.15.167:6833/4169560909","heartbeat_front_addr":"172.21.15.167:6831/4169560909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:40.054920+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.177110+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.749278+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.400155+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.503576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.196417+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.371063+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.212852+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.167:6837/3889162905":"2024-09-18T05:22:55.361131+0000","172.21.15.167:6835/3889162905":"2024-09-18T05:22:55.361131+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:22:59.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.731+0000 7fcc2d870640 1 -- 172.21.15.98:0/4227225253 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fcc14078d40 msgr2=0x7fcc1407b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:59.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.731+0000 7fcc2d870640 1 --2- 172.21.15.98:0/4227225253 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fcc14078d40 0x7fcc1407b200 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c033000 tx=0x7fcc1c004730 comp rx=0 tx=0).stop 2024-09-17T05:22:59.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.731+0000 7fcc2d870640 1 -- 172.21.15.98:0/4227225253 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcc28074150 msgr2=0x7fcc28157a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:59.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.731+0000 7fcc2d870640 1 --2- 172.21.15.98:0/4227225253 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcc28074150 0x7fcc28157a90 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fcc1800d740 tx=0x7fcc1800dc00 comp rx=0 tx=0).stop 2024-09-17T05:22:59.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.731+0000 7fcc2d870640 1 -- 172.21.15.98:0/4227225253 shutdown_connections 2024-09-17T05:22:59.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.731+0000 7fcc2d870640 1 --2- 172.21.15.98:0/4227225253 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fcc14078d40 0x7fcc1407b200 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:59.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.731+0000 7fcc2d870640 1 --2- 172.21.15.98:0/4227225253 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc280b43f0 0x7fcc28150a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:59.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.731+0000 7fcc2d870640 1 --2- 172.21.15.98:0/4227225253 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc280746a0 0x7fcc28156aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:59.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.731+0000 7fcc2d870640 1 --2- 172.21.15.98:0/4227225253 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcc28074150 0x7fcc28157a90 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:59.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.731+0000 7fcc2d870640 1 -- 172.21.15.98:0/4227225253 >> 172.21.15.98:0/4227225253 conn(0x7fcc280b1950 msgr2=0x7fcc28152680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:59.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.732+0000 7fcc2d870640 1 -- 172.21.15.98:0/4227225253 shutdown_connections 2024-09-17T05:22:59.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.732+0000 7fcc2d870640 1 -- 172.21.15.98:0/4227225253 wait complete. 2024-09-17T05:22:59.745 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T05:21:42.263011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T05:22:59.745 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T05:22:59.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.847+0000 7fbf260c6640 1 -- 172.21.15.98:0/1715981214 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf2015c080 msgr2=0x7fbf2015f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:59.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.847+0000 7fbf260c6640 1 --2- 172.21.15.98:0/1715981214 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf2015c080 0x7fbf2015f090 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fbf18009830 tx=0x7fbf1802a5c0 comp rx=0 tx=0).stop 2024-09-17T05:22:59.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.847+0000 7fbf260c6640 1 -- 172.21.15.98:0/1715981214 shutdown_connections 2024-09-17T05:22:59.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.847+0000 7fbf260c6640 1 --2- 172.21.15.98:0/1715981214 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf2015c080 0x7fbf2015f090 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:59.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.847+0000 7fbf260c6640 1 -- 172.21.15.98:0/1715981214 >> 172.21.15.98:0/1715981214 conn(0x7fbf200b1840 msgr2=0x7fbf200b1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:59.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.847+0000 7fbf260c6640 1 -- 172.21.15.98:0/1715981214 shutdown_connections 2024-09-17T05:22:59.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.847+0000 7fbf260c6640 1 -- 172.21.15.98:0/1715981214 wait complete. 2024-09-17T05:22:59.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.848+0000 7fbf260c6640 1 Processor -- start 2024-09-17T05:22:59.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.848+0000 7fbf260c6640 1 -- start start 2024-09-17T05:22:59.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.849+0000 7fbf260c6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf200b3370 0x7fbf20154e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:59.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.849+0000 7fbf260c6640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbf200cf2f0 0x7fbf20159d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:59.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.849+0000 7fbf260c6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf2015c080 0x7fbf2015a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:59.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.849+0000 7fbf260c6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fbf20166080 con 0x7fbf2015c080 2024-09-17T05:22:59.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.849+0000 7fbf260c6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbf20165f00 con 0x7fbf200b3370 2024-09-17T05:22:59.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.849+0000 7fbf260c6640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fbf20166200 con 0x7fbf200cf2f0 2024-09-17T05:22:59.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.849+0000 7fbf1ffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf2015c080 0x7fbf2015a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:59.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.849+0000 7fbf1ffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf2015c080 0x7fbf2015a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48610/0 (socket says 172.21.15.98:48610) 2024-09-17T05:22:59.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.849+0000 7fbf1ffff640 1 -- 172.21.15.98:0/1709089917 learned_addr learned my addr 172.21.15.98:0/1709089917 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:22:59.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.849+0000 7fbf1effd640 1 --2- 172.21.15.98:0/1709089917 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbf200cf2f0 0x7fbf20159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:59.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.849+0000 7fbf1f7fe640 1 --2- 172.21.15.98:0/1709089917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf200b3370 0x7fbf20154e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:59.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.849+0000 7fbf1ffff640 1 -- 172.21.15.98:0/1709089917 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbf200cf2f0 msgr2=0x7fbf20159d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:59.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.849+0000 7fbf1ffff640 1 --2- 172.21.15.98:0/1709089917 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbf200cf2f0 0x7fbf20159d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:59.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.849+0000 7fbf1ffff640 1 -- 172.21.15.98:0/1709089917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf200b3370 msgr2=0x7fbf20154e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:59.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.849+0000 7fbf1ffff640 1 --2- 172.21.15.98:0/1709089917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf200b3370 0x7fbf20154e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:59.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.849+0000 7fbf1ffff640 1 -- 172.21.15.98:0/1709089917 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf2006fd20 con 0x7fbf2015c080 2024-09-17T05:22:59.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.849+0000 7fbf1effd640 1 --2- 172.21.15.98:0/1709089917 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbf200cf2f0 0x7fbf20159d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:22:59.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.849+0000 7fbf1f7fe640 1 --2- 172.21.15.98:0/1709089917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf200b3370 0x7fbf20154e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:22:59.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.850+0000 7fbf1ffff640 1 --2- 172.21.15.98:0/1709089917 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf2015c080 0x7fbf2015a2c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fbf1802abb0 tx=0x7fbf18033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:59.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.850+0000 7fbf07fff640 1 -- 172.21.15.98:0/1709089917 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf18031d60 con 0x7fbf2015c080 2024-09-17T05:22:59.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.850+0000 7fbf07fff640 1 -- 172.21.15.98:0/1709089917 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbf18033e10 con 0x7fbf2015c080 2024-09-17T05:22:59.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.850+0000 7fbf260c6640 1 -- 172.21.15.98:0/1709089917 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf20070000 con 0x7fbf2015c080 2024-09-17T05:22:59.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.850+0000 7fbf07fff640 1 -- 172.21.15.98:0/1709089917 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf18005260 con 0x7fbf2015c080 2024-09-17T05:22:59.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.850+0000 7fbf260c6640 1 -- 172.21.15.98:0/1709089917 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf200705c0 con 0x7fbf2015c080 2024-09-17T05:22:59.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.851+0000 7fbf260c6640 1 -- 172.21.15.98:0/1709089917 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf200cebe0 con 0x7fbf2015c080 2024-09-17T05:22:59.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.851+0000 7fbf07fff640 1 -- 172.21.15.98:0/1709089917 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 6) ==== 101594+0+0 (secure 0 0 0) 0x7fbf18005400 con 0x7fbf2015c080 2024-09-17T05:22:59.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.852+0000 7fbf07fff640 1 --2- 172.21.15.98:0/1709089917 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fbf0c078d40 0x7fbf0c07b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:59.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.852+0000 7fbf07fff640 1 -- 172.21.15.98:0/1709089917 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fbf180bbee0 con 0x7fbf2015c080 2024-09-17T05:22:59.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.852+0000 7fbf1f7fe640 1 --2- 172.21.15.98:0/1709089917 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fbf0c078d40 0x7fbf0c07b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:59.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.853+0000 7fbf1f7fe640 1 --2- 172.21.15.98:0/1709089917 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fbf0c078d40 0x7fbf0c07b200 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbf100012e0 tx=0x7fbf10009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:59.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:22:59.856+0000 7fbf07fff640 1 -- 172.21.15.98:0/1709089917 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fbf1803f030 con 0x7fbf2015c080 2024-09-17T05:23:00.037 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.034+0000 7fbf260c6640 1 -- 172.21.15.98:0/1709089917 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fbf2015d3e0 con 0x7fbf2015c080 2024-09-17T05:23:00.037 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.035+0000 7fbf07fff640 1 -- 172.21.15.98:0/1709089917 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) ==== 93+0+10 (secure 0 0 0) 0x7fbf18031770 con 0x7fbf2015c080 2024-09-17T05:23:00.037 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 1 2024-09-17T05:23:00.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.037+0000 7fbf260c6640 1 -- 172.21.15.98:0/1709089917 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fbf0c078d40 msgr2=0x7fbf0c07b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:00.040 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.037+0000 7fbf260c6640 1 --2- 172.21.15.98:0/1709089917 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fbf0c078d40 0x7fbf0c07b200 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbf100012e0 tx=0x7fbf10009040 comp rx=0 tx=0).stop 2024-09-17T05:23:00.040 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.037+0000 7fbf260c6640 1 -- 172.21.15.98:0/1709089917 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf2015c080 msgr2=0x7fbf2015a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:00.040 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.037+0000 7fbf260c6640 1 --2- 172.21.15.98:0/1709089917 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf2015c080 0x7fbf2015a2c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fbf1802abb0 tx=0x7fbf18033c20 comp rx=0 tx=0).stop 2024-09-17T05:23:00.040 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.037+0000 7fbf260c6640 1 -- 172.21.15.98:0/1709089917 shutdown_connections 2024-09-17T05:23:00.040 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.037+0000 7fbf260c6640 1 --2- 172.21.15.98:0/1709089917 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fbf0c078d40 0x7fbf0c07b200 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:00.040 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.037+0000 7fbf260c6640 1 --2- 172.21.15.98:0/1709089917 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf2015c080 0x7fbf2015a2c0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:00.040 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.037+0000 7fbf260c6640 1 --2- 172.21.15.98:0/1709089917 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbf200cf2f0 0x7fbf20159d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:00.040 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.037+0000 7fbf260c6640 1 --2- 172.21.15.98:0/1709089917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf200b3370 0x7fbf20154e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:00.040 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.037+0000 7fbf260c6640 1 -- 172.21.15.98:0/1709089917 >> 172.21.15.98:0/1709089917 conn(0x7fbf200b1840 msgr2=0x7fbf200b0c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:00.040 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.037+0000 7fbf260c6640 1 -- 172.21.15.98:0/1709089917 shutdown_connections 2024-09-17T05:23:00.040 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.037+0000 7fbf260c6640 1 -- 172.21.15.98:0/1709089917 wait complete. 2024-09-17T05:23:00.050 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-17T05:23:00.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.148+0000 7f0716e52640 1 -- 172.21.15.98:0/2758925034 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f07100d2050 msgr2=0x7f07100d0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:00.151 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.148+0000 7f0716e52640 1 --2- 172.21.15.98:0/2758925034 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f07100d2050 0x7f07100d0f00 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f071008e550 tx=0x7f06fc02a530 comp rx=0 tx=0).stop 2024-09-17T05:23:00.151 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.148+0000 7f0716e52640 1 -- 172.21.15.98:0/2758925034 shutdown_connections 2024-09-17T05:23:00.151 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.148+0000 7f0716e52640 1 --2- 172.21.15.98:0/2758925034 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f07100d2050 0x7f07100d0f00 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:00.151 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.148+0000 7f0716e52640 1 --2- 172.21.15.98:0/2758925034 >> v2:172.21.15.167:3300/0 conn(0x7f071015e0d0 0x7f07100d09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:00.151 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.148+0000 7f0716e52640 1 -- 172.21.15.98:0/2758925034 >> 172.21.15.98:0/2758925034 conn(0x7f07100d3fe0 msgr2=0x7f07100d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:00.151 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.148+0000 7f0716e52640 1 -- 172.21.15.98:0/2758925034 shutdown_connections 2024-09-17T05:23:00.151 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.148+0000 7f0716e52640 1 -- 172.21.15.98:0/2758925034 wait complete. 2024-09-17T05:23:00.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.150+0000 7f0716e52640 1 Processor -- start 2024-09-17T05:23:00.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.150+0000 7f0716e52640 1 -- start start 2024-09-17T05:23:00.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.150+0000 7f0716e52640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f07100d1440 0x7f07100b18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:00.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.150+0000 7f0716e52640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07100d2050 0x7f0710160730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:00.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.150+0000 7f0716e52640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f071015e0d0 0x7f0710152b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:00.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.150+0000 7f0716e52640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f071015ebc0 con 0x7f071015e0d0 2024-09-17T05:23:00.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.150+0000 7f0716e52640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f07100cff60 con 0x7f07100d2050 2024-09-17T05:23:00.155 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.150+0000 7f0716e52640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f071015ed40 con 0x7f07100d1440 2024-09-17T05:23:00.155 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.151+0000 7f07153ef640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f071015e0d0 0x7f0710152b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:00.155 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.151+0000 7f07153ef640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f071015e0d0 0x7f0710152b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48622/0 (socket says 172.21.15.98:48622) 2024-09-17T05:23:00.155 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.151+0000 7f07153ef640 1 -- 172.21.15.98:0/3637581905 learned_addr learned my addr 172.21.15.98:0/3637581905 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:23:00.155 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.151+0000 7f070ffff640 1 --2- 172.21.15.98:0/3637581905 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07100d2050 0x7f0710160730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:00.155 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.151+0000 7f0714bee640 1 --2- 172.21.15.98:0/3637581905 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f07100d1440 0x7f07100b18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:00.155 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.151+0000 7f07153ef640 1 -- 172.21.15.98:0/3637581905 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f07100d1440 msgr2=0x7f07100b18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:00.155 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.151+0000 7f07153ef640 1 --2- 172.21.15.98:0/3637581905 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f07100d1440 0x7f07100b18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:00.155 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.151+0000 7f07153ef640 1 -- 172.21.15.98:0/3637581905 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07100d2050 msgr2=0x7f0710160730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:00.155 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.151+0000 7f07153ef640 1 --2- 172.21.15.98:0/3637581905 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07100d2050 0x7f0710160730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:00.155 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.151+0000 7f07153ef640 1 -- 172.21.15.98:0/3637581905 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07101539b0 con 0x7f071015e0d0 2024-09-17T05:23:00.155 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.151+0000 7f07153ef640 1 --2- 172.21.15.98:0/3637581905 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f071015e0d0 0x7f0710152b80 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f070800c770 tx=0x7f070800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:00.156 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.151+0000 7f070d7fa640 1 -- 172.21.15.98:0/3637581905 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0708003da0 con 0x7f071015e0d0 2024-09-17T05:23:00.156 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.151+0000 7f070d7fa640 1 -- 172.21.15.98:0/3637581905 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0708005070 con 0x7f071015e0d0 2024-09-17T05:23:00.156 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.151+0000 7f0716e52640 1 -- 172.21.15.98:0/3637581905 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07101f4f10 con 0x7f071015e0d0 2024-09-17T05:23:00.156 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.151+0000 7f070d7fa640 1 -- 172.21.15.98:0/3637581905 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0708005500 con 0x7f071015e0d0 2024-09-17T05:23:00.156 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.151+0000 7f0716e52640 1 -- 172.21.15.98:0/3637581905 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07100b10b0 con 0x7f071015e0d0 2024-09-17T05:23:00.156 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.152+0000 7f0716e52640 1 -- 172.21.15.98:0/3637581905 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f071015f260 con 0x7f071015e0d0 2024-09-17T05:23:00.157 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.153+0000 7f070d7fa640 1 -- 172.21.15.98:0/3637581905 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 6) ==== 101594+0+0 (secure 0 0 0) 0x7f07080056a0 con 0x7f071015e0d0 2024-09-17T05:23:00.157 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.153+0000 7f070d7fa640 1 --2- 172.21.15.98:0/3637581905 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f06f4078d40 0x7f06f407b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:00.157 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.154+0000 7f070d7fa640 1 -- 172.21.15.98:0/3637581905 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f070809ac40 con 0x7f071015e0d0 2024-09-17T05:23:00.157 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.154+0000 7f0714bee640 1 --2- 172.21.15.98:0/3637581905 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f06f4078d40 0x7f06f407b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:00.157 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.154+0000 7f0714bee640 1 --2- 172.21.15.98:0/3637581905 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f06f4078d40 0x7f06f407b200 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0704005fd0 tx=0x7f0704005850 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:00.159 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.158+0000 7f070d7fa640 1 -- 172.21.15.98:0/3637581905 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f0708063080 con 0x7f071015e0d0 2024-09-17T05:23:00.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.380+0000 7f0716e52640 1 -- 172.21.15.98:0/3637581905 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f07100761d0 con 0x7f071015e0d0 2024-09-17T05:23:00.386 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.385+0000 7f070d7fa640 1 -- 172.21.15.98:0/3637581905 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v6) ==== 81+0+530214 (secure 0 0 0) 0x7f0708062980 con 0x7f071015e0d0 2024-09-17T05:23:00.394 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:23:00.394 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T05:23:00.394 INFO:teuthology.orchestra.run.smithi098.stdout: "epoch": 6, 2024-09-17T05:23:00.394 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.395 INFO:teuthology.orchestra.run.smithi098.stdout: "active_gid": 4103, 2024-09-17T05:23:00.395 INFO:teuthology.orchestra.run.smithi098.stdout: "active_name": "x", 2024-09-17T05:23:00.395 INFO:teuthology.orchestra.run.smithi098.stdout: "active_addrs": { 2024-09-17T05:23:00.395 INFO:teuthology.orchestra.run.smithi098.stdout: "addrvec": [ 2024-09-17T05:23:00.395 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:00.395 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "v2", 2024-09-17T05:23:00.396 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": "172.21.15.167:6800", 2024-09-17T05:23:00.396 INFO:teuthology.orchestra.run.smithi098.stdout: "nonce": 610796449 2024-09-17T05:23:00.396 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.396 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:00.396 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "v1", 2024-09-17T05:23:00.396 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": "172.21.15.167:6801", 2024-09-17T05:23:00.396 INFO:teuthology.orchestra.run.smithi098.stdout: "nonce": 610796449 2024-09-17T05:23:00.396 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.396 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T05:23:00.396 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.397 INFO:teuthology.orchestra.run.smithi098.stdout: "active_addr": "172.21.15.167:6801/610796449", 2024-09-17T05:23:00.397 INFO:teuthology.orchestra.run.smithi098.stdout: "active_change": "2024-09-17T05:21:34.240980+0000", 2024-09-17T05:23:00.397 INFO:teuthology.orchestra.run.smithi098.stdout: "active_mgr_features": 4540719139924082687, 2024-09-17T05:23:00.397 INFO:teuthology.orchestra.run.smithi098.stdout: "available": true, 2024-09-17T05:23:00.397 INFO:teuthology.orchestra.run.smithi098.stdout: "standbys": [ 2024-09-17T05:23:00.397 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:00.397 INFO:teuthology.orchestra.run.smithi098.stdout: "gid": 4112, 2024-09-17T05:23:00.397 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "y", 2024-09-17T05:23:00.397 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr_features": 4540719139924082687, 2024-09-17T05:23:00.397 INFO:teuthology.orchestra.run.smithi098.stdout: "available_modules": [ 2024-09-17T05:23:00.397 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:00.397 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "alerts", 2024-09-17T05:23:00.397 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:00.398 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:00.398 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:00.398 INFO:teuthology.orchestra.run.smithi098.stdout: "interval": { 2024-09-17T05:23:00.398 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "interval", 2024-09-17T05:23:00.398 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-17T05:23:00.398 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.398 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.398 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "60", 2024-09-17T05:23:00.398 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.398 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.398 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.398 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "How frequently to reexamine health status", 2024-09-17T05:23:00.399 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.399 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.399 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.399 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.399 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:00.399 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:00.399 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.399 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.399 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.399 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.399 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.399 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.399 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.400 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.400 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.400 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.400 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.400 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.400 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.401 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.401 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.401 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.401 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.401 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.401 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.401 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:00.401 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:00.401 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.401 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.401 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.401 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.402 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.402 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.402 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.402 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.402 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.402 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.402 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.402 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.402 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:00.402 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:00.402 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.402 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.403 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.403 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:00.403 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.403 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.403 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.403 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.403 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.403 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.403 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.403 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.403 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.404 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.404 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.404 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.404 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.404 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.404 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.404 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:00.404 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:00.404 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.404 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.404 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.404 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.404 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.405 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.405 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.405 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.405 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.405 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.405 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.405 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.405 INFO:teuthology.orchestra.run.smithi098.stdout: "smtp_destination": { 2024-09-17T05:23:00.405 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "smtp_destination", 2024-09-17T05:23:00.405 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.405 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.405 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.405 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.406 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.406 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.406 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.406 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-17T05:23:00.406 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.406 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.406 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.407 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.407 INFO:teuthology.orchestra.run.smithi098.stdout: "smtp_from_name": { 2024-09-17T05:23:00.407 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "smtp_from_name", 2024-09-17T05:23:00.407 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.407 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.407 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.407 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "Ceph", 2024-09-17T05:23:00.407 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.407 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.407 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.407 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Email From: name", 2024-09-17T05:23:00.407 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.407 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.408 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.408 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.408 INFO:teuthology.orchestra.run.smithi098.stdout: "smtp_host": { 2024-09-17T05:23:00.408 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "smtp_host", 2024-09-17T05:23:00.408 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.408 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.408 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.408 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.408 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.408 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.408 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.408 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "SMTP server", 2024-09-17T05:23:00.408 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.409 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.409 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.409 INFO:teuthology.orchestra.run.smithi098.stdout: "smtp_password": { 2024-09-17T05:23:00.409 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "smtp_password", 2024-09-17T05:23:00.409 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.409 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.409 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.409 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.409 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.409 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.409 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.409 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Password to authenticate with", 2024-09-17T05:23:00.410 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.410 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.410 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.410 INFO:teuthology.orchestra.run.smithi098.stdout: "smtp_port": { 2024-09-17T05:23:00.410 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "smtp_port", 2024-09-17T05:23:00.410 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.410 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.410 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.410 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "465", 2024-09-17T05:23:00.410 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.410 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.410 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.411 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "SMTP port", 2024-09-17T05:23:00.411 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.411 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.411 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.411 INFO:teuthology.orchestra.run.smithi098.stdout: "smtp_sender": { 2024-09-17T05:23:00.411 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "smtp_sender", 2024-09-17T05:23:00.411 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.411 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.411 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.411 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.411 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.411 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.412 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.412 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "SMTP envelope sender", 2024-09-17T05:23:00.412 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.412 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.412 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.412 INFO:teuthology.orchestra.run.smithi098.stdout: "smtp_ssl": { 2024-09-17T05:23:00.412 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "smtp_ssl", 2024-09-17T05:23:00.412 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.412 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.412 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.413 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:00.413 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.413 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.413 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.413 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-17T05:23:00.413 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.413 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.413 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.413 INFO:teuthology.orchestra.run.smithi098.stdout: "smtp_user": { 2024-09-17T05:23:00.413 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "smtp_user", 2024-09-17T05:23:00.413 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.413 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.414 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.414 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.414 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.414 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.414 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.414 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "User to authenticate as", 2024-09-17T05:23:00.414 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.414 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.414 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.414 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:00.414 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:00.414 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.415 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:00.415 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.415 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:00.415 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.415 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.415 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.415 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.415 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.415 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.415 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.415 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.415 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:00.416 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "balancer", 2024-09-17T05:23:00.416 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:00.416 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:00.416 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:00.416 INFO:teuthology.orchestra.run.smithi098.stdout: "active": { 2024-09-17T05:23:00.416 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "active", 2024-09-17T05:23:00.416 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.417 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.417 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.417 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:00.417 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.417 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.417 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.417 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "automatically balance PGs across cluster", 2024-09-17T05:23:00.417 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.417 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.417 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.417 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.417 INFO:teuthology.orchestra.run.smithi098.stdout: "begin_time": { 2024-09-17T05:23:00.418 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "begin_time", 2024-09-17T05:23:00.418 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.418 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.418 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.418 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0000", 2024-09-17T05:23:00.418 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.418 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.418 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.418 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "beginning time of day to automatically balance", 2024-09-17T05:23:00.418 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-17T05:23:00.418 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.418 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.418 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.419 INFO:teuthology.orchestra.run.smithi098.stdout: "begin_weekday": { 2024-09-17T05:23:00.419 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "begin_weekday", 2024-09-17T05:23:00.419 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "uint", 2024-09-17T05:23:00.419 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.419 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.419 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:00.419 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "0", 2024-09-17T05:23:00.419 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "6", 2024-09-17T05:23:00.419 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.419 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-17T05:23:00.419 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-17T05:23:00.419 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.419 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.420 INFO:teuthology.orchestra.run.smithi098.stdout: "crush_compat_max_iterations": { 2024-09-17T05:23:00.420 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "crush_compat_max_iterations", 2024-09-17T05:23:00.420 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "uint", 2024-09-17T05:23:00.420 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.420 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.420 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "25", 2024-09-17T05:23:00.420 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "1", 2024-09-17T05:23:00.420 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "250", 2024-09-17T05:23:00.421 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.421 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-17T05:23:00.421 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.421 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.421 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.421 INFO:teuthology.orchestra.run.smithi098.stdout: "crush_compat_metrics": { 2024-09-17T05:23:00.421 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "crush_compat_metrics", 2024-09-17T05:23:00.421 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.421 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.421 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.421 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "pgs,objects,bytes", 2024-09-17T05:23:00.421 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.422 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.422 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.422 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-17T05:23:00.422 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-17T05:23:00.422 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.422 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.422 INFO:teuthology.orchestra.run.smithi098.stdout: "crush_compat_step": { 2024-09-17T05:23:00.422 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "crush_compat_step", 2024-09-17T05:23:00.422 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "float", 2024-09-17T05:23:00.422 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.422 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.423 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0.5", 2024-09-17T05:23:00.423 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "0.001", 2024-09-17T05:23:00.423 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "0.999", 2024-09-17T05:23:00.423 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.423 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "aggressiveness of optimization", 2024-09-17T05:23:00.423 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-17T05:23:00.423 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.423 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.423 INFO:teuthology.orchestra.run.smithi098.stdout: "end_time": { 2024-09-17T05:23:00.423 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "end_time", 2024-09-17T05:23:00.423 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.423 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.424 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.424 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "2359", 2024-09-17T05:23:00.424 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.424 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.424 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.424 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "ending time of day to automatically balance", 2024-09-17T05:23:00.424 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-17T05:23:00.424 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.424 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.424 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.424 INFO:teuthology.orchestra.run.smithi098.stdout: "end_weekday": { 2024-09-17T05:23:00.424 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "end_weekday", 2024-09-17T05:23:00.425 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "uint", 2024-09-17T05:23:00.425 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.425 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.425 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:00.425 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "0", 2024-09-17T05:23:00.425 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "6", 2024-09-17T05:23:00.425 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.425 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-17T05:23:00.425 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-17T05:23:00.425 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.425 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.426 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:00.426 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:00.426 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.426 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.426 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.426 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.426 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.426 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.426 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.426 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.427 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.427 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.427 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.427 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.427 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.427 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.427 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.427 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.428 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.428 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.428 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.428 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:00.428 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:00.428 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.428 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.428 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.428 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.428 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.428 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.428 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.428 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.429 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.429 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.429 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.429 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.429 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:00.429 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:00.429 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.429 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.429 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.429 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:00.429 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.429 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.430 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.430 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.430 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.430 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.430 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.430 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.430 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.430 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.430 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.430 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.430 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.430 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.430 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.431 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:00.431 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:00.431 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.431 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.431 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.431 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.431 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.431 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.431 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.431 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.431 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.431 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.431 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.432 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.432 INFO:teuthology.orchestra.run.smithi098.stdout: "min_score": { 2024-09-17T05:23:00.432 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "min_score", 2024-09-17T05:23:00.432 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "float", 2024-09-17T05:23:00.432 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.432 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.432 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:00.432 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.432 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.432 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.432 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-17T05:23:00.432 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.432 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.433 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.433 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.433 INFO:teuthology.orchestra.run.smithi098.stdout: "mode": { 2024-09-17T05:23:00.433 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "mode", 2024-09-17T05:23:00.433 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.433 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.433 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.433 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "upmap", 2024-09-17T05:23:00.433 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.433 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.433 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.433 INFO:teuthology.orchestra.run.smithi098.stdout: "crush-compat", 2024-09-17T05:23:00.433 INFO:teuthology.orchestra.run.smithi098.stdout: "none", 2024-09-17T05:23:00.433 INFO:teuthology.orchestra.run.smithi098.stdout: "read", 2024-09-17T05:23:00.434 INFO:teuthology.orchestra.run.smithi098.stdout: "upmap", 2024-09-17T05:23:00.434 INFO:teuthology.orchestra.run.smithi098.stdout: "upmap-read" 2024-09-17T05:23:00.434 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.434 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Balancer mode", 2024-09-17T05:23:00.434 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.434 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.434 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.434 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.434 INFO:teuthology.orchestra.run.smithi098.stdout: "pool_ids": { 2024-09-17T05:23:00.434 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "pool_ids", 2024-09-17T05:23:00.434 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.434 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.434 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.435 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.435 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.435 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.435 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.435 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-17T05:23:00.435 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.435 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.435 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.435 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.435 INFO:teuthology.orchestra.run.smithi098.stdout: "sleep_interval": { 2024-09-17T05:23:00.435 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sleep_interval", 2024-09-17T05:23:00.435 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-17T05:23:00.435 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.436 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.436 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "60", 2024-09-17T05:23:00.436 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.436 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.436 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.436 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-17T05:23:00.436 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.436 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.436 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.436 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.436 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:00.436 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:00.436 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.437 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:00.437 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.437 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:00.437 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.437 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.437 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.437 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.438 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.438 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.438 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.438 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.438 INFO:teuthology.orchestra.run.smithi098.stdout: "upmap_max_deviation": { 2024-09-17T05:23:00.438 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "upmap_max_deviation", 2024-09-17T05:23:00.438 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.438 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.438 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.438 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "5", 2024-09-17T05:23:00.438 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "1", 2024-09-17T05:23:00.438 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.438 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.439 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-17T05:23:00.439 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-17T05:23:00.439 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.439 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.439 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.439 INFO:teuthology.orchestra.run.smithi098.stdout: "upmap_max_optimizations": { 2024-09-17T05:23:00.439 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "upmap_max_optimizations", 2024-09-17T05:23:00.439 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "uint", 2024-09-17T05:23:00.439 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.439 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.439 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "10", 2024-09-17T05:23:00.439 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.439 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.440 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.440 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-17T05:23:00.440 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.440 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.440 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.440 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.440 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.440 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.440 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:00.441 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "cephadm", 2024-09-17T05:23:00.441 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:00.441 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:00.441 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:00.441 INFO:teuthology.orchestra.run.smithi098.stdout: "agent_down_multiplier": { 2024-09-17T05:23:00.441 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "agent_down_multiplier", 2024-09-17T05:23:00.441 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "float", 2024-09-17T05:23:00.441 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.441 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.441 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "3.0", 2024-09-17T05:23:00.441 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.441 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.441 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.442 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-17T05:23:00.442 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.442 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.442 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.442 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.442 INFO:teuthology.orchestra.run.smithi098.stdout: "agent_refresh_rate": { 2024-09-17T05:23:00.442 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "agent_refresh_rate", 2024-09-17T05:23:00.442 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-17T05:23:00.442 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.442 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.442 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "20", 2024-09-17T05:23:00.443 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.443 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.443 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.443 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-17T05:23:00.443 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.443 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.443 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.443 INFO:teuthology.orchestra.run.smithi098.stdout: "agent_starting_port": { 2024-09-17T05:23:00.443 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "agent_starting_port", 2024-09-17T05:23:00.443 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.443 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.443 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.444 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "4721", 2024-09-17T05:23:00.444 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.444 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.444 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.444 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-17T05:23:00.444 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.444 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.444 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.444 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.444 INFO:teuthology.orchestra.run.smithi098.stdout: "allow_ptrace": { 2024-09-17T05:23:00.444 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "allow_ptrace", 2024-09-17T05:23:00.444 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.444 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.445 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.445 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.445 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.445 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.445 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.445 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-17T05:23:00.445 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-17T05:23:00.445 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.445 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.445 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.445 INFO:teuthology.orchestra.run.smithi098.stdout: "autotune_interval": { 2024-09-17T05:23:00.445 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "autotune_interval", 2024-09-17T05:23:00.446 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-17T05:23:00.446 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.446 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.446 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "600", 2024-09-17T05:23:00.446 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.446 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.446 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.446 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-17T05:23:00.446 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.446 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.446 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.446 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.446 INFO:teuthology.orchestra.run.smithi098.stdout: "autotune_memory_target_ratio": { 2024-09-17T05:23:00.446 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "autotune_memory_target_ratio", 2024-09-17T05:23:00.447 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "float", 2024-09-17T05:23:00.447 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.447 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.447 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0.7", 2024-09-17T05:23:00.447 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.447 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.447 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.447 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-17T05:23:00.448 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.448 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.448 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.448 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.448 INFO:teuthology.orchestra.run.smithi098.stdout: "cephadm_log_destination": { 2024-09-17T05:23:00.448 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "cephadm_log_destination", 2024-09-17T05:23:00.448 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.448 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.448 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.448 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.448 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.448 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.449 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.449 INFO:teuthology.orchestra.run.smithi098.stdout: "file", 2024-09-17T05:23:00.449 INFO:teuthology.orchestra.run.smithi098.stdout: "file,syslog", 2024-09-17T05:23:00.449 INFO:teuthology.orchestra.run.smithi098.stdout: "syslog" 2024-09-17T05:23:00.449 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.449 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-17T05:23:00.449 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.449 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.449 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.449 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.449 INFO:teuthology.orchestra.run.smithi098.stdout: "cgroups_split": { 2024-09-17T05:23:00.449 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "cgroups_split", 2024-09-17T05:23:00.449 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.450 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.450 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.450 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:00.450 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.450 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.450 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.450 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-17T05:23:00.450 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.450 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.450 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.450 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.450 INFO:teuthology.orchestra.run.smithi098.stdout: "config_checks_enabled": { 2024-09-17T05:23:00.450 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "config_checks_enabled", 2024-09-17T05:23:00.451 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.451 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.451 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.451 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.451 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.451 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.451 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.451 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-17T05:23:00.451 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.451 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.451 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.451 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.451 INFO:teuthology.orchestra.run.smithi098.stdout: "config_dashboard": { 2024-09-17T05:23:00.452 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "config_dashboard", 2024-09-17T05:23:00.452 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.452 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.452 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.452 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:00.452 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.452 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.452 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.452 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-17T05:23:00.452 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.452 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.452 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.452 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.453 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_alertmanager": { 2024-09-17T05:23:00.453 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_alertmanager", 2024-09-17T05:23:00.453 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.453 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.453 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.453 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-17T05:23:00.453 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.453 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.453 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.453 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Prometheus container image", 2024-09-17T05:23:00.453 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.453 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.453 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.454 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.454 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_base": { 2024-09-17T05:23:00.454 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_base", 2024-09-17T05:23:00.454 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.454 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.454 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.454 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-17T05:23:00.454 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.454 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.454 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.454 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Container image name, without the tag", 2024-09-17T05:23:00.454 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.454 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.454 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.455 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.455 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_elasticsearch": { 2024-09-17T05:23:00.455 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_elasticsearch", 2024-09-17T05:23:00.455 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.455 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.455 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.455 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-17T05:23:00.455 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.455 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.455 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.455 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "elasticsearch container image", 2024-09-17T05:23:00.455 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.456 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.456 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.456 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.456 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_grafana": { 2024-09-17T05:23:00.456 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_grafana", 2024-09-17T05:23:00.456 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.456 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.456 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.456 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-09-17T05:23:00.456 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.456 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.456 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.457 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Prometheus container image", 2024-09-17T05:23:00.457 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.457 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.457 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.457 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.457 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_haproxy": { 2024-09-17T05:23:00.457 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_haproxy", 2024-09-17T05:23:00.460 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.460 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.460 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.460 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-17T05:23:00.461 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.461 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.461 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.461 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "HAproxy container image", 2024-09-17T05:23:00.461 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.462 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.462 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.462 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_jaeger_agent": { 2024-09-17T05:23:00.462 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_jaeger_agent", 2024-09-17T05:23:00.462 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.462 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.462 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.462 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-17T05:23:00.462 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.462 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.462 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.463 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Jaeger agent container image", 2024-09-17T05:23:00.463 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.463 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.463 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.463 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.463 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_jaeger_collector": { 2024-09-17T05:23:00.463 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_jaeger_collector", 2024-09-17T05:23:00.463 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.463 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.463 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.463 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-17T05:23:00.463 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.463 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.464 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.464 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Jaeger collector container image", 2024-09-17T05:23:00.464 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.464 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.464 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.464 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.464 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_jaeger_query": { 2024-09-17T05:23:00.464 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_jaeger_query", 2024-09-17T05:23:00.464 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.464 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.464 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.464 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-17T05:23:00.464 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.465 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.465 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.465 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Jaeger query container image", 2024-09-17T05:23:00.465 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.465 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.465 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.465 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.465 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_keepalived": { 2024-09-17T05:23:00.466 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_keepalived", 2024-09-17T05:23:00.466 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.466 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.466 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.466 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-17T05:23:00.466 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.466 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.466 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.466 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Keepalived container image", 2024-09-17T05:23:00.466 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.466 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.466 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.466 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.466 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_loki": { 2024-09-17T05:23:00.467 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_loki", 2024-09-17T05:23:00.467 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.467 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.467 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.467 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-17T05:23:00.467 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.467 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.467 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.467 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Loki container image", 2024-09-17T05:23:00.467 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.467 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.467 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.467 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.468 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_nginx": { 2024-09-17T05:23:00.468 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_nginx", 2024-09-17T05:23:00.468 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.468 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.468 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.468 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-17T05:23:00.468 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.468 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.468 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.468 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Nginx container image", 2024-09-17T05:23:00.468 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.468 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.468 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.469 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.469 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_node_exporter": { 2024-09-17T05:23:00.469 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_node_exporter", 2024-09-17T05:23:00.469 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.469 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.469 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.469 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-17T05:23:00.469 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.469 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.469 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.469 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Prometheus container image", 2024-09-17T05:23:00.469 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.469 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.470 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.470 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.470 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_nvmeof": { 2024-09-17T05:23:00.470 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_nvmeof", 2024-09-17T05:23:00.470 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.470 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.470 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.470 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-17T05:23:00.470 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.470 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.470 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.470 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Nvme-of container image", 2024-09-17T05:23:00.470 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.471 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.471 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.471 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.471 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_oauth2_proxy": { 2024-09-17T05:23:00.471 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_oauth2_proxy", 2024-09-17T05:23:00.471 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.471 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.471 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.472 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-17T05:23:00.472 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.472 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.472 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.472 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "oauth2-proxy container image", 2024-09-17T05:23:00.472 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.472 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.472 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.472 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.473 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_prometheus": { 2024-09-17T05:23:00.473 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_prometheus", 2024-09-17T05:23:00.473 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.473 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.473 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.473 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-17T05:23:00.473 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.473 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.473 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.473 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Prometheus container image", 2024-09-17T05:23:00.473 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.473 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.474 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.474 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.474 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_promtail": { 2024-09-17T05:23:00.474 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_promtail", 2024-09-17T05:23:00.474 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.474 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.474 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.474 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-17T05:23:00.474 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.474 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.474 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.474 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Promtail container image", 2024-09-17T05:23:00.474 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.474 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.475 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.475 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.475 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_samba": { 2024-09-17T05:23:00.475 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_samba", 2024-09-17T05:23:00.475 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.475 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.475 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.476 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-17T05:23:00.476 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.476 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.476 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.476 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Samba/SMB container image", 2024-09-17T05:23:00.476 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.476 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.476 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.476 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.476 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_samba_metrics": { 2024-09-17T05:23:00.476 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_samba_metrics", 2024-09-17T05:23:00.476 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.477 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.477 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.477 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-17T05:23:00.477 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.477 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.477 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.477 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-17T05:23:00.477 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.477 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.477 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.477 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.478 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_snmp_gateway": { 2024-09-17T05:23:00.478 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_snmp_gateway", 2024-09-17T05:23:00.478 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.478 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.478 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.478 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-17T05:23:00.478 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.478 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.478 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.478 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "SNMP Gateway container image", 2024-09-17T05:23:00.478 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.478 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.478 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.479 INFO:teuthology.orchestra.run.smithi098.stdout: "container_init": { 2024-09-17T05:23:00.479 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_init", 2024-09-17T05:23:00.479 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.479 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.479 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.480 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:00.480 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.480 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.480 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.480 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Run podman/docker with `--init`", 2024-09-17T05:23:00.480 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.480 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.481 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.481 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.481 INFO:teuthology.orchestra.run.smithi098.stdout: "daemon_cache_timeout": { 2024-09-17T05:23:00.481 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "daemon_cache_timeout", 2024-09-17T05:23:00.481 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-17T05:23:00.481 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.481 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.481 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "600", 2024-09-17T05:23:00.481 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.481 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.481 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.481 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-17T05:23:00.481 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.481 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.482 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.482 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.482 INFO:teuthology.orchestra.run.smithi098.stdout: "default_cephadm_command_timeout": { 2024-09-17T05:23:00.482 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "default_cephadm_command_timeout", 2024-09-17T05:23:00.482 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.482 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.482 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.482 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "900", 2024-09-17T05:23:00.483 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.483 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.483 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.483 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-17T05:23:00.483 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.483 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.483 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.484 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.484 INFO:teuthology.orchestra.run.smithi098.stdout: "default_registry": { 2024-09-17T05:23:00.484 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "default_registry", 2024-09-17T05:23:00.484 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.484 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.484 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.484 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "docker.io", 2024-09-17T05:23:00.484 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.484 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.484 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.484 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-17T05:23:00.484 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.485 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.485 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.485 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.485 INFO:teuthology.orchestra.run.smithi098.stdout: "device_cache_timeout": { 2024-09-17T05:23:00.485 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "device_cache_timeout", 2024-09-17T05:23:00.485 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-17T05:23:00.485 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.485 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.485 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "1800", 2024-09-17T05:23:00.485 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.485 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.485 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.485 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "seconds to cache device inventory", 2024-09-17T05:23:00.486 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.486 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.486 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.486 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.486 INFO:teuthology.orchestra.run.smithi098.stdout: "device_enhanced_scan": { 2024-09-17T05:23:00.486 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "device_enhanced_scan", 2024-09-17T05:23:00.486 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.486 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.486 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.486 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.486 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.486 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.486 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.487 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-17T05:23:00.487 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.487 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.487 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.487 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.487 INFO:teuthology.orchestra.run.smithi098.stdout: "facts_cache_timeout": { 2024-09-17T05:23:00.487 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "facts_cache_timeout", 2024-09-17T05:23:00.487 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-17T05:23:00.487 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.487 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.487 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "60", 2024-09-17T05:23:00.487 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.487 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.488 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.488 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "seconds to cache host facts data", 2024-09-17T05:23:00.488 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.488 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.488 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.488 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.488 INFO:teuthology.orchestra.run.smithi098.stdout: "grafana_dashboards_path": { 2024-09-17T05:23:00.488 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "grafana_dashboards_path", 2024-09-17T05:23:00.488 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.489 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.489 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.489 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-17T05:23:00.489 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.489 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.489 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.489 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-17T05:23:00.489 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.489 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.490 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.490 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.490 INFO:teuthology.orchestra.run.smithi098.stdout: "host_check_interval": { 2024-09-17T05:23:00.490 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "host_check_interval", 2024-09-17T05:23:00.490 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-17T05:23:00.490 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.490 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.490 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "600", 2024-09-17T05:23:00.490 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.490 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.490 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.490 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "how frequently to perform a host check", 2024-09-17T05:23:00.490 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.490 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.491 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.491 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.491 INFO:teuthology.orchestra.run.smithi098.stdout: "hw_monitoring": { 2024-09-17T05:23:00.491 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "hw_monitoring", 2024-09-17T05:23:00.491 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.491 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.491 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.491 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.491 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.491 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.491 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.491 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-17T05:23:00.491 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.491 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.492 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.492 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.492 INFO:teuthology.orchestra.run.smithi098.stdout: "inventory_list_all": { 2024-09-17T05:23:00.492 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "inventory_list_all", 2024-09-17T05:23:00.492 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.492 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.492 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.492 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.492 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.492 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.492 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.492 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-17T05:23:00.493 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.493 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.493 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.493 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.493 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:00.493 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:00.493 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.493 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.493 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.493 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.493 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.493 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.493 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.494 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.494 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.494 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.494 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.494 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.494 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.494 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.494 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.494 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.494 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.494 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.495 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.495 INFO:teuthology.orchestra.run.smithi098.stdout: "log_refresh_metadata": { 2024-09-17T05:23:00.495 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_refresh_metadata", 2024-09-17T05:23:00.495 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.495 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.495 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.495 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.495 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.495 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.495 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.495 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-17T05:23:00.495 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.495 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.495 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.496 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.496 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:00.496 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:00.496 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.496 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.496 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.496 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:00.496 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.496 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.496 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.496 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-17T05:23:00.496 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.496 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.497 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.497 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.497 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:00.497 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:00.497 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.497 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.497 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.497 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:00.497 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.497 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.497 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.497 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.497 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.497 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.498 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.498 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.498 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.498 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.498 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.498 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.498 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.498 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.498 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.498 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:00.498 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:00.498 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.498 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.498 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.499 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.499 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.499 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.499 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.499 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.499 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.499 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.499 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.499 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.499 INFO:teuthology.orchestra.run.smithi098.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-17T05:23:00.499 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-17T05:23:00.499 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.499 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.500 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.500 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.500 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.500 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.500 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.500 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-17T05:23:00.500 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.500 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.500 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.501 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.501 INFO:teuthology.orchestra.run.smithi098.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-17T05:23:00.501 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-17T05:23:00.501 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.501 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.501 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.501 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "*", 2024-09-17T05:23:00.501 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.501 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.502 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.502 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-17T05:23:00.502 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.502 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.502 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.502 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.502 INFO:teuthology.orchestra.run.smithi098.stdout: "max_count_per_host": { 2024-09-17T05:23:00.502 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "max_count_per_host", 2024-09-17T05:23:00.502 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.502 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.502 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.502 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "10", 2024-09-17T05:23:00.502 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.503 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.503 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.503 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "max number of daemons per service per host", 2024-09-17T05:23:00.503 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.503 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.503 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.503 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.503 INFO:teuthology.orchestra.run.smithi098.stdout: "max_osd_draining_count": { 2024-09-17T05:23:00.503 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "max_osd_draining_count", 2024-09-17T05:23:00.503 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.504 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.504 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.504 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "10", 2024-09-17T05:23:00.504 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.504 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.504 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.504 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-17T05:23:00.504 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.504 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.504 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.504 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.504 INFO:teuthology.orchestra.run.smithi098.stdout: "migration_current": { 2024-09-17T05:23:00.505 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "migration_current", 2024-09-17T05:23:00.505 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.505 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.505 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.505 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.505 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.505 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.505 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.505 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "internal - do not modify", 2024-09-17T05:23:00.505 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.505 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.505 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.505 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.506 INFO:teuthology.orchestra.run.smithi098.stdout: "mode": { 2024-09-17T05:23:00.506 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "mode", 2024-09-17T05:23:00.506 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.506 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.506 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.506 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "root", 2024-09-17T05:23:00.506 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.506 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.506 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.506 INFO:teuthology.orchestra.run.smithi098.stdout: "cephadm-package", 2024-09-17T05:23:00.506 INFO:teuthology.orchestra.run.smithi098.stdout: "root" 2024-09-17T05:23:00.506 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.506 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "mode for remote execution of cephadm", 2024-09-17T05:23:00.507 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.507 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.507 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.507 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.507 INFO:teuthology.orchestra.run.smithi098.stdout: "oob_default_addr": { 2024-09-17T05:23:00.507 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "oob_default_addr", 2024-09-17T05:23:00.507 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.507 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.507 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.507 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "169.254.1.1", 2024-09-17T05:23:00.507 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.507 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.507 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.507 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-17T05:23:00.508 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.508 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.508 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.508 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.508 INFO:teuthology.orchestra.run.smithi098.stdout: "prometheus_alerts_path": { 2024-09-17T05:23:00.508 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "prometheus_alerts_path", 2024-09-17T05:23:00.508 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.508 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.508 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.508 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-17T05:23:00.508 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.508 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.508 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.509 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-17T05:23:00.509 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.509 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.509 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.509 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.509 INFO:teuthology.orchestra.run.smithi098.stdout: "registry_insecure": { 2024-09-17T05:23:00.509 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "registry_insecure", 2024-09-17T05:23:00.509 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.509 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.509 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.509 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.509 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.509 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.509 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.510 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-17T05:23:00.510 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.510 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.510 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.510 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.510 INFO:teuthology.orchestra.run.smithi098.stdout: "registry_password": { 2024-09-17T05:23:00.510 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "registry_password", 2024-09-17T05:23:00.510 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.510 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.510 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.510 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.510 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.510 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.511 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.511 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-17T05:23:00.511 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.511 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.511 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.511 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.511 INFO:teuthology.orchestra.run.smithi098.stdout: "registry_url": { 2024-09-17T05:23:00.511 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "registry_url", 2024-09-17T05:23:00.511 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.511 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.511 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.511 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.511 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.512 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.512 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.512 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-17T05:23:00.512 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.512 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.512 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.512 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.512 INFO:teuthology.orchestra.run.smithi098.stdout: "registry_username": { 2024-09-17T05:23:00.512 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "registry_username", 2024-09-17T05:23:00.512 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.513 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.513 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.513 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.513 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.513 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.513 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.513 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-17T05:23:00.513 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.513 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.513 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.513 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.513 INFO:teuthology.orchestra.run.smithi098.stdout: "secure_monitoring_stack": { 2024-09-17T05:23:00.513 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "secure_monitoring_stack", 2024-09-17T05:23:00.514 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.514 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.514 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.514 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.514 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.514 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.514 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.514 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-17T05:23:00.514 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.514 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.514 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.514 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.514 INFO:teuthology.orchestra.run.smithi098.stdout: "service_discovery_port": { 2024-09-17T05:23:00.515 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "service_discovery_port", 2024-09-17T05:23:00.515 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.515 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.515 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.515 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "8765", 2024-09-17T05:23:00.515 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.515 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.515 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.515 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "cephadm service discovery port", 2024-09-17T05:23:00.515 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.515 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.515 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.515 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.516 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:00.516 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:00.516 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.516 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:00.516 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.516 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:00.516 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.516 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.516 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.516 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.516 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.516 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.516 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.517 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.517 INFO:teuthology.orchestra.run.smithi098.stdout: "ssh_config_file": { 2024-09-17T05:23:00.517 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ssh_config_file", 2024-09-17T05:23:00.517 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.517 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.517 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.517 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.517 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.517 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.517 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.518 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-17T05:23:00.518 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.518 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.518 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.518 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.518 INFO:teuthology.orchestra.run.smithi098.stdout: "ssh_keepalive_count_max": { 2024-09-17T05:23:00.518 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ssh_keepalive_count_max", 2024-09-17T05:23:00.518 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.518 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.518 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.518 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "3", 2024-09-17T05:23:00.518 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.518 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.518 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.519 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-17T05:23:00.519 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.519 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.519 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.519 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.519 INFO:teuthology.orchestra.run.smithi098.stdout: "ssh_keepalive_interval": { 2024-09-17T05:23:00.519 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ssh_keepalive_interval", 2024-09-17T05:23:00.519 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.519 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.519 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.519 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "7", 2024-09-17T05:23:00.519 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.519 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.520 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.520 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-17T05:23:00.520 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.520 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.520 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.520 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.520 INFO:teuthology.orchestra.run.smithi098.stdout: "use_agent": { 2024-09-17T05:23:00.520 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "use_agent", 2024-09-17T05:23:00.520 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.520 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.520 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.520 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.520 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.520 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.521 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.521 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-17T05:23:00.521 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.521 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.521 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.521 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.521 INFO:teuthology.orchestra.run.smithi098.stdout: "use_repo_digest": { 2024-09-17T05:23:00.521 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "use_repo_digest", 2024-09-17T05:23:00.521 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.521 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.521 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.521 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:00.521 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.522 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.522 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.522 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-17T05:23:00.522 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.522 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.522 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.522 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.522 INFO:teuthology.orchestra.run.smithi098.stdout: "warn_on_failed_host_check": { 2024-09-17T05:23:00.522 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "warn_on_failed_host_check", 2024-09-17T05:23:00.522 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.522 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.522 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.522 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:00.522 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.523 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.523 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.523 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "raise a health warning if the host check fails", 2024-09-17T05:23:00.523 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.523 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.523 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.523 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.523 INFO:teuthology.orchestra.run.smithi098.stdout: "warn_on_stray_daemons": { 2024-09-17T05:23:00.523 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "warn_on_stray_daemons", 2024-09-17T05:23:00.523 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.523 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.523 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.523 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:00.523 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.524 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.524 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.524 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-17T05:23:00.524 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.524 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.524 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.524 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.524 INFO:teuthology.orchestra.run.smithi098.stdout: "warn_on_stray_hosts": { 2024-09-17T05:23:00.524 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "warn_on_stray_hosts", 2024-09-17T05:23:00.524 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.524 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.524 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.524 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:00.525 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.525 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.525 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.525 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-17T05:23:00.525 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.525 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.525 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.525 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.525 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.525 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.525 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:00.525 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "crash", 2024-09-17T05:23:00.525 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:00.526 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:00.526 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:00.526 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:00.526 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:00.526 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.526 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.526 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.526 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.526 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.526 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.526 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.526 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.526 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.526 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.527 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.527 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.527 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.527 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.527 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.527 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.527 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.527 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.527 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.527 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:00.527 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:00.527 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.527 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.528 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.528 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.528 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.528 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.528 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.528 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.528 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.528 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.528 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.528 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.528 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:00.528 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:00.528 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.529 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.529 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.529 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:00.529 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.529 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.529 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.529 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.529 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.529 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.529 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.529 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.529 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.529 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.530 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.530 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.530 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.530 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.530 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.530 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:00.530 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:00.530 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.530 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.530 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.530 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.530 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.530 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.530 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.531 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.531 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.531 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.531 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.531 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.531 INFO:teuthology.orchestra.run.smithi098.stdout: "retain_interval": { 2024-09-17T05:23:00.531 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "retain_interval", 2024-09-17T05:23:00.531 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-17T05:23:00.531 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.531 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.531 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "31536000", 2024-09-17T05:23:00.531 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.532 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.532 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.532 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-17T05:23:00.532 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.532 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.532 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.532 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.532 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:00.532 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:00.532 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.532 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:00.532 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.533 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:00.533 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.533 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.533 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.533 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.533 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.533 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.533 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.533 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.533 INFO:teuthology.orchestra.run.smithi098.stdout: "warn_recent_interval": { 2024-09-17T05:23:00.533 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "warn_recent_interval", 2024-09-17T05:23:00.533 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-17T05:23:00.533 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.533 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.534 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "1209600", 2024-09-17T05:23:00.534 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.534 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.534 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.534 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-17T05:23:00.534 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.534 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.534 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.534 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.534 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.534 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.534 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:00.534 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "dashboard", 2024-09-17T05:23:00.535 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:00.535 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:00.535 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:00.535 INFO:teuthology.orchestra.run.smithi098.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-17T05:23:00.535 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-17T05:23:00.535 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.535 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.535 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.535 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "10", 2024-09-17T05:23:00.535 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.535 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.535 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.535 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.536 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.536 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.536 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.536 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.536 INFO:teuthology.orchestra.run.smithi098.stdout: "ALERTMANAGER_API_HOST": { 2024-09-17T05:23:00.536 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-17T05:23:00.536 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.536 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.536 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.536 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.536 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.536 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.536 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.537 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.537 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.537 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.537 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.537 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.537 INFO:teuthology.orchestra.run.smithi098.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-17T05:23:00.537 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-17T05:23:00.537 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.537 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.537 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.537 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:00.537 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.537 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.537 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.538 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.538 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.538 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.538 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.538 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.538 INFO:teuthology.orchestra.run.smithi098.stdout: "AUDIT_API_ENABLED": { 2024-09-17T05:23:00.538 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "AUDIT_API_ENABLED", 2024-09-17T05:23:00.538 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.538 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.538 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.538 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.538 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.538 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.539 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.539 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.539 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.539 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.539 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.539 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.539 INFO:teuthology.orchestra.run.smithi098.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-17T05:23:00.539 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-17T05:23:00.539 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.539 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.539 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.539 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:00.539 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.539 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.540 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.540 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.540 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.540 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.540 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.540 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.540 INFO:teuthology.orchestra.run.smithi098.stdout: "ENABLE_BROWSABLE_API": { 2024-09-17T05:23:00.540 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-17T05:23:00.540 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.540 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.540 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.540 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:00.540 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.540 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.541 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.541 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.541 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.541 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.541 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.541 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.541 INFO:teuthology.orchestra.run.smithi098.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-17T05:23:00.541 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-17T05:23:00.541 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.541 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.541 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.541 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:00.542 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.542 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.542 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.542 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.542 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.542 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.542 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.542 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.542 INFO:teuthology.orchestra.run.smithi098.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-17T05:23:00.542 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-17T05:23:00.542 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.542 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.542 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.542 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:00.543 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.543 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.543 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.543 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.543 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.543 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.543 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.543 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.543 INFO:teuthology.orchestra.run.smithi098.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-17T05:23:00.543 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-17T05:23:00.543 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.543 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.543 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.544 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:00.544 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.544 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.544 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.544 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.544 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.544 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.544 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.544 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.544 INFO:teuthology.orchestra.run.smithi098.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-17T05:23:00.544 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-17T05:23:00.544 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.545 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.545 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.545 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:00.545 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.545 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.545 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.545 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.545 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.545 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.545 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.545 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.545 INFO:teuthology.orchestra.run.smithi098.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-17T05:23:00.546 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-17T05:23:00.546 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.546 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.546 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.546 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:00.546 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.546 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.546 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.546 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.546 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.546 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.546 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.546 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.546 INFO:teuthology.orchestra.run.smithi098.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-17T05:23:00.547 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-17T05:23:00.547 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.547 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.547 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.547 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:00.547 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.547 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.547 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.547 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.547 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.547 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.547 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.547 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.548 INFO:teuthology.orchestra.run.smithi098.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-17T05:23:00.548 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-17T05:23:00.548 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.548 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.548 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.548 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:00.548 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.548 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.548 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.548 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.548 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.548 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.548 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.549 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.549 INFO:teuthology.orchestra.run.smithi098.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-17T05:23:00.549 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-17T05:23:00.549 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.549 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.549 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.549 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.549 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.549 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.549 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.549 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.549 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.549 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.550 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.550 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.550 INFO:teuthology.orchestra.run.smithi098.stdout: "GRAFANA_API_PASSWORD": { 2024-09-17T05:23:00.550 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-17T05:23:00.550 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.550 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.550 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.550 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "admin", 2024-09-17T05:23:00.550 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.550 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.550 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.550 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.550 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.551 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.551 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.551 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.551 INFO:teuthology.orchestra.run.smithi098.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-17T05:23:00.551 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-17T05:23:00.551 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.551 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.551 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.551 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:00.551 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.551 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.551 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.551 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.551 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.552 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.552 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.552 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.552 INFO:teuthology.orchestra.run.smithi098.stdout: "GRAFANA_API_URL": { 2024-09-17T05:23:00.552 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "GRAFANA_API_URL", 2024-09-17T05:23:00.552 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.552 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.552 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.552 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.552 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.552 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.552 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.552 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.553 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.553 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.553 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.553 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.553 INFO:teuthology.orchestra.run.smithi098.stdout: "GRAFANA_API_USERNAME": { 2024-09-17T05:23:00.553 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-17T05:23:00.553 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.553 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.553 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.553 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "admin", 2024-09-17T05:23:00.553 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.553 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.553 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.554 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.554 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.554 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.554 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.554 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.554 INFO:teuthology.orchestra.run.smithi098.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-17T05:23:00.554 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-17T05:23:00.554 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.554 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.554 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.554 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.554 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.554 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.554 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.555 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.555 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.555 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.555 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.555 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.555 INFO:teuthology.orchestra.run.smithi098.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-17T05:23:00.555 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-17T05:23:00.555 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.555 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.555 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.555 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.555 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.555 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.556 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.556 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.556 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.556 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.556 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.556 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.556 INFO:teuthology.orchestra.run.smithi098.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-17T05:23:00.556 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-17T05:23:00.556 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.556 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.556 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.556 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:00.556 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.556 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.557 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.557 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.557 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.557 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.557 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.557 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.557 INFO:teuthology.orchestra.run.smithi098.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-17T05:23:00.557 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-17T05:23:00.557 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.557 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.557 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.557 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.557 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.558 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.558 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.558 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.558 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.558 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.558 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.558 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.558 INFO:teuthology.orchestra.run.smithi098.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-17T05:23:00.558 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-17T05:23:00.558 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.558 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.558 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.558 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "[]", 2024-09-17T05:23:00.558 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.559 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.559 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.559 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.559 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.559 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.559 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.559 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.559 INFO:teuthology.orchestra.run.smithi098.stdout: "MULTICLUSTER_CONFIG": { 2024-09-17T05:23:00.559 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-17T05:23:00.559 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.559 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.559 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.560 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "{}", 2024-09-17T05:23:00.560 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.560 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.560 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.560 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.560 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.560 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.560 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.560 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.560 INFO:teuthology.orchestra.run.smithi098.stdout: "PROMETHEUS_API_HOST": { 2024-09-17T05:23:00.560 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-17T05:23:00.560 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.560 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.560 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.561 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.561 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.561 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.561 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.561 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.561 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.561 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.561 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.561 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.561 INFO:teuthology.orchestra.run.smithi098.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-17T05:23:00.561 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-17T05:23:00.561 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.561 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.562 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.562 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:00.562 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.562 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.562 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.562 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.562 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.562 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.562 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.562 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.562 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-17T05:23:00.562 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-17T05:23:00.562 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.562 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.563 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.563 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.563 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.563 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.563 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.563 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.563 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.563 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.563 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.563 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.563 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-17T05:23:00.563 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-17T05:23:00.563 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.564 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.564 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.564 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.564 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.564 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.564 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.564 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.564 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.564 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.564 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.564 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.564 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-17T05:23:00.564 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-17T05:23:00.564 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.565 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.565 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.565 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:00.565 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.565 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.565 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.565 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.565 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.565 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.565 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.565 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.565 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-17T05:23:00.565 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-17T05:23:00.566 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.566 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.566 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.566 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:00.566 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.566 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.566 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.566 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.566 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.566 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.566 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.566 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.566 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-17T05:23:00.566 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-17T05:23:00.567 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.567 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.567 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.567 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.567 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.567 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.567 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.567 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.567 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.567 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.567 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.567 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.567 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-17T05:23:00.568 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-17T05:23:00.568 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.568 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.568 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.568 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.568 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.568 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.568 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.568 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.569 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.569 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.569 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.569 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.569 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-17T05:23:00.569 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-17T05:23:00.569 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.569 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.569 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.569 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.569 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.569 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.569 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.570 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.570 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.570 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.570 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.570 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.570 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_ENABLED": { 2024-09-17T05:23:00.570 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-17T05:23:00.570 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.570 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.570 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.570 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:00.570 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.570 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.571 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.571 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.571 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.571 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.571 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.571 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.571 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-17T05:23:00.571 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-17T05:23:00.571 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.571 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.571 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.571 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-17T05:23:00.571 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.572 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.572 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.572 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.572 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.572 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.572 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.572 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.572 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-17T05:23:00.572 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-17T05:23:00.572 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.572 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.572 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.572 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "10", 2024-09-17T05:23:00.573 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.573 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.573 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.573 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.573 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.573 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.573 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.573 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.573 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-17T05:23:00.573 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-17T05:23:00.573 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.573 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.573 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.574 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "8", 2024-09-17T05:23:00.574 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.574 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.574 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.574 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.574 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.574 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.574 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.574 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.574 INFO:teuthology.orchestra.run.smithi098.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-17T05:23:00.574 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-17T05:23:00.574 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.574 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.575 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.575 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "45", 2024-09-17T05:23:00.575 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.575 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.575 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.575 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.575 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.575 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.575 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.575 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.575 INFO:teuthology.orchestra.run.smithi098.stdout: "RGW_API_ACCESS_KEY": { 2024-09-17T05:23:00.575 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-17T05:23:00.575 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.576 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.576 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.576 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.576 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.576 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.576 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.576 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.577 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.577 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.577 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.577 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.577 INFO:teuthology.orchestra.run.smithi098.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-17T05:23:00.577 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-17T05:23:00.577 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.577 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.577 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.577 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "admin", 2024-09-17T05:23:00.577 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.577 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.577 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.578 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.578 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.578 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.578 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.578 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.578 INFO:teuthology.orchestra.run.smithi098.stdout: "RGW_API_SECRET_KEY": { 2024-09-17T05:23:00.578 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-17T05:23:00.578 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.578 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.578 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.578 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.578 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.578 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.578 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.579 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.579 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.579 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.579 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.579 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.579 INFO:teuthology.orchestra.run.smithi098.stdout: "RGW_API_SSL_VERIFY": { 2024-09-17T05:23:00.579 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-17T05:23:00.579 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.579 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.579 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.579 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:00.579 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.579 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.580 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.580 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.580 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.580 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.580 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.580 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.580 INFO:teuthology.orchestra.run.smithi098.stdout: "UNSAFE_TLS_v1_2": { 2024-09-17T05:23:00.580 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-17T05:23:00.580 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.580 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.580 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.580 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.580 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.581 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.581 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.581 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.581 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.581 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.581 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.581 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.581 INFO:teuthology.orchestra.run.smithi098.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-17T05:23:00.581 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-17T05:23:00.581 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.581 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.581 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.581 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:00.581 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.582 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.582 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.582 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.582 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.582 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.582 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.582 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.582 INFO:teuthology.orchestra.run.smithi098.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-17T05:23:00.582 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-17T05:23:00.582 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.582 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.582 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.582 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "10", 2024-09-17T05:23:00.582 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.583 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.583 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.583 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.583 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.583 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.583 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.583 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.583 INFO:teuthology.orchestra.run.smithi098.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-17T05:23:00.583 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-17T05:23:00.583 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.583 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.583 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.583 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "5", 2024-09-17T05:23:00.584 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.584 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.584 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.584 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.584 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.584 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.584 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.584 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.584 INFO:teuthology.orchestra.run.smithi098.stdout: "cross_origin_url": { 2024-09-17T05:23:00.584 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "cross_origin_url", 2024-09-17T05:23:00.584 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.584 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.584 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.584 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.585 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.585 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.585 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.585 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.585 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.585 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.585 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.585 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.585 INFO:teuthology.orchestra.run.smithi098.stdout: "crt_file": { 2024-09-17T05:23:00.585 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "crt_file", 2024-09-17T05:23:00.585 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.585 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.585 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.586 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.586 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.586 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.586 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.586 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.586 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.586 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.586 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.586 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.586 INFO:teuthology.orchestra.run.smithi098.stdout: "debug": { 2024-09-17T05:23:00.586 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "debug", 2024-09-17T05:23:00.586 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.586 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.586 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.587 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.587 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.587 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.587 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.587 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Enable/disable debug options", 2024-09-17T05:23:00.587 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.587 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.587 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.587 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.587 INFO:teuthology.orchestra.run.smithi098.stdout: "jwt_token_ttl": { 2024-09-17T05:23:00.587 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "jwt_token_ttl", 2024-09-17T05:23:00.587 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.587 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.588 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.588 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "28800", 2024-09-17T05:23:00.588 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.588 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.588 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.588 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.588 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.588 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.588 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.588 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.588 INFO:teuthology.orchestra.run.smithi098.stdout: "key_file": { 2024-09-17T05:23:00.588 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "key_file", 2024-09-17T05:23:00.589 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.589 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.589 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.589 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.589 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.589 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.589 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.589 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.589 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.589 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.589 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.589 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.589 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:00.590 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:00.590 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.590 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.590 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.590 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.590 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.590 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.590 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.590 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.590 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.590 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.590 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.590 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.590 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.591 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.591 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.591 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.591 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.591 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.591 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.591 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:00.591 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:00.591 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.591 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.591 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.591 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.591 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.591 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.592 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.592 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.592 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.592 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.592 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.592 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.592 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:00.592 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:00.592 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.592 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.592 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.592 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:00.592 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.593 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.593 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.593 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.593 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.593 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.593 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.593 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.593 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.593 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.593 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.593 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.593 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.593 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.593 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.594 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:00.594 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:00.594 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.594 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.594 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.594 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.594 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.594 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.594 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.594 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.594 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.594 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.594 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.595 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.595 INFO:teuthology.orchestra.run.smithi098.stdout: "motd": { 2024-09-17T05:23:00.595 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "motd", 2024-09-17T05:23:00.595 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.595 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.595 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.595 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.595 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.595 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.595 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.595 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "The message of the day", 2024-09-17T05:23:00.595 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.595 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.596 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.596 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.596 INFO:teuthology.orchestra.run.smithi098.stdout: "redirect_resolve_ip_addr": { 2024-09-17T05:23:00.596 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "redirect_resolve_ip_addr", 2024-09-17T05:23:00.596 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.596 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.596 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.596 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.596 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.596 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.596 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.596 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.596 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.596 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.597 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.597 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.597 INFO:teuthology.orchestra.run.smithi098.stdout: "server_addr": { 2024-09-17T05:23:00.597 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "server_addr", 2024-09-17T05:23:00.597 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.597 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.597 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.597 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "::", 2024-09-17T05:23:00.597 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.597 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.597 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.597 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.597 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.598 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.598 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.598 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.598 INFO:teuthology.orchestra.run.smithi098.stdout: "server_port": { 2024-09-17T05:23:00.598 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "server_port", 2024-09-17T05:23:00.598 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.598 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.598 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.598 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "8080", 2024-09-17T05:23:00.598 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.598 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.598 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.598 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.598 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.599 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.599 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.599 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.599 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:00.599 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:00.599 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.599 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:00.599 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.599 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:00.599 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.599 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.599 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.599 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.599 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.600 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.600 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.600 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.600 INFO:teuthology.orchestra.run.smithi098.stdout: "ssl": { 2024-09-17T05:23:00.600 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ssl", 2024-09-17T05:23:00.600 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.600 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.600 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.600 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:00.600 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.600 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.600 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.600 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.601 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.601 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.601 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.601 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.601 INFO:teuthology.orchestra.run.smithi098.stdout: "ssl_server_port": { 2024-09-17T05:23:00.601 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ssl_server_port", 2024-09-17T05:23:00.601 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.601 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.601 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.601 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "8443", 2024-09-17T05:23:00.602 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.602 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.602 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.602 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.602 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.602 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.602 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.602 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.602 INFO:teuthology.orchestra.run.smithi098.stdout: "sso_oauth2": { 2024-09-17T05:23:00.602 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sso_oauth2", 2024-09-17T05:23:00.602 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.603 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.603 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.603 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.603 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.603 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.603 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.603 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.603 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.603 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.603 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.603 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.603 INFO:teuthology.orchestra.run.smithi098.stdout: "standby_behaviour": { 2024-09-17T05:23:00.603 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "standby_behaviour", 2024-09-17T05:23:00.603 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.604 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.604 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.604 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "redirect", 2024-09-17T05:23:00.604 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.604 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.604 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.604 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.604 INFO:teuthology.orchestra.run.smithi098.stdout: "redirect" 2024-09-17T05:23:00.604 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.604 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.604 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.604 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.604 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.605 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.605 INFO:teuthology.orchestra.run.smithi098.stdout: "standby_error_status_code": { 2024-09-17T05:23:00.605 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "standby_error_status_code", 2024-09-17T05:23:00.605 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.605 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.605 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.605 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "500", 2024-09-17T05:23:00.605 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "400", 2024-09-17T05:23:00.605 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "599", 2024-09-17T05:23:00.605 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.605 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.605 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.605 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.606 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.606 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.606 INFO:teuthology.orchestra.run.smithi098.stdout: "url_prefix": { 2024-09-17T05:23:00.606 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "url_prefix", 2024-09-17T05:23:00.606 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.606 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.606 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.606 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.606 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.606 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.606 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.606 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.606 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.606 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.607 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.607 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.607 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.607 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.607 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:00.607 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "devicehealth", 2024-09-17T05:23:00.607 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:00.607 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:00.607 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:00.607 INFO:teuthology.orchestra.run.smithi098.stdout: "enable_monitoring": { 2024-09-17T05:23:00.607 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "enable_monitoring", 2024-09-17T05:23:00.607 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.607 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.608 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.608 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:00.608 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.608 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.608 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.608 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "monitor device health metrics", 2024-09-17T05:23:00.608 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.608 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.608 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.608 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.608 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:00.608 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:00.608 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.608 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.609 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.609 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.609 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.609 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.609 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.609 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.609 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.609 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.609 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.609 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.609 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.609 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.609 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.610 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.610 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.610 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.610 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.610 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:00.610 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:00.610 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.610 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.610 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.610 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.610 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.610 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.610 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.611 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.611 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.611 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.611 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.611 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.611 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:00.611 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:00.611 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.611 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.611 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.611 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:00.611 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.611 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.611 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.612 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.612 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.612 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.612 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.612 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.612 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.612 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.612 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.612 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.612 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.612 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.613 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.613 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:00.613 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:00.613 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.613 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.613 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.613 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.613 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.613 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.613 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.613 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.613 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.613 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.614 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.614 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.614 INFO:teuthology.orchestra.run.smithi098.stdout: "mark_out_threshold": { 2024-09-17T05:23:00.614 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "mark_out_threshold", 2024-09-17T05:23:00.614 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-17T05:23:00.614 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.614 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.614 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "2419200", 2024-09-17T05:23:00.614 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.614 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.614 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.614 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-17T05:23:00.614 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.614 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.615 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.615 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.615 INFO:teuthology.orchestra.run.smithi098.stdout: "pool_name": { 2024-09-17T05:23:00.615 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "pool_name", 2024-09-17T05:23:00.615 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.615 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.615 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.615 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "device_health_metrics", 2024-09-17T05:23:00.615 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.615 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.615 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.615 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-17T05:23:00.615 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.616 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.616 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.616 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.616 INFO:teuthology.orchestra.run.smithi098.stdout: "retention_period": { 2024-09-17T05:23:00.616 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "retention_period", 2024-09-17T05:23:00.616 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-17T05:23:00.616 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.616 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.616 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "15552000", 2024-09-17T05:23:00.616 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.616 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.616 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.617 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "how long to retain device health metrics", 2024-09-17T05:23:00.617 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.617 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.617 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.617 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.617 INFO:teuthology.orchestra.run.smithi098.stdout: "scrape_frequency": { 2024-09-17T05:23:00.617 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "scrape_frequency", 2024-09-17T05:23:00.617 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-17T05:23:00.617 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.617 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.617 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "86400", 2024-09-17T05:23:00.617 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.617 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.618 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.618 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-17T05:23:00.618 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.618 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.618 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.618 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.618 INFO:teuthology.orchestra.run.smithi098.stdout: "self_heal": { 2024-09-17T05:23:00.618 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "self_heal", 2024-09-17T05:23:00.618 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.618 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.618 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.618 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:00.618 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.618 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.619 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.619 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-17T05:23:00.619 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.619 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.619 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.619 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.619 INFO:teuthology.orchestra.run.smithi098.stdout: "sleep_interval": { 2024-09-17T05:23:00.619 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sleep_interval", 2024-09-17T05:23:00.619 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-17T05:23:00.619 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.619 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.619 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "600", 2024-09-17T05:23:00.619 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.620 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.620 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.620 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "how frequently to wake up and check device health", 2024-09-17T05:23:00.620 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.620 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.620 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.620 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.620 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:00.620 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:00.620 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.620 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:00.620 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.620 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:00.620 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.621 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.621 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.621 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.621 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.621 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.621 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.621 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.621 INFO:teuthology.orchestra.run.smithi098.stdout: "warn_threshold": { 2024-09-17T05:23:00.621 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "warn_threshold", 2024-09-17T05:23:00.621 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-17T05:23:00.621 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.621 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.621 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "7257600", 2024-09-17T05:23:00.622 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.622 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.622 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.622 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-17T05:23:00.622 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.622 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.622 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.622 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.622 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.622 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.622 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:00.622 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "diskprediction_local", 2024-09-17T05:23:00.622 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:00.622 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:00.623 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:00.623 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:00.623 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:00.623 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.623 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.623 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.623 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.623 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.623 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.623 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.623 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.623 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.623 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.624 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.624 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.624 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.624 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.624 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.624 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.624 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.624 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.624 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.624 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:00.624 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:00.624 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.624 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.624 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.625 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.625 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.625 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.625 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.625 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.625 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.625 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.625 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.625 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.625 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:00.625 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:00.625 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.625 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.626 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.626 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:00.626 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.626 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.626 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.626 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.626 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.626 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.626 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.626 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.626 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.626 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.626 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.627 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.627 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.627 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.627 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.627 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:00.627 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:00.627 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.627 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.627 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.627 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.627 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.627 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.627 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.627 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.628 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.628 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.628 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.628 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.628 INFO:teuthology.orchestra.run.smithi098.stdout: "predict_interval": { 2024-09-17T05:23:00.628 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "predict_interval", 2024-09-17T05:23:00.628 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.628 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.628 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.628 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "86400", 2024-09-17T05:23:00.628 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.628 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.628 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.629 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.629 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.629 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.629 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.629 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.629 INFO:teuthology.orchestra.run.smithi098.stdout: "predictor_model": { 2024-09-17T05:23:00.629 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "predictor_model", 2024-09-17T05:23:00.629 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.629 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.629 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.629 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "prophetstor", 2024-09-17T05:23:00.629 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.629 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.630 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.630 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.630 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.630 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.630 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.630 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.630 INFO:teuthology.orchestra.run.smithi098.stdout: "sleep_interval": { 2024-09-17T05:23:00.630 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sleep_interval", 2024-09-17T05:23:00.630 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.630 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.630 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.630 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "600", 2024-09-17T05:23:00.631 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.631 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.631 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.631 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.631 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.631 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.631 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.631 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.631 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:00.631 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:00.631 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.631 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:00.631 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.631 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:00.632 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.632 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.632 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.632 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.632 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.632 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.632 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.632 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.632 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.632 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.632 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:00.632 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "influx", 2024-09-17T05:23:00.632 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": false, 2024-09-17T05:23:00.633 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "influxdb python module not found", 2024-09-17T05:23:00.633 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:00.633 INFO:teuthology.orchestra.run.smithi098.stdout: "batch_size": { 2024-09-17T05:23:00.633 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "batch_size", 2024-09-17T05:23:00.633 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.633 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.633 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.633 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "5000", 2024-09-17T05:23:00.633 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.633 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.633 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.633 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-17T05:23:00.633 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.633 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.634 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.634 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.634 INFO:teuthology.orchestra.run.smithi098.stdout: "database": { 2024-09-17T05:23:00.634 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "database", 2024-09-17T05:23:00.634 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.634 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.634 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.634 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "ceph", 2024-09-17T05:23:00.634 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.634 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.634 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.634 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-17T05:23:00.634 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.635 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.635 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.635 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.635 INFO:teuthology.orchestra.run.smithi098.stdout: "hostname": { 2024-09-17T05:23:00.635 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "hostname", 2024-09-17T05:23:00.635 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.635 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.635 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.635 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.635 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.635 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.635 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.635 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "InfluxDB server hostname", 2024-09-17T05:23:00.635 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.636 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.636 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.636 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.636 INFO:teuthology.orchestra.run.smithi098.stdout: "interval": { 2024-09-17T05:23:00.636 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "interval", 2024-09-17T05:23:00.636 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-17T05:23:00.636 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.636 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.636 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "30", 2024-09-17T05:23:00.636 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "5", 2024-09-17T05:23:00.636 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.636 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.636 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-17T05:23:00.637 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.637 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.637 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.637 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.637 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:00.637 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:00.637 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.637 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.637 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.637 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.637 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.637 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.637 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.637 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.638 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.638 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.638 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.638 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.638 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.638 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.638 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.638 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.638 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.638 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.638 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.638 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:00.638 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:00.639 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.639 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.639 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.639 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.639 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.639 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.639 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.639 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.639 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.639 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.639 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.639 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.639 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:00.639 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:00.640 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.640 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.640 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.640 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:00.640 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.640 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.640 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.640 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.640 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.640 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.640 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.640 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.640 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.641 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.641 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.641 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.641 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.641 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.641 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.641 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:00.641 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:00.641 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.641 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.641 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.641 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.641 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.641 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.642 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.642 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.642 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.642 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.642 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.642 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.642 INFO:teuthology.orchestra.run.smithi098.stdout: "password": { 2024-09-17T05:23:00.642 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "password", 2024-09-17T05:23:00.642 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.642 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.642 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.642 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.642 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.642 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.643 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.643 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "password of InfluxDB server user", 2024-09-17T05:23:00.643 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.643 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.643 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.643 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.643 INFO:teuthology.orchestra.run.smithi098.stdout: "port": { 2024-09-17T05:23:00.643 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "port", 2024-09-17T05:23:00.643 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.643 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.643 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.643 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "8086", 2024-09-17T05:23:00.643 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.643 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.644 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.644 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "InfluxDB server port", 2024-09-17T05:23:00.644 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.644 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.644 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.644 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.644 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:00.644 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:00.644 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.644 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:00.644 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.644 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:00.645 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.645 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.645 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.645 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.645 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.645 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.645 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.645 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.645 INFO:teuthology.orchestra.run.smithi098.stdout: "ssl": { 2024-09-17T05:23:00.645 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ssl", 2024-09-17T05:23:00.645 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.645 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.645 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.646 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "false", 2024-09-17T05:23:00.646 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.646 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.646 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.646 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-17T05:23:00.646 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.646 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.646 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.646 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.646 INFO:teuthology.orchestra.run.smithi098.stdout: "threads": { 2024-09-17T05:23:00.646 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "threads", 2024-09-17T05:23:00.646 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.646 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.647 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.647 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "5", 2024-09-17T05:23:00.647 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "1", 2024-09-17T05:23:00.647 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "32", 2024-09-17T05:23:00.647 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.647 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-17T05:23:00.647 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.647 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.647 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.647 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.647 INFO:teuthology.orchestra.run.smithi098.stdout: "username": { 2024-09-17T05:23:00.647 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "username", 2024-09-17T05:23:00.647 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.648 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.648 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.648 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.648 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.648 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.648 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.648 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "username of InfluxDB server user", 2024-09-17T05:23:00.648 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.648 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.648 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.648 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.648 INFO:teuthology.orchestra.run.smithi098.stdout: "verify_ssl": { 2024-09-17T05:23:00.648 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "verify_ssl", 2024-09-17T05:23:00.648 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.649 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.649 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.649 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "true", 2024-09-17T05:23:00.649 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.649 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.649 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.649 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-17T05:23:00.649 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.649 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.649 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.649 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.649 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.650 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:00.650 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "insights", 2024-09-17T05:23:00.650 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:00.650 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:00.650 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:00.650 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:00.650 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:00.650 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.650 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.650 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.650 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.650 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.650 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.650 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.651 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.651 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.651 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.651 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.651 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.651 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.651 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.651 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.651 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.651 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.651 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.651 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.651 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:00.652 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:00.652 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.652 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.652 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.652 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.652 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.652 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.652 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.652 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.652 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.652 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.652 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.652 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.652 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:00.653 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:00.653 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.653 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.653 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.653 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:00.653 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.653 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.653 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.653 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.653 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.653 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.653 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.653 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.654 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.654 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.654 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.654 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.654 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.654 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.654 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.654 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:00.654 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:00.654 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.654 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.654 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.654 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.654 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.655 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.655 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.655 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.655 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.655 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.655 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.655 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.655 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:00.655 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:00.655 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.655 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:00.655 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.655 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:00.656 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.656 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.656 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.656 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.656 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.656 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.656 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.656 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.656 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.656 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.656 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:00.656 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "iostat", 2024-09-17T05:23:00.656 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:00.657 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:00.657 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:00.657 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:00.657 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:00.657 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.657 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.657 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.657 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.657 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.657 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.657 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.657 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.657 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.658 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.658 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.658 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.658 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.658 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.658 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.658 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.658 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.658 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.658 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.658 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:00.658 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:00.658 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.659 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.659 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.659 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.659 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.659 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.659 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.659 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.659 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.659 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.659 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.659 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.659 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:00.660 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:00.660 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.660 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.660 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.660 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:00.660 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.660 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.660 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.660 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.660 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.660 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.660 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.661 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.661 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.661 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.661 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.661 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.661 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.661 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.661 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.661 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:00.661 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:00.661 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.661 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.661 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.662 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.662 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.662 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.662 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.662 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.662 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.662 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.662 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.662 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.662 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:00.662 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:00.662 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.662 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:00.662 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.663 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:00.663 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.663 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.663 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.663 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.663 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.663 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.663 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.663 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.663 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.663 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.663 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:00.663 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "localpool", 2024-09-17T05:23:00.663 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:00.664 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:00.664 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:00.664 INFO:teuthology.orchestra.run.smithi098.stdout: "failure_domain": { 2024-09-17T05:23:00.664 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "failure_domain", 2024-09-17T05:23:00.664 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.664 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.664 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.664 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "host", 2024-09-17T05:23:00.664 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.664 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.664 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.664 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "failure domain for any created local pool", 2024-09-17T05:23:00.665 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-17T05:23:00.665 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.665 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.665 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.665 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:00.665 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:00.665 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.665 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.665 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.665 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.665 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.665 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.665 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.665 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.666 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.666 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.666 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.666 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.666 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.666 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.666 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.666 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.666 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.666 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.666 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.666 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:00.666 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:00.667 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.667 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.667 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.667 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.667 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.667 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.667 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.667 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.667 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.667 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.667 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.667 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.667 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:00.667 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:00.668 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.668 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.668 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.668 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:00.668 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.668 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.668 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.668 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.668 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.668 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.668 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.668 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.668 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.668 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.669 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.669 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.669 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.669 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.669 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.669 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:00.669 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:00.669 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.669 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.669 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.669 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.669 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.669 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.670 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.670 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.670 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.670 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.670 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.670 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.670 INFO:teuthology.orchestra.run.smithi098.stdout: "min_size": { 2024-09-17T05:23:00.670 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "min_size", 2024-09-17T05:23:00.670 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.670 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.670 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.670 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.670 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.670 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.671 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.671 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "default min_size for any created local pool", 2024-09-17T05:23:00.671 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-17T05:23:00.671 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.671 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.671 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.671 INFO:teuthology.orchestra.run.smithi098.stdout: "num_rep": { 2024-09-17T05:23:00.671 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "num_rep", 2024-09-17T05:23:00.671 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.671 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.671 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.671 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "3", 2024-09-17T05:23:00.671 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.671 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.672 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.672 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "default replica count for any created local pool", 2024-09-17T05:23:00.672 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.672 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.672 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.672 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.672 INFO:teuthology.orchestra.run.smithi098.stdout: "pg_num": { 2024-09-17T05:23:00.672 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "pg_num", 2024-09-17T05:23:00.672 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.672 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.672 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.672 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "128", 2024-09-17T05:23:00.672 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.673 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.673 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.673 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "default pg_num for any created local pool", 2024-09-17T05:23:00.673 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.673 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.673 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.673 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.673 INFO:teuthology.orchestra.run.smithi098.stdout: "prefix": { 2024-09-17T05:23:00.673 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "prefix", 2024-09-17T05:23:00.673 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.673 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.673 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.673 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.674 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.674 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.674 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.674 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "name prefix for any created local pool", 2024-09-17T05:23:00.674 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.674 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.674 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.674 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.674 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:00.674 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:00.674 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.674 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:00.674 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.674 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:00.675 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.675 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.675 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.675 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.675 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.675 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.675 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.675 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.675 INFO:teuthology.orchestra.run.smithi098.stdout: "subtree": { 2024-09-17T05:23:00.675 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "subtree", 2024-09-17T05:23:00.675 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.675 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.675 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.675 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "rack", 2024-09-17T05:23:00.676 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.676 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.676 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.676 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-17T05:23:00.676 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-17T05:23:00.676 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.676 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.676 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.676 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.676 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.676 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:00.676 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "mds_autoscaler", 2024-09-17T05:23:00.676 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:00.677 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:00.677 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:00.677 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:00.677 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:00.677 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.677 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.677 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.677 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.677 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.677 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.677 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.677 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.677 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.677 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.678 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.678 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.678 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.678 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.678 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.678 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.678 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.678 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.678 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.678 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:00.678 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:00.678 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.678 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.679 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.679 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.679 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.679 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.679 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.679 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.679 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.679 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.679 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.679 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.679 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:00.679 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:00.679 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.679 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.680 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.680 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:00.680 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.680 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.680 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.680 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.680 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.680 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.680 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.680 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.680 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.680 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.680 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.681 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.681 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.681 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.681 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:00.681 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:00.681 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.681 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.681 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.681 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.681 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.681 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.681 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.681 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.682 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.682 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.682 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.682 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.682 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:00.682 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:00.682 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.682 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:00.682 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.682 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:00.682 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.682 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.682 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.683 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.683 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.683 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.683 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.683 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.683 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.683 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:00.683 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "mirroring", 2024-09-17T05:23:00.683 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:00.683 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:00.683 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:00.683 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:00.683 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:00.684 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.684 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.684 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.684 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.684 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.684 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.684 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.684 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.684 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.684 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.684 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.684 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.684 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.685 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.685 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.685 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.685 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.685 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.685 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.685 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:00.685 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:00.685 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.685 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.685 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.685 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.685 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.685 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.686 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.686 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.686 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.686 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.686 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.686 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.686 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:00.686 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:00.686 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.686 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.686 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.686 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:00.686 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.687 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.687 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.687 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.687 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.687 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.687 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.687 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.687 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.687 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.687 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.687 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.687 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.688 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.688 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.688 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:00.688 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:00.688 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.688 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.688 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.688 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.688 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.688 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.688 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.688 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.688 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.689 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.689 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.689 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.689 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:00.689 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:00.689 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.689 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:00.689 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.689 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:00.689 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.689 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.689 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.689 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.690 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.690 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.690 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.690 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.690 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.690 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:00.690 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "nfs", 2024-09-17T05:23:00.690 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:00.690 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:00.690 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:00.690 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:00.690 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:00.690 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.691 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.691 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.691 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.691 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.691 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.691 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.691 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.691 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.691 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.691 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.691 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.691 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.691 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.691 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.692 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.692 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.692 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.692 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.692 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:00.692 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:00.692 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.692 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.692 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.692 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.692 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.692 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.692 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.692 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.693 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.693 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.693 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.693 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.693 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:00.693 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:00.693 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.693 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.693 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.693 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:00.693 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.693 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.693 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.694 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.694 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.694 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.694 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.694 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.694 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.694 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.694 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.694 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.694 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.694 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.694 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.694 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:00.694 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:00.695 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.695 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.695 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.695 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.695 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.695 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.695 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.695 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.695 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.695 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.695 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.695 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.695 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:00.695 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:00.696 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.696 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:00.696 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.696 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:00.696 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.696 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.696 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.696 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.696 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.696 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.696 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.696 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.696 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.696 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.697 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:00.697 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "orchestrator", 2024-09-17T05:23:00.697 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:00.697 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:00.697 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:00.697 INFO:teuthology.orchestra.run.smithi098.stdout: "fail_fs": { 2024-09-17T05:23:00.697 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "fail_fs", 2024-09-17T05:23:00.697 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.697 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.697 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.697 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.697 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.697 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.697 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.698 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-17T05:23:00.698 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.698 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.698 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.698 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:00.698 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:00.698 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.698 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.698 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.698 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.698 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.698 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.699 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.699 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.699 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.699 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.699 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.699 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.699 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.699 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.699 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.699 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.699 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.699 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.699 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.699 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:00.700 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:00.700 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.700 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.700 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.700 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.700 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.700 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.700 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.700 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.700 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.700 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.700 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.701 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:00.701 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:00.701 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.701 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.701 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.701 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:00.701 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.701 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.701 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.701 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.701 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.701 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.701 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.701 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.702 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.702 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.702 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.702 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.702 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.702 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.702 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.702 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:00.702 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:00.702 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.702 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.702 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.703 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.703 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.703 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.703 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.703 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.703 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.703 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.703 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.703 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.703 INFO:teuthology.orchestra.run.smithi098.stdout: "orchestrator": { 2024-09-17T05:23:00.703 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "orchestrator", 2024-09-17T05:23:00.703 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.703 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.703 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.704 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.704 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.704 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.704 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.704 INFO:teuthology.orchestra.run.smithi098.stdout: "cephadm", 2024-09-17T05:23:00.704 INFO:teuthology.orchestra.run.smithi098.stdout: "rook", 2024-09-17T05:23:00.704 INFO:teuthology.orchestra.run.smithi098.stdout: "test_orchestrator" 2024-09-17T05:23:00.704 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.704 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Orchestrator backend", 2024-09-17T05:23:00.704 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.704 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.704 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.704 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.705 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:00.705 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:00.705 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.705 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:00.705 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.705 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:00.705 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.705 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.705 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.705 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.705 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.705 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.705 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.705 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.706 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.706 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.706 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:00.706 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "osd_perf_query", 2024-09-17T05:23:00.706 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:00.706 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:00.706 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:00.706 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:00.706 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:00.706 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.706 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.706 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.706 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.707 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.707 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.707 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.707 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.707 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.707 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.707 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.707 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.707 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.707 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.707 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.707 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.707 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.707 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.708 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:00.708 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:00.708 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.708 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.708 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.708 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.708 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.708 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.708 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.708 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.708 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.708 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.709 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.709 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:00.709 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:00.709 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.709 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.709 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.709 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:00.709 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.709 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.709 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.709 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.709 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.709 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.710 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.710 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.710 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.710 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.710 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.710 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.710 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.710 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.710 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:00.710 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:00.710 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.710 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.710 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.711 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.711 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.711 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.711 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.711 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.711 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.711 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.711 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.711 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:00.711 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:00.711 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.711 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:00.712 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.712 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:00.712 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.712 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.712 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.712 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.712 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.712 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.712 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.712 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.712 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:00.713 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "osd_support", 2024-09-17T05:23:00.713 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:00.713 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:00.713 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:00.713 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:00.713 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:00.713 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.713 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.713 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.713 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.713 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.713 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.714 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.714 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.714 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.714 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.714 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.714 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.714 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.714 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.714 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.714 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.714 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.714 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.714 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.715 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:00.715 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:00.715 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.715 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.715 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.715 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.715 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.715 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.715 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.715 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.715 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.715 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.715 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.716 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:00.716 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:00.716 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.716 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.716 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.716 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:00.716 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.716 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.716 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.716 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.716 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.716 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.716 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.717 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.717 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.717 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.717 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.717 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.717 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.717 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.717 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.717 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:00.717 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:00.717 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.717 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.717 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.718 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.718 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.718 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.718 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.718 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.718 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.718 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.718 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.718 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.718 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:00.718 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:00.718 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.718 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:00.719 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.719 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:00.719 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.719 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.719 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.719 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.719 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.719 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.719 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.719 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.719 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:00.720 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "pg_autoscaler", 2024-09-17T05:23:00.720 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:00.720 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:00.720 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:00.720 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:00.720 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:00.720 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.720 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.720 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.720 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.720 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.720 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.720 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.721 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.721 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.721 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.721 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.721 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.721 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.721 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.721 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.721 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.721 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.721 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.721 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.721 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:00.721 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:00.722 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.722 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.722 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.722 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.722 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.722 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.722 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.722 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.722 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.722 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.722 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.722 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.722 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:00.723 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:00.723 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.723 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.723 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.723 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:00.723 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.723 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.723 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.723 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.723 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.723 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.723 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.723 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.723 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.724 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.724 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.724 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.724 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.724 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.724 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:00.724 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:00.724 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.724 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.724 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.724 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.724 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.725 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.725 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.725 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.725 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.725 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.725 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.725 INFO:teuthology.orchestra.run.smithi098.stdout: "sleep_interval": { 2024-09-17T05:23:00.725 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sleep_interval", 2024-09-17T05:23:00.725 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-17T05:23:00.725 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.725 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.725 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "60", 2024-09-17T05:23:00.725 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.726 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.726 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.726 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.726 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.726 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.726 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.726 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:00.726 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:00.726 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.726 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:00.726 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.726 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:00.726 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.727 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.727 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.727 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.727 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.727 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.727 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.727 INFO:teuthology.orchestra.run.smithi098.stdout: "threshold": { 2024-09-17T05:23:00.727 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "threshold", 2024-09-17T05:23:00.727 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "float", 2024-09-17T05:23:00.727 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.727 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.727 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "3.0", 2024-09-17T05:23:00.728 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "1.0", 2024-09-17T05:23:00.728 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.728 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.728 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "scaling threshold", 2024-09-17T05:23:00.728 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-17T05:23:00.728 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.728 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.728 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.728 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:00.728 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "progress", 2024-09-17T05:23:00.728 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:00.728 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:00.729 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:00.729 INFO:teuthology.orchestra.run.smithi098.stdout: "allow_pg_recovery_event": { 2024-09-17T05:23:00.729 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "allow_pg_recovery_event", 2024-09-17T05:23:00.729 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.729 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.729 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.729 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.729 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.729 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.729 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.729 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-17T05:23:00.729 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.729 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.730 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.730 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.730 INFO:teuthology.orchestra.run.smithi098.stdout: "enabled": { 2024-09-17T05:23:00.730 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "enabled", 2024-09-17T05:23:00.730 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.730 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.730 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.730 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:00.730 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.730 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.730 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.730 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.730 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.730 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.731 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.731 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:00.731 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:00.731 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.731 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.731 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.731 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.731 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.731 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.731 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.731 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.732 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.732 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.732 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.732 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.732 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.732 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.732 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.732 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.732 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.732 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.732 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.732 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:00.732 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:00.733 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.733 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.733 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.733 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.733 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.733 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.733 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.733 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.733 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.733 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.733 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.733 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.733 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:00.733 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:00.734 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.734 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.734 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.734 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:00.734 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.734 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.734 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.734 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.734 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.734 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.734 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.734 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.734 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.735 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.735 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.735 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.735 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.735 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.735 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:00.735 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:00.735 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.735 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.735 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.735 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.735 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.735 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.736 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.736 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.736 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.736 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.736 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.736 INFO:teuthology.orchestra.run.smithi098.stdout: "max_completed_events": { 2024-09-17T05:23:00.736 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "max_completed_events", 2024-09-17T05:23:00.736 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.736 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.736 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.736 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "50", 2024-09-17T05:23:00.736 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.737 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.737 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.737 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "number of past completed events to remember", 2024-09-17T05:23:00.737 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.737 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.737 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.737 INFO:teuthology.orchestra.run.smithi098.stdout: "sleep_interval": { 2024-09-17T05:23:00.737 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sleep_interval", 2024-09-17T05:23:00.737 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-17T05:23:00.737 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.737 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.737 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "5", 2024-09-17T05:23:00.737 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.738 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.738 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.738 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "how long the module is going to sleep", 2024-09-17T05:23:00.738 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.738 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.738 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.738 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:00.738 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:00.738 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.738 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:00.738 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.738 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:00.739 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.739 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.739 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.739 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.739 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.739 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.739 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.739 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.739 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:00.739 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "prometheus", 2024-09-17T05:23:00.739 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:00.739 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:00.740 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:00.740 INFO:teuthology.orchestra.run.smithi098.stdout: "cache": { 2024-09-17T05:23:00.740 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "cache", 2024-09-17T05:23:00.740 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.740 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.740 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.740 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:00.740 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.740 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.740 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.740 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.740 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.740 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.741 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.741 INFO:teuthology.orchestra.run.smithi098.stdout: "exclude_perf_counters": { 2024-09-17T05:23:00.741 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "exclude_perf_counters", 2024-09-17T05:23:00.741 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.741 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.741 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.741 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:00.741 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.741 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.741 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.741 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-17T05:23:00.741 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-17T05:23:00.742 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.742 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.742 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.742 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:00.742 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:00.742 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.742 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.742 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.742 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.742 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.742 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.742 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.742 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.742 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.743 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.743 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.743 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.743 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.743 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.743 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.743 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.743 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.743 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.743 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:00.743 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:00.743 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.743 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.744 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.744 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.744 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.744 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.744 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.744 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.744 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.744 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.744 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.744 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.744 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:00.744 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:00.744 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.745 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.745 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.745 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:00.745 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.745 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.745 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.745 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.745 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.745 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.746 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.746 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.746 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.746 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.746 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.746 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.746 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.746 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.746 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.746 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:00.746 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:00.746 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.746 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.747 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.747 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.747 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.747 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.747 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.747 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.747 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.747 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.747 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.747 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.747 INFO:teuthology.orchestra.run.smithi098.stdout: "rbd_stats_pools": { 2024-09-17T05:23:00.747 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rbd_stats_pools", 2024-09-17T05:23:00.747 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.748 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.748 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.748 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.748 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.748 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.748 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.748 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.748 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.748 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.748 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.748 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.748 INFO:teuthology.orchestra.run.smithi098.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-17T05:23:00.748 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-17T05:23:00.749 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.749 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.749 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.749 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "300", 2024-09-17T05:23:00.749 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.749 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.749 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.749 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.749 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.749 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.749 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.749 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.749 INFO:teuthology.orchestra.run.smithi098.stdout: "scrape_interval": { 2024-09-17T05:23:00.749 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "scrape_interval", 2024-09-17T05:23:00.750 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "float", 2024-09-17T05:23:00.750 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.750 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.750 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "15.0", 2024-09-17T05:23:00.750 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.750 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.750 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.750 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.750 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.750 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.750 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.750 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.750 INFO:teuthology.orchestra.run.smithi098.stdout: "server_addr": { 2024-09-17T05:23:00.751 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "server_addr", 2024-09-17T05:23:00.751 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.751 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.751 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.751 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "::", 2024-09-17T05:23:00.751 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.751 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.751 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.751 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-17T05:23:00.751 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.751 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.751 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.751 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.751 INFO:teuthology.orchestra.run.smithi098.stdout: "server_port": { 2024-09-17T05:23:00.752 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "server_port", 2024-09-17T05:23:00.752 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.752 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.752 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.752 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "9283", 2024-09-17T05:23:00.752 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.752 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.752 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.752 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-17T05:23:00.752 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.752 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.752 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.752 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.753 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:00.753 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:00.753 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.753 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:00.753 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.753 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:00.753 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.753 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.753 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.753 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.753 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.753 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.753 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.754 INFO:teuthology.orchestra.run.smithi098.stdout: "stale_cache_strategy": { 2024-09-17T05:23:00.754 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "stale_cache_strategy", 2024-09-17T05:23:00.754 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.754 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.754 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.754 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "log", 2024-09-17T05:23:00.754 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.754 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.754 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.754 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.754 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.754 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.754 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.754 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.755 INFO:teuthology.orchestra.run.smithi098.stdout: "standby_behaviour": { 2024-09-17T05:23:00.755 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "standby_behaviour", 2024-09-17T05:23:00.755 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.755 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.755 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.755 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "default", 2024-09-17T05:23:00.755 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.755 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.755 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.755 INFO:teuthology.orchestra.run.smithi098.stdout: "default", 2024-09-17T05:23:00.755 INFO:teuthology.orchestra.run.smithi098.stdout: "error" 2024-09-17T05:23:00.755 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.755 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.756 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.756 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.756 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.756 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.756 INFO:teuthology.orchestra.run.smithi098.stdout: "standby_error_status_code": { 2024-09-17T05:23:00.756 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "standby_error_status_code", 2024-09-17T05:23:00.756 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.756 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.756 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.756 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "500", 2024-09-17T05:23:00.756 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "400", 2024-09-17T05:23:00.756 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "599", 2024-09-17T05:23:00.756 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.756 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.757 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.757 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.757 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.757 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.757 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:00.757 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rbd_support", 2024-09-17T05:23:00.757 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:00.757 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:00.757 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:00.757 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:00.757 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:00.758 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.758 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.758 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.758 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.758 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.758 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.758 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.758 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.758 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.758 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.758 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.758 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.758 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.758 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.759 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.759 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.759 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.759 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.759 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.759 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:00.759 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:00.759 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.759 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.759 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.759 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.759 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.759 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.760 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.760 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.760 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.760 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.760 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.760 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.760 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:00.760 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:00.760 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.760 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.760 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.760 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:00.760 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.761 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.761 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.761 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.761 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.761 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.761 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.761 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.761 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.761 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.761 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.761 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.761 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.762 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.762 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:00.762 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:00.762 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.762 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.762 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.762 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.762 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.762 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.762 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.762 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.762 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.762 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.763 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.763 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.763 INFO:teuthology.orchestra.run.smithi098.stdout: "max_concurrent_snap_create": { 2024-09-17T05:23:00.763 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "max_concurrent_snap_create", 2024-09-17T05:23:00.763 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.763 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.763 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.763 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "10", 2024-09-17T05:23:00.763 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.763 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.763 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.763 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.763 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.764 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.764 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.764 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.764 INFO:teuthology.orchestra.run.smithi098.stdout: "mirror_snapshot_schedule": { 2024-09-17T05:23:00.764 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "mirror_snapshot_schedule", 2024-09-17T05:23:00.764 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.764 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.764 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.764 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.764 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.764 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.764 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.764 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.765 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.765 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.765 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.765 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:00.765 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:00.765 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.765 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:00.765 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.765 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:00.765 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.765 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.765 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.765 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.766 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.766 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.766 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.766 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.766 INFO:teuthology.orchestra.run.smithi098.stdout: "trash_purge_schedule": { 2024-09-17T05:23:00.766 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "trash_purge_schedule", 2024-09-17T05:23:00.766 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.766 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.766 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.766 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.766 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.766 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.766 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.767 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.767 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.767 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.767 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.767 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.767 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.767 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.767 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:00.767 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "restful", 2024-09-17T05:23:00.767 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:00.767 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:00.767 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:00.767 INFO:teuthology.orchestra.run.smithi098.stdout: "enable_auth": { 2024-09-17T05:23:00.767 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "enable_auth", 2024-09-17T05:23:00.768 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.768 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.768 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.768 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:00.768 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.768 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.768 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.768 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.768 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.768 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.768 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.768 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.768 INFO:teuthology.orchestra.run.smithi098.stdout: "key_file": { 2024-09-17T05:23:00.769 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "key_file", 2024-09-17T05:23:00.769 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.769 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.769 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.769 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.769 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.769 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.769 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.769 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.769 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.769 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.769 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.769 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.769 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:00.770 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:00.770 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.770 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.770 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.770 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.770 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.770 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.770 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.770 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.770 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.770 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.770 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.770 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.771 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.771 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.771 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.771 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.771 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.771 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.771 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.771 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:00.771 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:00.771 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.771 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.771 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.771 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.771 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.772 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.772 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.772 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.772 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.772 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.772 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.772 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.772 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:00.772 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:00.772 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.772 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.772 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.772 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:00.773 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.773 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.773 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.773 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.773 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.773 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.773 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.773 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.773 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.773 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.773 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.773 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.773 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.774 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.774 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.774 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:00.774 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:00.774 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.774 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.774 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.774 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.774 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.774 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.774 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.774 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.774 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.775 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.775 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.775 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.775 INFO:teuthology.orchestra.run.smithi098.stdout: "max_requests": { 2024-09-17T05:23:00.775 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "max_requests", 2024-09-17T05:23:00.775 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.775 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.775 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.775 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "500", 2024-09-17T05:23:00.775 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.775 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.775 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.775 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-17T05:23:00.775 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.776 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.776 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.776 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.776 INFO:teuthology.orchestra.run.smithi098.stdout: "server_addr": { 2024-09-17T05:23:00.776 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "server_addr", 2024-09-17T05:23:00.776 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.776 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.776 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.776 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.776 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.776 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.776 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.776 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.777 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.777 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.777 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.777 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.777 INFO:teuthology.orchestra.run.smithi098.stdout: "server_port": { 2024-09-17T05:23:00.777 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "server_port", 2024-09-17T05:23:00.777 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.777 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.777 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.777 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.777 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.777 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.777 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.778 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.778 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.778 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.778 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.778 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.778 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:00.778 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:00.778 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.778 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:00.778 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.778 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:00.778 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.778 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.778 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.779 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.779 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.779 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.779 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.779 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.779 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.779 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.779 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:00.779 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rgw", 2024-09-17T05:23:00.779 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:00.779 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:00.779 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:00.779 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:00.779 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:00.780 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.780 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.780 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.780 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.780 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.780 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.780 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.780 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.780 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.780 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.780 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.780 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.780 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.781 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.781 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.781 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.781 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.781 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.781 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.781 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:00.781 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:00.781 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.781 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.781 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.781 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.781 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.782 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.782 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.782 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.782 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.782 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.782 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.782 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.782 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:00.782 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:00.782 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.782 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.782 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.782 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:00.782 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.783 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.783 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.783 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.783 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.783 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.783 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.783 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.783 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.783 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.783 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.783 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.783 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.783 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.784 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.784 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:00.784 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:00.784 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.784 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.784 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.784 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.784 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.784 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.784 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.784 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.784 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.784 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.784 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.785 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.785 INFO:teuthology.orchestra.run.smithi098.stdout: "secondary_zone_period_retry_limit": { 2024-09-17T05:23:00.785 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-17T05:23:00.785 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.785 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.785 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.785 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "5", 2024-09-17T05:23:00.785 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.785 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.785 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.785 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-17T05:23:00.785 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.785 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.785 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.786 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.786 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:00.786 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:00.786 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.786 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:00.786 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.786 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:00.786 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.786 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.786 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.786 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.786 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.786 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.787 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.787 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.787 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.787 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.787 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:00.787 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rook", 2024-09-17T05:23:00.787 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:00.787 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:00.787 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:00.787 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:00.787 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:00.787 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.787 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.788 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.788 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.788 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.788 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.788 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.788 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.788 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.788 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.788 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.788 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.788 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.788 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.788 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.789 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.789 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.789 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.789 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.789 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:00.789 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:00.789 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.789 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.789 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.789 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.789 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.789 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.789 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.790 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.790 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.790 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.790 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.790 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.790 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:00.790 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:00.790 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.790 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.790 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.790 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:00.790 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.790 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.790 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.791 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.791 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.791 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.791 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.791 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.791 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.791 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.791 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.791 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.791 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.791 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.791 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.791 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:00.791 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:00.792 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.792 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.792 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.792 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.792 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.792 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.792 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.792 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.792 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.792 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.792 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.792 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.792 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:00.793 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:00.793 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.793 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:00.793 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.793 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:00.793 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.793 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.793 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.793 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.793 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.793 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.793 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.793 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.794 INFO:teuthology.orchestra.run.smithi098.stdout: "storage_class": { 2024-09-17T05:23:00.794 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "storage_class", 2024-09-17T05:23:00.794 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.794 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.794 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.794 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "local", 2024-09-17T05:23:00.794 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.794 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.794 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.794 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-17T05:23:00.794 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.794 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.794 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.794 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.795 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.795 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.795 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:00.795 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "selftest", 2024-09-17T05:23:00.795 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:00.795 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:00.795 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:00.795 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:00.795 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:00.795 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.795 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.795 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.795 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.795 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.796 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.796 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.796 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.796 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.796 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.796 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.796 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.796 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.796 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.796 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.796 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.796 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.796 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.797 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:00.797 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:00.797 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.797 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.797 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.797 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.797 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.797 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.797 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.797 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.797 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.797 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.797 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.798 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.798 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:00.798 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:00.798 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.798 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.798 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.798 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:00.798 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.798 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.798 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.798 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.798 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.798 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.799 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.799 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.799 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.799 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.799 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.799 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.799 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.799 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.799 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.799 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:00.799 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:00.799 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.799 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.799 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.800 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.800 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.800 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.800 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.800 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.800 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.800 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.800 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.800 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.800 INFO:teuthology.orchestra.run.smithi098.stdout: "roption1": { 2024-09-17T05:23:00.800 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "roption1", 2024-09-17T05:23:00.800 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.800 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.801 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.801 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.801 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.801 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.801 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.801 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.801 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.801 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.801 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.801 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.801 INFO:teuthology.orchestra.run.smithi098.stdout: "roption2": { 2024-09-17T05:23:00.801 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "roption2", 2024-09-17T05:23:00.801 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.801 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.802 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.802 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "xyz", 2024-09-17T05:23:00.802 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.802 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.802 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.802 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.802 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.802 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.802 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.802 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.802 INFO:teuthology.orchestra.run.smithi098.stdout: "rwoption1": { 2024-09-17T05:23:00.802 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rwoption1", 2024-09-17T05:23:00.803 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.803 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.803 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.803 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.803 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.803 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.803 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.803 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.803 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.803 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.803 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.803 INFO:teuthology.orchestra.run.smithi098.stdout: "rwoption2": { 2024-09-17T05:23:00.804 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rwoption2", 2024-09-17T05:23:00.804 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.804 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.804 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.804 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.804 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.804 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.804 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.804 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.804 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.804 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.804 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.804 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.805 INFO:teuthology.orchestra.run.smithi098.stdout: "rwoption3": { 2024-09-17T05:23:00.805 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rwoption3", 2024-09-17T05:23:00.805 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "float", 2024-09-17T05:23:00.805 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.805 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.805 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.805 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.805 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.805 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.805 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.805 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.805 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.805 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.806 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.806 INFO:teuthology.orchestra.run.smithi098.stdout: "rwoption4": { 2024-09-17T05:23:00.806 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rwoption4", 2024-09-17T05:23:00.806 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.806 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.806 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.806 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.806 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.806 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.806 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.806 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.806 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.806 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.806 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.807 INFO:teuthology.orchestra.run.smithi098.stdout: "rwoption5": { 2024-09-17T05:23:00.807 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rwoption5", 2024-09-17T05:23:00.807 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.807 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.807 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.807 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.807 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.807 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.807 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.807 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.807 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.807 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.807 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.808 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.808 INFO:teuthology.orchestra.run.smithi098.stdout: "rwoption6": { 2024-09-17T05:23:00.808 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rwoption6", 2024-09-17T05:23:00.808 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.808 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.808 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.808 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:00.808 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.808 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.808 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.808 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.808 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.809 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.809 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.809 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.809 INFO:teuthology.orchestra.run.smithi098.stdout: "rwoption7": { 2024-09-17T05:23:00.809 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rwoption7", 2024-09-17T05:23:00.809 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.809 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.809 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.809 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.809 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "1", 2024-09-17T05:23:00.809 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "42", 2024-09-17T05:23:00.809 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.809 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.809 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.810 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.810 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.810 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.810 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:00.810 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:00.810 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.810 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:00.810 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.810 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:00.810 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.810 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.810 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.810 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.810 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.811 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.811 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.811 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.811 INFO:teuthology.orchestra.run.smithi098.stdout: "testkey": { 2024-09-17T05:23:00.811 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "testkey", 2024-09-17T05:23:00.811 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.811 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.811 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.811 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.811 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.811 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.811 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.811 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.812 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.812 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.812 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.812 INFO:teuthology.orchestra.run.smithi098.stdout: "testlkey": { 2024-09-17T05:23:00.812 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "testlkey", 2024-09-17T05:23:00.812 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.812 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.812 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.812 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.812 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.812 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.812 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.812 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.813 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.813 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.813 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.813 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.813 INFO:teuthology.orchestra.run.smithi098.stdout: "testnewline": { 2024-09-17T05:23:00.813 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "testnewline", 2024-09-17T05:23:00.813 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.813 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.813 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.813 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.814 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.814 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.814 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.814 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.814 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.814 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.814 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.814 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.814 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.814 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:00.814 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "smb", 2024-09-17T05:23:00.814 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:00.814 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:00.815 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:00.815 INFO:teuthology.orchestra.run.smithi098.stdout: "internal_store_backend": { 2024-09-17T05:23:00.815 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "internal_store_backend", 2024-09-17T05:23:00.815 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.815 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:00.815 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.815 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.815 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.815 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.815 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.815 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-17T05:23:00.815 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.815 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.816 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.816 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.816 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:00.816 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:00.816 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.816 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.816 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.816 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.816 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.816 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.816 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.816 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.816 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.816 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.817 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.817 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.817 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.817 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.817 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.817 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.817 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.817 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.817 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.817 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:00.817 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:00.818 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.818 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.818 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.818 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.818 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.818 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.818 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.818 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.818 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.818 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.818 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.818 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:00.818 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:00.819 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.819 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.819 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.819 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:00.819 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.819 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.819 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.819 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.819 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.819 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.819 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.819 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.819 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.819 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.820 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.820 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.820 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.820 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.820 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.820 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:00.820 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:00.820 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.820 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.820 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.820 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.820 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.820 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.821 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.821 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.821 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.821 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.821 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.821 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.821 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:00.821 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:00.821 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.821 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:00.821 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.821 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:00.821 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.821 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.822 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.822 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.822 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.822 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.822 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.822 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.822 INFO:teuthology.orchestra.run.smithi098.stdout: "update_orchestration": { 2024-09-17T05:23:00.822 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "update_orchestration", 2024-09-17T05:23:00.822 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.822 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.822 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.822 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:00.822 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.823 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.823 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.823 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-17T05:23:00.823 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.823 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.823 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.823 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.823 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.823 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:00.823 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "snap_schedule", 2024-09-17T05:23:00.823 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:00.823 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:00.823 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:00.824 INFO:teuthology.orchestra.run.smithi098.stdout: "allow_m_granularity": { 2024-09-17T05:23:00.824 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "allow_m_granularity", 2024-09-17T05:23:00.824 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.824 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.824 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.824 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.824 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.824 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.824 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.824 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "allow minute scheduled snapshots", 2024-09-17T05:23:00.824 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.824 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.824 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.825 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.825 INFO:teuthology.orchestra.run.smithi098.stdout: "dump_on_update": { 2024-09-17T05:23:00.825 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "dump_on_update", 2024-09-17T05:23:00.825 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.825 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.825 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.825 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.825 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.825 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.825 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.825 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "dump database to debug log on update", 2024-09-17T05:23:00.825 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.825 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.825 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.826 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.826 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:00.826 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:00.826 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.826 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.826 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.826 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.826 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.826 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.826 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.826 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.826 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.826 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.826 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.827 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.827 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.827 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.827 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.827 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.827 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.827 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.827 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.827 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:00.827 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:00.827 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.827 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.827 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.828 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.828 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.828 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.828 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.828 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.828 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.828 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.828 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.828 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.828 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:00.828 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:00.828 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.828 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.828 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.829 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:00.829 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.829 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.829 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.829 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.829 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.829 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.829 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.829 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.829 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.829 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.829 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.829 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.830 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.830 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.830 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.830 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:00.830 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:00.830 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.830 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.830 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.830 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.830 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.830 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.830 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.830 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.831 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.831 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.831 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.831 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.831 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:00.831 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:00.831 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.831 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:00.831 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.831 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:00.831 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.831 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.831 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.832 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.832 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.832 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.832 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.832 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.832 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.832 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.832 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:00.832 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "stats", 2024-09-17T05:23:00.832 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:00.832 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:00.832 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:00.832 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:00.832 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:00.833 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.833 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.833 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.833 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.833 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.833 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.833 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.833 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.833 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.833 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.833 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.833 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.833 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.833 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.834 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.834 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.834 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.834 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.834 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.834 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:00.834 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:00.834 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.834 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.834 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.834 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.834 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.834 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.835 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.835 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.835 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.835 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.835 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.835 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.835 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:00.835 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:00.835 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.835 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.835 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.835 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:00.835 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.835 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.836 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.836 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.836 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.836 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.836 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.836 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.836 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.836 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.836 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.836 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.836 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.836 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.836 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.836 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:00.837 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:00.837 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.837 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.837 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.837 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.837 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.837 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.837 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.837 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.837 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.837 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.837 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.837 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.837 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:00.838 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:00.838 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.838 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:00.838 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.838 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:00.838 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.838 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.838 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.838 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.838 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.838 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.838 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.838 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.839 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.839 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.839 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:00.839 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "status", 2024-09-17T05:23:00.839 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:00.839 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:00.839 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:00.839 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:00.839 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:00.839 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.839 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.839 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.839 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.839 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.840 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.840 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.840 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.840 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.840 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.840 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.840 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.840 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.840 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.840 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.840 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.840 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.840 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.840 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.841 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:00.841 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:00.841 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.841 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.841 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.841 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.841 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.841 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.841 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.841 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.841 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.841 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.841 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.842 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.842 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:00.842 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:00.842 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.842 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.842 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.842 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:00.842 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.842 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.842 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.842 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.842 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.842 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.842 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.843 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.843 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.843 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.843 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.843 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.843 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.843 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.843 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.843 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:00.843 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:00.843 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.843 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.843 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.843 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.844 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.844 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.844 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.844 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.844 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.844 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.844 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.844 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.844 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:00.844 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:00.844 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.844 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:00.844 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.845 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:00.845 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.845 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.845 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.845 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.845 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.845 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.845 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.845 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.845 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.845 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.845 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:00.845 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "telegraf", 2024-09-17T05:23:00.845 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:00.846 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:00.846 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:00.846 INFO:teuthology.orchestra.run.smithi098.stdout: "address": { 2024-09-17T05:23:00.846 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "address", 2024-09-17T05:23:00.846 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.846 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.846 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.846 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-17T05:23:00.846 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.846 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.846 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.846 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.847 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.847 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.847 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.847 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.847 INFO:teuthology.orchestra.run.smithi098.stdout: "interval": { 2024-09-17T05:23:00.847 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "interval", 2024-09-17T05:23:00.847 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-17T05:23:00.847 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.847 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.847 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "15", 2024-09-17T05:23:00.847 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.847 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.847 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.847 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.848 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.848 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.848 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.848 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.848 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:00.848 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:00.848 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.848 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.848 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.848 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.848 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.848 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.848 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.849 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.849 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.849 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.849 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.849 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.849 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.849 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.849 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.849 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.849 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.849 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.849 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.849 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:00.849 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:00.850 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.850 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.850 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.850 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.850 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.850 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.850 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.850 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.850 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.850 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.850 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.850 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.850 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:00.851 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:00.851 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.851 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.851 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.851 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:00.851 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.851 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.851 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.851 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.851 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.851 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.851 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.851 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.851 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.852 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.852 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.852 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.852 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.852 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.852 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.852 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:00.852 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:00.852 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.852 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.852 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.852 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.852 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.852 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.853 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.853 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.853 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.853 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.853 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.853 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.853 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:00.853 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:00.853 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.853 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:00.853 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.853 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:00.853 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.854 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.854 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.854 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.854 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.854 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.854 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.854 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.854 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.854 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:00.854 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "telemetry", 2024-09-17T05:23:00.854 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:00.854 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:00.854 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:00.855 INFO:teuthology.orchestra.run.smithi098.stdout: "channel_basic": { 2024-09-17T05:23:00.855 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "channel_basic", 2024-09-17T05:23:00.855 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.855 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.855 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.855 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:00.855 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.855 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.855 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.855 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-17T05:23:00.855 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.855 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.855 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.855 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.856 INFO:teuthology.orchestra.run.smithi098.stdout: "channel_crash": { 2024-09-17T05:23:00.856 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "channel_crash", 2024-09-17T05:23:00.856 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.856 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.856 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.856 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:00.856 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.856 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.856 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.856 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-17T05:23:00.856 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.856 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.856 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.857 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.857 INFO:teuthology.orchestra.run.smithi098.stdout: "channel_device": { 2024-09-17T05:23:00.857 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "channel_device", 2024-09-17T05:23:00.857 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.857 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.857 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.857 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:00.857 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.857 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.857 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.857 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-17T05:23:00.857 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.857 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.858 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.858 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.858 INFO:teuthology.orchestra.run.smithi098.stdout: "channel_ident": { 2024-09-17T05:23:00.858 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "channel_ident", 2024-09-17T05:23:00.858 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.858 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.858 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.858 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.858 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.858 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.858 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.858 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-17T05:23:00.858 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.858 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.859 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.859 INFO:teuthology.orchestra.run.smithi098.stdout: "channel_perf": { 2024-09-17T05:23:00.859 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "channel_perf", 2024-09-17T05:23:00.859 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.859 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.859 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.859 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.859 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.859 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.859 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.859 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-17T05:23:00.859 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.860 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.860 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.860 INFO:teuthology.orchestra.run.smithi098.stdout: "contact": { 2024-09-17T05:23:00.860 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "contact", 2024-09-17T05:23:00.860 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.860 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.860 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.860 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.860 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.860 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.860 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.861 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.861 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.861 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.861 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.861 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.861 INFO:teuthology.orchestra.run.smithi098.stdout: "description": { 2024-09-17T05:23:00.861 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "description", 2024-09-17T05:23:00.861 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.861 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.861 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.861 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.861 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.861 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.861 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.862 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.862 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.862 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.862 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.862 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.862 INFO:teuthology.orchestra.run.smithi098.stdout: "device_url": { 2024-09-17T05:23:00.862 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "device_url", 2024-09-17T05:23:00.862 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.862 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.862 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.862 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-17T05:23:00.862 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.862 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.863 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.863 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.863 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.863 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.863 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.863 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.863 INFO:teuthology.orchestra.run.smithi098.stdout: "enabled": { 2024-09-17T05:23:00.863 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "enabled", 2024-09-17T05:23:00.863 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.863 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.863 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.863 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.863 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.863 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.864 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.864 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.864 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.864 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.864 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.864 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.864 INFO:teuthology.orchestra.run.smithi098.stdout: "interval": { 2024-09-17T05:23:00.864 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "interval", 2024-09-17T05:23:00.864 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.864 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.864 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.864 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "24", 2024-09-17T05:23:00.864 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "8", 2024-09-17T05:23:00.864 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.865 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.865 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.865 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.865 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.865 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.865 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.865 INFO:teuthology.orchestra.run.smithi098.stdout: "last_opt_revision": { 2024-09-17T05:23:00.865 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "last_opt_revision", 2024-09-17T05:23:00.865 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.865 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.865 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.865 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "1", 2024-09-17T05:23:00.865 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.865 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.866 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.866 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.866 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.866 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.866 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.866 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.866 INFO:teuthology.orchestra.run.smithi098.stdout: "leaderboard": { 2024-09-17T05:23:00.866 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "leaderboard", 2024-09-17T05:23:00.868 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.868 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.868 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.868 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.868 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.868 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.868 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.868 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.868 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.869 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.869 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.869 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.869 INFO:teuthology.orchestra.run.smithi098.stdout: "leaderboard_description": { 2024-09-17T05:23:00.869 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "leaderboard_description", 2024-09-17T05:23:00.869 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.869 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.869 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.870 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.870 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.870 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.870 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.870 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.870 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.870 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.870 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.870 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.870 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:00.870 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:00.871 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.871 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.871 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.871 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.871 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.871 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.871 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.871 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.871 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.871 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.871 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.871 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.872 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.872 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.872 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.872 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.872 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.872 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.872 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.872 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:00.872 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:00.872 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.872 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.873 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.873 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.873 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.873 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.873 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.873 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.873 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.873 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.873 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.873 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.873 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:00.874 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:00.874 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.874 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.874 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.874 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:00.874 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.874 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.874 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.874 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.874 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.874 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.874 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.875 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.875 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.875 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.875 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.875 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.875 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.875 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.875 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.875 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:00.875 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:00.875 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.876 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.876 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.876 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.876 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.876 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.876 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.876 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.876 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.876 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.876 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.876 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.877 INFO:teuthology.orchestra.run.smithi098.stdout: "organization": { 2024-09-17T05:23:00.877 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "organization", 2024-09-17T05:23:00.877 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.877 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.877 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.877 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.877 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.877 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.877 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.877 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.878 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.878 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.878 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.878 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.878 INFO:teuthology.orchestra.run.smithi098.stdout: "proxy": { 2024-09-17T05:23:00.878 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "proxy", 2024-09-17T05:23:00.878 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.878 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.878 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.878 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.878 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.879 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.879 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.879 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.879 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.879 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.879 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.879 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.879 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:00.879 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:00.879 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.879 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:00.879 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.880 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:00.880 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.880 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.880 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.880 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.880 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.880 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.880 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.880 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.880 INFO:teuthology.orchestra.run.smithi098.stdout: "url": { 2024-09-17T05:23:00.880 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "url", 2024-09-17T05:23:00.881 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.881 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.881 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.881 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-17T05:23:00.881 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.881 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.881 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.881 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.881 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.881 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.881 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.882 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.882 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.882 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.882 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:00.882 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "test_orchestrator", 2024-09-17T05:23:00.882 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:00.882 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:00.882 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:00.882 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:00.882 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:00.882 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.883 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.883 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.883 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.883 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.883 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.883 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.883 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.883 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.883 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.883 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.883 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.884 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.884 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.884 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.884 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.884 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.884 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.884 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.884 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:00.884 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:00.884 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.884 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.884 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.885 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.885 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.885 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.885 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.885 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.885 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.885 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.885 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.885 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.885 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:00.885 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:00.886 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.886 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.886 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.886 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:00.886 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.886 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.886 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.886 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.886 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.886 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.886 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.886 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.887 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.887 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.887 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.887 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.887 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.887 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.887 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.887 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:00.887 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:00.887 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.887 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.888 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.888 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.888 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.888 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.888 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.888 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.888 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.888 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.888 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.888 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.888 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:00.889 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:00.889 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.889 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:00.889 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.889 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:00.889 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.889 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.889 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.889 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.889 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.890 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.890 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.890 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.890 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.890 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.890 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:00.890 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "volumes", 2024-09-17T05:23:00.890 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:00.890 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:00.890 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:00.890 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:00.891 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:00.891 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.891 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.891 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.891 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.891 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.891 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.891 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.891 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.891 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.891 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.891 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.892 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.892 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.892 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.892 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.892 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.892 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.892 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.892 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.892 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:00.892 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:00.892 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.893 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.893 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.893 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.893 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.893 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.893 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.893 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.893 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.893 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.893 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.893 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.894 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:00.894 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:00.894 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.894 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.894 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.894 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:00.894 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.894 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.894 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.894 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.894 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.894 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.895 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.895 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.895 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.895 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.895 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.895 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.895 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.895 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.895 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.895 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:00.896 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:00.896 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.896 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.896 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.896 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.896 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.896 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.896 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.896 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.896 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.896 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.897 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.897 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.897 INFO:teuthology.orchestra.run.smithi098.stdout: "max_concurrent_clones": { 2024-09-17T05:23:00.897 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "max_concurrent_clones", 2024-09-17T05:23:00.897 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.897 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.897 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.897 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "4", 2024-09-17T05:23:00.897 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.897 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.897 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.898 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-17T05:23:00.898 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.898 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.898 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.898 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.898 INFO:teuthology.orchestra.run.smithi098.stdout: "periodic_async_work": { 2024-09-17T05:23:00.898 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "periodic_async_work", 2024-09-17T05:23:00.898 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.898 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.898 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.898 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.899 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.899 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.899 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.899 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Periodically check for async work", 2024-09-17T05:23:00.899 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.899 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.899 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.899 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.899 INFO:teuthology.orchestra.run.smithi098.stdout: "snapshot_clone_delay": { 2024-09-17T05:23:00.899 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "snapshot_clone_delay", 2024-09-17T05:23:00.899 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.900 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.900 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.900 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:00.900 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.900 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.900 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.900 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-17T05:23:00.900 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.900 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.900 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.900 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.901 INFO:teuthology.orchestra.run.smithi098.stdout: "snapshot_clone_no_wait": { 2024-09-17T05:23:00.901 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "snapshot_clone_no_wait", 2024-09-17T05:23:00.901 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.901 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.901 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.901 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:00.901 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.901 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.901 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.901 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-17T05:23:00.901 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.902 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.902 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.902 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.902 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:00.902 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:00.902 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.902 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:00.902 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.902 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:00.902 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.902 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.903 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.903 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.903 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.903 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.903 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.903 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.903 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.903 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.903 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:00.903 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "zabbix", 2024-09-17T05:23:00.903 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:00.904 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:00.904 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:00.904 INFO:teuthology.orchestra.run.smithi098.stdout: "discovery_interval": { 2024-09-17T05:23:00.904 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "discovery_interval", 2024-09-17T05:23:00.904 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "uint", 2024-09-17T05:23:00.904 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.904 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.904 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "100", 2024-09-17T05:23:00.904 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.904 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.904 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.905 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.905 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.905 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.905 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.905 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.905 INFO:teuthology.orchestra.run.smithi098.stdout: "identifier": { 2024-09-17T05:23:00.905 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "identifier", 2024-09-17T05:23:00.905 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.905 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.905 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.905 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.906 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.906 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.906 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.906 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.906 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.906 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.906 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.906 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.906 INFO:teuthology.orchestra.run.smithi098.stdout: "interval": { 2024-09-17T05:23:00.906 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "interval", 2024-09-17T05:23:00.906 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-17T05:23:00.906 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.907 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.907 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "60", 2024-09-17T05:23:00.907 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.907 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.907 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.907 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.907 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.907 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.907 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.907 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.907 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:00.908 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:00.908 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.908 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.908 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.908 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.908 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.908 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.908 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.908 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.908 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.908 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.909 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.909 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.909 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.909 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.909 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.909 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.909 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.909 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.909 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.909 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:00.909 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:00.909 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.910 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.910 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.910 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.910 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.910 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.910 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.910 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.910 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.910 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.910 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.910 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.910 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:00.911 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:00.911 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.911 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.911 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.911 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:00.911 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.911 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.911 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.911 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.911 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.912 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.912 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.912 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.912 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.912 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.912 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.912 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.912 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.912 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.912 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.912 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:00.913 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:00.913 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.913 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.913 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.913 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.913 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.913 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.913 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.913 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.913 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.914 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.914 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.914 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.914 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:00.914 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:00.914 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.914 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:00.914 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.914 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:00.914 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.914 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.915 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.915 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.915 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.915 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.915 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.915 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.915 INFO:teuthology.orchestra.run.smithi098.stdout: "zabbix_host": { 2024-09-17T05:23:00.915 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "zabbix_host", 2024-09-17T05:23:00.915 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.915 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.915 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.916 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.916 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.916 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.916 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.916 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.916 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.916 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.916 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.916 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.916 INFO:teuthology.orchestra.run.smithi098.stdout: "zabbix_port": { 2024-09-17T05:23:00.916 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "zabbix_port", 2024-09-17T05:23:00.917 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.917 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.917 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.917 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "10051", 2024-09-17T05:23:00.917 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.917 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.917 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.917 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.917 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.917 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.917 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.918 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.918 INFO:teuthology.orchestra.run.smithi098.stdout: "zabbix_sender": { 2024-09-17T05:23:00.918 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "zabbix_sender", 2024-09-17T05:23:00.918 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.918 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.918 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.918 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-17T05:23:00.918 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.918 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.918 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.918 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.918 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.919 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.919 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.919 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.919 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.919 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.919 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T05:23:00.919 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.919 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.919 INFO:teuthology.orchestra.run.smithi098.stdout: "modules": [ 2024-09-17T05:23:00.919 INFO:teuthology.orchestra.run.smithi098.stdout: "iostat", 2024-09-17T05:23:00.919 INFO:teuthology.orchestra.run.smithi098.stdout: "nfs", 2024-09-17T05:23:00.920 INFO:teuthology.orchestra.run.smithi098.stdout: "restful" 2024-09-17T05:23:00.920 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.920 INFO:teuthology.orchestra.run.smithi098.stdout: "available_modules": [ 2024-09-17T05:23:00.920 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:00.920 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "alerts", 2024-09-17T05:23:00.920 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:00.920 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:00.920 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:00.920 INFO:teuthology.orchestra.run.smithi098.stdout: "interval": { 2024-09-17T05:23:00.921 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "interval", 2024-09-17T05:23:00.921 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-17T05:23:00.921 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.921 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.921 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "60", 2024-09-17T05:23:00.921 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.921 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.921 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.921 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "How frequently to reexamine health status", 2024-09-17T05:23:00.921 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.921 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.921 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.922 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.922 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:00.922 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:00.922 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.922 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.922 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.922 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.922 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.922 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.922 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.922 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.923 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.923 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.923 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.923 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.923 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.923 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.923 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.923 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.923 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.923 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.923 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.924 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:00.924 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:00.924 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.924 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.924 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.924 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.924 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.924 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.924 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.924 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.924 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.924 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.925 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.925 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.925 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:00.925 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:00.925 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.925 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.925 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.925 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:00.925 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.925 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.925 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.926 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.926 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.926 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.926 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.926 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.926 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.926 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.926 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.926 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.926 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.926 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.927 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.927 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:00.927 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:00.927 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.927 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.927 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.927 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.927 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.927 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.927 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.927 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.928 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.928 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.928 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.928 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.928 INFO:teuthology.orchestra.run.smithi098.stdout: "smtp_destination": { 2024-09-17T05:23:00.928 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "smtp_destination", 2024-09-17T05:23:00.928 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.928 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.928 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.928 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.928 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.929 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.929 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.929 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-17T05:23:00.929 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.929 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.929 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.929 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.929 INFO:teuthology.orchestra.run.smithi098.stdout: "smtp_from_name": { 2024-09-17T05:23:00.929 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "smtp_from_name", 2024-09-17T05:23:00.929 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.930 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.930 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.930 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "Ceph", 2024-09-17T05:23:00.930 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.930 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.930 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.930 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Email From: name", 2024-09-17T05:23:00.930 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.930 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.930 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.930 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.930 INFO:teuthology.orchestra.run.smithi098.stdout: "smtp_host": { 2024-09-17T05:23:00.931 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "smtp_host", 2024-09-17T05:23:00.931 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.931 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.931 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.931 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.931 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.931 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.931 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.931 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "SMTP server", 2024-09-17T05:23:00.931 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.931 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.932 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.932 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.932 INFO:teuthology.orchestra.run.smithi098.stdout: "smtp_password": { 2024-09-17T05:23:00.932 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "smtp_password", 2024-09-17T05:23:00.932 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.932 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.932 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.932 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.932 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.932 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.932 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.933 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Password to authenticate with", 2024-09-17T05:23:00.933 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.933 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.933 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.933 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.933 INFO:teuthology.orchestra.run.smithi098.stdout: "smtp_port": { 2024-09-17T05:23:00.933 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "smtp_port", 2024-09-17T05:23:00.933 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.933 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.933 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.934 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "465", 2024-09-17T05:23:00.934 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.934 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.934 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.934 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "SMTP port", 2024-09-17T05:23:00.934 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.934 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.934 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.934 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.934 INFO:teuthology.orchestra.run.smithi098.stdout: "smtp_sender": { 2024-09-17T05:23:00.934 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "smtp_sender", 2024-09-17T05:23:00.935 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.935 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.935 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.935 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.935 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.935 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.935 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.935 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "SMTP envelope sender", 2024-09-17T05:23:00.935 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.935 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.935 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.935 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.936 INFO:teuthology.orchestra.run.smithi098.stdout: "smtp_ssl": { 2024-09-17T05:23:00.936 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "smtp_ssl", 2024-09-17T05:23:00.936 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.936 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.936 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.936 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:00.936 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.936 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.936 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.936 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-17T05:23:00.937 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.937 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.937 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.937 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.937 INFO:teuthology.orchestra.run.smithi098.stdout: "smtp_user": { 2024-09-17T05:23:00.937 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "smtp_user", 2024-09-17T05:23:00.937 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.937 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.937 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.937 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.937 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.938 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.938 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.938 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "User to authenticate as", 2024-09-17T05:23:00.938 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.938 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.938 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.938 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.938 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:00.938 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:00.938 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.938 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:00.939 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.939 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:00.939 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.939 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.939 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.939 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.939 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.939 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.939 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.939 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.939 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.940 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.940 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:00.940 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "balancer", 2024-09-17T05:23:00.940 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:00.940 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:00.940 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:00.940 INFO:teuthology.orchestra.run.smithi098.stdout: "active": { 2024-09-17T05:23:00.940 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "active", 2024-09-17T05:23:00.940 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.940 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.940 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.941 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:00.941 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.941 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.941 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.941 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "automatically balance PGs across cluster", 2024-09-17T05:23:00.941 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.941 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.941 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.941 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.941 INFO:teuthology.orchestra.run.smithi098.stdout: "begin_time": { 2024-09-17T05:23:00.941 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "begin_time", 2024-09-17T05:23:00.941 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.942 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.942 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.942 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0000", 2024-09-17T05:23:00.942 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.942 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.942 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.942 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "beginning time of day to automatically balance", 2024-09-17T05:23:00.942 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-17T05:23:00.942 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.942 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.942 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.943 INFO:teuthology.orchestra.run.smithi098.stdout: "begin_weekday": { 2024-09-17T05:23:00.943 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "begin_weekday", 2024-09-17T05:23:00.943 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "uint", 2024-09-17T05:23:00.943 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.943 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.943 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:00.943 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "0", 2024-09-17T05:23:00.943 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "6", 2024-09-17T05:23:00.943 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.943 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-17T05:23:00.943 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-17T05:23:00.943 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.944 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.944 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.944 INFO:teuthology.orchestra.run.smithi098.stdout: "crush_compat_max_iterations": { 2024-09-17T05:23:00.944 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "crush_compat_max_iterations", 2024-09-17T05:23:00.944 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "uint", 2024-09-17T05:23:00.944 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.944 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.944 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "25", 2024-09-17T05:23:00.944 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "1", 2024-09-17T05:23:00.944 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "250", 2024-09-17T05:23:00.944 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.945 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-17T05:23:00.945 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.945 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.945 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.945 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.945 INFO:teuthology.orchestra.run.smithi098.stdout: "crush_compat_metrics": { 2024-09-17T05:23:00.945 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "crush_compat_metrics", 2024-09-17T05:23:00.945 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.945 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.945 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.945 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "pgs,objects,bytes", 2024-09-17T05:23:00.946 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.946 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.946 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.946 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-17T05:23:00.946 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-17T05:23:00.946 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.946 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.946 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.946 INFO:teuthology.orchestra.run.smithi098.stdout: "crush_compat_step": { 2024-09-17T05:23:00.946 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "crush_compat_step", 2024-09-17T05:23:00.946 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "float", 2024-09-17T05:23:00.947 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.947 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.947 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0.5", 2024-09-17T05:23:00.947 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "0.001", 2024-09-17T05:23:00.947 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "0.999", 2024-09-17T05:23:00.947 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.947 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "aggressiveness of optimization", 2024-09-17T05:23:00.947 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-17T05:23:00.947 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.947 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.947 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.948 INFO:teuthology.orchestra.run.smithi098.stdout: "end_time": { 2024-09-17T05:23:00.948 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "end_time", 2024-09-17T05:23:00.948 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.948 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.948 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.948 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "2359", 2024-09-17T05:23:00.948 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.948 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.948 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.948 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "ending time of day to automatically balance", 2024-09-17T05:23:00.948 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-17T05:23:00.949 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.949 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.949 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.949 INFO:teuthology.orchestra.run.smithi098.stdout: "end_weekday": { 2024-09-17T05:23:00.949 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "end_weekday", 2024-09-17T05:23:00.949 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "uint", 2024-09-17T05:23:00.949 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.949 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.949 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:00.949 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "0", 2024-09-17T05:23:00.949 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "6", 2024-09-17T05:23:00.949 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.950 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-17T05:23:00.950 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-17T05:23:00.950 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.950 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.950 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.950 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:00.950 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:00.950 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.950 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.950 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.950 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.951 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.951 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.951 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.951 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.951 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.951 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.951 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.951 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.951 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.951 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.952 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.952 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.952 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.952 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.952 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.952 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:00.952 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:00.952 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.952 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.952 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.952 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.952 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.953 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.953 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.953 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.953 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.953 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.953 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.953 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.953 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:00.953 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:00.953 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.953 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.954 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.954 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:00.954 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.954 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.954 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.954 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:00.954 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:00.954 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:00.954 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:00.954 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:00.954 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:00.955 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.955 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.955 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.955 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.955 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.955 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.955 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:00.955 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:00.955 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.955 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.955 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.956 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.956 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.956 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.956 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.956 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.956 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.956 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.956 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.956 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.956 INFO:teuthology.orchestra.run.smithi098.stdout: "min_score": { 2024-09-17T05:23:00.956 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "min_score", 2024-09-17T05:23:00.957 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "float", 2024-09-17T05:23:00.957 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.957 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.957 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:00.957 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.957 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.957 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.957 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-17T05:23:00.957 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.957 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.957 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.957 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.958 INFO:teuthology.orchestra.run.smithi098.stdout: "mode": { 2024-09-17T05:23:00.958 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "mode", 2024-09-17T05:23:00.958 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.958 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.958 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.958 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "upmap", 2024-09-17T05:23:00.958 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.958 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.958 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.958 INFO:teuthology.orchestra.run.smithi098.stdout: "crush-compat", 2024-09-17T05:23:00.958 INFO:teuthology.orchestra.run.smithi098.stdout: "none", 2024-09-17T05:23:00.959 INFO:teuthology.orchestra.run.smithi098.stdout: "read", 2024-09-17T05:23:00.959 INFO:teuthology.orchestra.run.smithi098.stdout: "upmap", 2024-09-17T05:23:00.959 INFO:teuthology.orchestra.run.smithi098.stdout: "upmap-read" 2024-09-17T05:23:00.959 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.959 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Balancer mode", 2024-09-17T05:23:00.959 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.959 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.959 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.959 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.959 INFO:teuthology.orchestra.run.smithi098.stdout: "pool_ids": { 2024-09-17T05:23:00.959 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "pool_ids", 2024-09-17T05:23:00.959 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.960 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.960 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.960 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.960 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.960 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.960 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.960 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-17T05:23:00.960 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.960 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.960 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.960 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.961 INFO:teuthology.orchestra.run.smithi098.stdout: "sleep_interval": { 2024-09-17T05:23:00.961 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sleep_interval", 2024-09-17T05:23:00.961 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-17T05:23:00.961 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.961 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.961 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "60", 2024-09-17T05:23:00.961 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.961 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.961 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.961 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-17T05:23:00.961 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.962 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.962 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.962 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.962 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:00.962 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:00.962 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.962 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:00.962 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.962 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:00.962 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.962 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.963 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.963 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:00.963 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.963 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.963 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.963 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.963 INFO:teuthology.orchestra.run.smithi098.stdout: "upmap_max_deviation": { 2024-09-17T05:23:00.963 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "upmap_max_deviation", 2024-09-17T05:23:00.963 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.963 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.963 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.963 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "5", 2024-09-17T05:23:00.964 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "1", 2024-09-17T05:23:00.964 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.964 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.964 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-17T05:23:00.964 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-17T05:23:00.964 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.964 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.964 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.964 INFO:teuthology.orchestra.run.smithi098.stdout: "upmap_max_optimizations": { 2024-09-17T05:23:00.964 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "upmap_max_optimizations", 2024-09-17T05:23:00.964 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "uint", 2024-09-17T05:23:00.965 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.965 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.965 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "10", 2024-09-17T05:23:00.965 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.965 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.965 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.965 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-17T05:23:00.965 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.965 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.965 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.965 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.966 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:00.966 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.966 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:00.966 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "cephadm", 2024-09-17T05:23:00.966 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:00.966 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:00.966 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:00.966 INFO:teuthology.orchestra.run.smithi098.stdout: "agent_down_multiplier": { 2024-09-17T05:23:00.966 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "agent_down_multiplier", 2024-09-17T05:23:00.966 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "float", 2024-09-17T05:23:00.966 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.967 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.967 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "3.0", 2024-09-17T05:23:00.967 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.967 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.967 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.967 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-17T05:23:00.967 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.967 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.967 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.967 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.967 INFO:teuthology.orchestra.run.smithi098.stdout: "agent_refresh_rate": { 2024-09-17T05:23:00.968 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "agent_refresh_rate", 2024-09-17T05:23:00.968 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-17T05:23:00.968 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.968 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.968 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "20", 2024-09-17T05:23:00.968 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.968 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.968 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.968 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-17T05:23:00.968 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.968 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.968 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.969 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.969 INFO:teuthology.orchestra.run.smithi098.stdout: "agent_starting_port": { 2024-09-17T05:23:00.969 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "agent_starting_port", 2024-09-17T05:23:00.969 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:00.969 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.969 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.969 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "4721", 2024-09-17T05:23:00.969 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.969 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.969 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.969 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-17T05:23:00.969 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.970 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.970 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.970 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.970 INFO:teuthology.orchestra.run.smithi098.stdout: "allow_ptrace": { 2024-09-17T05:23:00.970 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "allow_ptrace", 2024-09-17T05:23:00.970 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.970 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.970 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.970 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.970 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.970 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.971 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.971 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-17T05:23:00.971 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-17T05:23:00.971 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.971 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.971 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.971 INFO:teuthology.orchestra.run.smithi098.stdout: "autotune_interval": { 2024-09-17T05:23:00.971 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "autotune_interval", 2024-09-17T05:23:00.971 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-17T05:23:00.971 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.972 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.972 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "600", 2024-09-17T05:23:00.972 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.972 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.972 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.972 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-17T05:23:00.972 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.972 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.972 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.972 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.972 INFO:teuthology.orchestra.run.smithi098.stdout: "autotune_memory_target_ratio": { 2024-09-17T05:23:00.973 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "autotune_memory_target_ratio", 2024-09-17T05:23:00.973 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "float", 2024-09-17T05:23:00.973 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.973 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.973 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0.7", 2024-09-17T05:23:00.973 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.973 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.973 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.973 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-17T05:23:00.973 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.973 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.974 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.974 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.974 INFO:teuthology.orchestra.run.smithi098.stdout: "cephadm_log_destination": { 2024-09-17T05:23:00.974 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "cephadm_log_destination", 2024-09-17T05:23:00.974 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.974 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.974 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.974 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:00.974 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.974 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.975 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:00.975 INFO:teuthology.orchestra.run.smithi098.stdout: "file", 2024-09-17T05:23:00.975 INFO:teuthology.orchestra.run.smithi098.stdout: "file,syslog", 2024-09-17T05:23:00.975 INFO:teuthology.orchestra.run.smithi098.stdout: "syslog" 2024-09-17T05:23:00.975 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:00.975 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-17T05:23:00.975 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.975 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.975 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.975 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.975 INFO:teuthology.orchestra.run.smithi098.stdout: "cgroups_split": { 2024-09-17T05:23:00.976 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "cgroups_split", 2024-09-17T05:23:00.976 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.976 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.976 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.976 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:00.976 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.976 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.976 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.976 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-17T05:23:00.976 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.977 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.977 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.977 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.977 INFO:teuthology.orchestra.run.smithi098.stdout: "config_checks_enabled": { 2024-09-17T05:23:00.977 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "config_checks_enabled", 2024-09-17T05:23:00.977 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.977 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.977 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.977 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:00.977 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.978 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.978 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.978 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-17T05:23:00.978 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.978 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.978 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.978 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.978 INFO:teuthology.orchestra.run.smithi098.stdout: "config_dashboard": { 2024-09-17T05:23:00.978 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "config_dashboard", 2024-09-17T05:23:00.978 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:00.979 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.979 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.979 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:00.979 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.979 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.979 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.979 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-17T05:23:00.979 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.979 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.979 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.979 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.980 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_alertmanager": { 2024-09-17T05:23:00.980 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_alertmanager", 2024-09-17T05:23:00.980 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.980 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.980 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.980 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-17T05:23:00.980 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.980 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.980 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.980 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Prometheus container image", 2024-09-17T05:23:00.981 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.981 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.981 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.981 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.981 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_base": { 2024-09-17T05:23:00.981 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_base", 2024-09-17T05:23:00.981 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.981 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.981 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:00.981 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-17T05:23:00.981 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.981 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.982 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.982 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Container image name, without the tag", 2024-09-17T05:23:00.982 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.982 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.982 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.982 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.982 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_elasticsearch": { 2024-09-17T05:23:00.982 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_elasticsearch", 2024-09-17T05:23:00.982 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.982 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.982 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.983 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-17T05:23:00.983 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.983 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.983 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.983 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "elasticsearch container image", 2024-09-17T05:23:00.983 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.983 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.983 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.983 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.983 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_grafana": { 2024-09-17T05:23:00.983 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_grafana", 2024-09-17T05:23:00.983 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.984 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.984 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.984 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-09-17T05:23:00.984 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.984 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.984 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.984 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Prometheus container image", 2024-09-17T05:23:00.984 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.984 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.984 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.985 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.985 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_haproxy": { 2024-09-17T05:23:00.985 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_haproxy", 2024-09-17T05:23:00.985 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.985 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.985 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.985 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-17T05:23:00.985 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.985 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.985 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.985 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "HAproxy container image", 2024-09-17T05:23:00.985 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.986 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.986 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.986 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.986 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_jaeger_agent": { 2024-09-17T05:23:00.986 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_jaeger_agent", 2024-09-17T05:23:00.986 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.986 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.986 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.986 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-17T05:23:00.986 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.986 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.987 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.987 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Jaeger agent container image", 2024-09-17T05:23:00.987 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.987 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.987 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.987 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.987 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_jaeger_collector": { 2024-09-17T05:23:00.987 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_jaeger_collector", 2024-09-17T05:23:00.987 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.987 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.987 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.988 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-17T05:23:00.988 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.988 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.988 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.988 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Jaeger collector container image", 2024-09-17T05:23:00.988 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.988 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.988 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.988 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.988 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_jaeger_query": { 2024-09-17T05:23:00.988 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_jaeger_query", 2024-09-17T05:23:00.988 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.989 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.989 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.989 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-17T05:23:00.989 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.989 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.989 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.989 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Jaeger query container image", 2024-09-17T05:23:00.989 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.989 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.989 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.990 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.990 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_keepalived": { 2024-09-17T05:23:00.990 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_keepalived", 2024-09-17T05:23:00.990 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.990 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.990 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.990 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-17T05:23:00.990 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.990 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.990 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.990 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Keepalived container image", 2024-09-17T05:23:00.990 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.991 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.991 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.991 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.991 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_loki": { 2024-09-17T05:23:00.991 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_loki", 2024-09-17T05:23:00.991 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.991 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.991 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.991 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-17T05:23:00.991 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.991 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.992 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.992 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Loki container image", 2024-09-17T05:23:00.992 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.992 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.992 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.992 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.992 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_nginx": { 2024-09-17T05:23:00.992 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_nginx", 2024-09-17T05:23:00.992 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.992 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.992 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.993 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-17T05:23:00.993 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.993 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.993 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.993 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Nginx container image", 2024-09-17T05:23:00.993 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.993 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.993 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.993 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.993 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_node_exporter": { 2024-09-17T05:23:00.993 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_node_exporter", 2024-09-17T05:23:00.993 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.994 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.994 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.994 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-17T05:23:00.994 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.994 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.994 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.994 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Prometheus container image", 2024-09-17T05:23:00.994 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.994 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.994 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.994 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.995 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_nvmeof": { 2024-09-17T05:23:00.995 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_nvmeof", 2024-09-17T05:23:00.995 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.995 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.995 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.995 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-17T05:23:00.995 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.995 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.995 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.995 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Nvme-of container image", 2024-09-17T05:23:00.995 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.995 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.996 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.996 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.996 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_oauth2_proxy": { 2024-09-17T05:23:00.996 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_oauth2_proxy", 2024-09-17T05:23:00.996 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.996 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.996 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.996 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-17T05:23:00.996 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.996 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.996 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.997 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "oauth2-proxy container image", 2024-09-17T05:23:00.997 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.997 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.997 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.997 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.997 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_prometheus": { 2024-09-17T05:23:00.997 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_prometheus", 2024-09-17T05:23:00.997 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.997 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.997 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.997 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-17T05:23:00.998 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.998 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.998 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.998 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Prometheus container image", 2024-09-17T05:23:00.998 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.998 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.998 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.998 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.998 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_promtail": { 2024-09-17T05:23:00.998 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_promtail", 2024-09-17T05:23:00.998 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:00.999 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:00.999 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:00.999 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-17T05:23:00.999 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:00.999 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:00.999 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:00.999 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Promtail container image", 2024-09-17T05:23:00.999 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:00.999 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:00.999 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:00.999 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:00.999 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_samba": { 2024-09-17T05:23:01.000 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_samba", 2024-09-17T05:23:01.000 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.000 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.000 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.000 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-17T05:23:01.000 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.000 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.000 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.000 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Samba/SMB container image", 2024-09-17T05:23:01.000 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.000 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.001 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.001 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.001 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_samba_metrics": { 2024-09-17T05:23:01.001 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_samba_metrics", 2024-09-17T05:23:01.001 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.001 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.001 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.001 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-17T05:23:01.001 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.001 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.001 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.002 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-17T05:23:01.002 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.002 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.002 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.002 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.002 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_snmp_gateway": { 2024-09-17T05:23:01.002 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_snmp_gateway", 2024-09-17T05:23:01.002 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.002 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.002 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.002 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-17T05:23:01.002 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.003 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.003 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.003 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "SNMP Gateway container image", 2024-09-17T05:23:01.003 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.003 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.003 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.003 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.003 INFO:teuthology.orchestra.run.smithi098.stdout: "container_init": { 2024-09-17T05:23:01.003 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_init", 2024-09-17T05:23:01.003 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.003 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.004 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.004 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:01.004 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.004 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.004 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.004 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Run podman/docker with `--init`", 2024-09-17T05:23:01.004 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.004 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.004 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.004 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.004 INFO:teuthology.orchestra.run.smithi098.stdout: "daemon_cache_timeout": { 2024-09-17T05:23:01.005 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "daemon_cache_timeout", 2024-09-17T05:23:01.005 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-17T05:23:01.005 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.005 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.005 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "600", 2024-09-17T05:23:01.005 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.005 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.005 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.005 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-17T05:23:01.005 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.005 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.006 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.006 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.006 INFO:teuthology.orchestra.run.smithi098.stdout: "default_cephadm_command_timeout": { 2024-09-17T05:23:01.006 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "default_cephadm_command_timeout", 2024-09-17T05:23:01.006 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.006 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.006 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.006 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "900", 2024-09-17T05:23:01.006 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.006 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.006 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.007 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-17T05:23:01.007 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.007 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.007 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.007 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.007 INFO:teuthology.orchestra.run.smithi098.stdout: "default_registry": { 2024-09-17T05:23:01.007 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "default_registry", 2024-09-17T05:23:01.007 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.007 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.007 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.008 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "docker.io", 2024-09-17T05:23:01.008 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.008 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.008 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.008 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-17T05:23:01.008 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.008 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.008 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.008 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.008 INFO:teuthology.orchestra.run.smithi098.stdout: "device_cache_timeout": { 2024-09-17T05:23:01.009 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "device_cache_timeout", 2024-09-17T05:23:01.009 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-17T05:23:01.009 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.009 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.009 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "1800", 2024-09-17T05:23:01.009 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.009 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.009 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.009 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "seconds to cache device inventory", 2024-09-17T05:23:01.009 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.009 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.009 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.010 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.010 INFO:teuthology.orchestra.run.smithi098.stdout: "device_enhanced_scan": { 2024-09-17T05:23:01.010 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "device_enhanced_scan", 2024-09-17T05:23:01.010 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.010 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.010 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.010 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.010 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.010 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.010 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.010 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-17T05:23:01.011 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.011 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.011 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.011 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.011 INFO:teuthology.orchestra.run.smithi098.stdout: "facts_cache_timeout": { 2024-09-17T05:23:01.011 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "facts_cache_timeout", 2024-09-17T05:23:01.011 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-17T05:23:01.011 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.011 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.011 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "60", 2024-09-17T05:23:01.012 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.012 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.012 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.012 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "seconds to cache host facts data", 2024-09-17T05:23:01.012 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.012 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.012 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.012 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.012 INFO:teuthology.orchestra.run.smithi098.stdout: "grafana_dashboards_path": { 2024-09-17T05:23:01.012 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "grafana_dashboards_path", 2024-09-17T05:23:01.012 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.013 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.013 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.013 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-17T05:23:01.013 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.013 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.013 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.013 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-17T05:23:01.013 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.013 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.014 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.014 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.014 INFO:teuthology.orchestra.run.smithi098.stdout: "host_check_interval": { 2024-09-17T05:23:01.014 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "host_check_interval", 2024-09-17T05:23:01.014 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-17T05:23:01.014 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.014 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.014 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "600", 2024-09-17T05:23:01.014 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.014 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.014 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.015 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "how frequently to perform a host check", 2024-09-17T05:23:01.015 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.015 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.015 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.015 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.015 INFO:teuthology.orchestra.run.smithi098.stdout: "hw_monitoring": { 2024-09-17T05:23:01.015 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "hw_monitoring", 2024-09-17T05:23:01.015 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.015 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.015 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.015 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.016 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.016 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.016 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.016 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-17T05:23:01.016 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.016 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.016 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.016 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.016 INFO:teuthology.orchestra.run.smithi098.stdout: "inventory_list_all": { 2024-09-17T05:23:01.016 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "inventory_list_all", 2024-09-17T05:23:01.016 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.017 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.017 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.017 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.017 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.017 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.017 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.017 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-17T05:23:01.017 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.017 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.017 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.017 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.018 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:01.018 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:01.018 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.018 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.018 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.018 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.018 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.018 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.018 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.018 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.018 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.019 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.019 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.019 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.019 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.019 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.019 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.019 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.019 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.019 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.019 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.020 INFO:teuthology.orchestra.run.smithi098.stdout: "log_refresh_metadata": { 2024-09-17T05:23:01.020 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_refresh_metadata", 2024-09-17T05:23:01.020 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.020 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.020 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.020 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.020 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.020 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.020 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.020 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-17T05:23:01.020 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.021 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.021 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.021 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.021 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:01.021 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:01.021 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.021 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.021 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.021 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:01.021 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.021 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.021 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.022 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-17T05:23:01.022 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.022 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.022 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.022 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.022 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:01.022 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:01.022 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.022 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.022 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.022 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:01.023 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.023 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.023 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.023 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.023 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.023 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.023 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.023 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.023 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.023 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.023 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.023 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.024 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.024 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.024 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.024 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:01.024 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:01.024 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.024 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.024 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.024 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.024 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.024 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.025 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.025 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.025 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.025 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.025 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.025 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.025 INFO:teuthology.orchestra.run.smithi098.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-17T05:23:01.025 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-17T05:23:01.025 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.025 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.025 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.025 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.026 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.026 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.026 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.026 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-17T05:23:01.026 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.026 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.026 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.026 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.026 INFO:teuthology.orchestra.run.smithi098.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-17T05:23:01.026 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-17T05:23:01.026 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.027 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.027 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.027 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "*", 2024-09-17T05:23:01.027 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.027 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.027 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.027 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-17T05:23:01.027 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.027 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.027 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.027 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.028 INFO:teuthology.orchestra.run.smithi098.stdout: "max_count_per_host": { 2024-09-17T05:23:01.028 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "max_count_per_host", 2024-09-17T05:23:01.028 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.028 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.028 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.028 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "10", 2024-09-17T05:23:01.028 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.028 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.028 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.028 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "max number of daemons per service per host", 2024-09-17T05:23:01.028 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.029 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.029 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.029 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.029 INFO:teuthology.orchestra.run.smithi098.stdout: "max_osd_draining_count": { 2024-09-17T05:23:01.029 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "max_osd_draining_count", 2024-09-17T05:23:01.029 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.029 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.029 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.029 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "10", 2024-09-17T05:23:01.029 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.029 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.030 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.030 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-17T05:23:01.030 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.030 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.030 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.030 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.030 INFO:teuthology.orchestra.run.smithi098.stdout: "migration_current": { 2024-09-17T05:23:01.030 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "migration_current", 2024-09-17T05:23:01.030 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.030 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.030 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.030 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.031 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.031 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.031 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.031 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "internal - do not modify", 2024-09-17T05:23:01.031 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.031 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.031 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.031 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.031 INFO:teuthology.orchestra.run.smithi098.stdout: "mode": { 2024-09-17T05:23:01.031 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "mode", 2024-09-17T05:23:01.031 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.031 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.032 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.032 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "root", 2024-09-17T05:23:01.032 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.032 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.032 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.032 INFO:teuthology.orchestra.run.smithi098.stdout: "cephadm-package", 2024-09-17T05:23:01.032 INFO:teuthology.orchestra.run.smithi098.stdout: "root" 2024-09-17T05:23:01.032 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.032 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "mode for remote execution of cephadm", 2024-09-17T05:23:01.032 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.032 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.033 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.033 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.033 INFO:teuthology.orchestra.run.smithi098.stdout: "oob_default_addr": { 2024-09-17T05:23:01.033 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "oob_default_addr", 2024-09-17T05:23:01.033 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.033 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.033 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.033 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "169.254.1.1", 2024-09-17T05:23:01.033 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.033 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.033 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.033 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-17T05:23:01.034 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.034 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.034 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.034 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.034 INFO:teuthology.orchestra.run.smithi098.stdout: "prometheus_alerts_path": { 2024-09-17T05:23:01.034 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "prometheus_alerts_path", 2024-09-17T05:23:01.034 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.034 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.034 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.034 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-17T05:23:01.034 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.035 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.035 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.035 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-17T05:23:01.035 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.035 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.035 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.035 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.035 INFO:teuthology.orchestra.run.smithi098.stdout: "registry_insecure": { 2024-09-17T05:23:01.035 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "registry_insecure", 2024-09-17T05:23:01.035 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.035 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.035 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.036 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.036 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.036 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.036 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.036 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-17T05:23:01.036 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.036 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.036 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.036 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.036 INFO:teuthology.orchestra.run.smithi098.stdout: "registry_password": { 2024-09-17T05:23:01.037 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "registry_password", 2024-09-17T05:23:01.037 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.037 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.037 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.037 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.037 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.037 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.037 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.037 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-17T05:23:01.037 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.037 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.037 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.038 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.038 INFO:teuthology.orchestra.run.smithi098.stdout: "registry_url": { 2024-09-17T05:23:01.038 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "registry_url", 2024-09-17T05:23:01.038 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.038 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.038 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.038 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.038 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.038 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.038 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.038 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-17T05:23:01.039 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.039 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.039 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.039 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.039 INFO:teuthology.orchestra.run.smithi098.stdout: "registry_username": { 2024-09-17T05:23:01.039 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "registry_username", 2024-09-17T05:23:01.039 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.039 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.039 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.039 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.039 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.039 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.040 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.040 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-17T05:23:01.040 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.040 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.040 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.040 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.040 INFO:teuthology.orchestra.run.smithi098.stdout: "secure_monitoring_stack": { 2024-09-17T05:23:01.040 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "secure_monitoring_stack", 2024-09-17T05:23:01.040 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.040 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.040 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.040 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.041 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.041 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.041 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.041 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-17T05:23:01.041 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.041 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.041 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.041 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.041 INFO:teuthology.orchestra.run.smithi098.stdout: "service_discovery_port": { 2024-09-17T05:23:01.041 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "service_discovery_port", 2024-09-17T05:23:01.042 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.042 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.042 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.042 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "8765", 2024-09-17T05:23:01.042 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.042 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.042 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.042 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "cephadm service discovery port", 2024-09-17T05:23:01.042 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.042 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.042 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.042 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.043 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:01.043 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:01.043 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.043 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:01.043 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.043 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:01.043 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.043 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.043 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.043 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.043 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.044 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.044 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.044 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.044 INFO:teuthology.orchestra.run.smithi098.stdout: "ssh_config_file": { 2024-09-17T05:23:01.044 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ssh_config_file", 2024-09-17T05:23:01.044 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.044 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.044 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.044 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.044 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.044 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.045 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.045 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-17T05:23:01.045 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.045 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.045 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.045 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.045 INFO:teuthology.orchestra.run.smithi098.stdout: "ssh_keepalive_count_max": { 2024-09-17T05:23:01.045 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ssh_keepalive_count_max", 2024-09-17T05:23:01.045 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.045 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.046 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.046 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "3", 2024-09-17T05:23:01.046 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.046 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.046 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.046 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-17T05:23:01.046 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.046 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.046 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.046 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.046 INFO:teuthology.orchestra.run.smithi098.stdout: "ssh_keepalive_interval": { 2024-09-17T05:23:01.047 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ssh_keepalive_interval", 2024-09-17T05:23:01.047 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.047 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.047 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.047 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "7", 2024-09-17T05:23:01.047 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.047 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.047 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.047 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-17T05:23:01.047 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.047 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.048 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.048 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.048 INFO:teuthology.orchestra.run.smithi098.stdout: "use_agent": { 2024-09-17T05:23:01.048 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "use_agent", 2024-09-17T05:23:01.048 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.048 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.048 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.048 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.048 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.048 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.048 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.049 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-17T05:23:01.049 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.049 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.049 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.049 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.049 INFO:teuthology.orchestra.run.smithi098.stdout: "use_repo_digest": { 2024-09-17T05:23:01.049 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "use_repo_digest", 2024-09-17T05:23:01.049 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.049 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.049 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.049 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:01.050 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.050 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.050 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.050 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-17T05:23:01.050 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.050 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.050 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.050 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.050 INFO:teuthology.orchestra.run.smithi098.stdout: "warn_on_failed_host_check": { 2024-09-17T05:23:01.050 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "warn_on_failed_host_check", 2024-09-17T05:23:01.050 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.050 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.051 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.051 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:01.051 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.051 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.051 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.051 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "raise a health warning if the host check fails", 2024-09-17T05:23:01.051 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.051 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.051 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.051 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.051 INFO:teuthology.orchestra.run.smithi098.stdout: "warn_on_stray_daemons": { 2024-09-17T05:23:01.052 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "warn_on_stray_daemons", 2024-09-17T05:23:01.052 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.052 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.052 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.052 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:01.052 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.052 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.052 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.052 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-17T05:23:01.052 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.052 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.052 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.053 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.053 INFO:teuthology.orchestra.run.smithi098.stdout: "warn_on_stray_hosts": { 2024-09-17T05:23:01.053 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "warn_on_stray_hosts", 2024-09-17T05:23:01.053 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.053 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.053 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.053 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:01.053 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.053 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.053 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.053 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-17T05:23:01.054 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.054 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.054 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.054 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.054 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.054 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.054 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:01.054 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "crash", 2024-09-17T05:23:01.054 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:01.054 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:01.054 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:01.054 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:01.055 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:01.055 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.055 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.055 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.055 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.055 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.055 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.055 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.055 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.055 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.055 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.056 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.056 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.056 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.056 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.056 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.056 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.056 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.056 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.056 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.056 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:01.056 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:01.057 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.057 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.057 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.057 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.057 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.057 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.057 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.057 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.057 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.057 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.057 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.057 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.058 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:01.058 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:01.058 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.058 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.058 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.058 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:01.058 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.058 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.058 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.058 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.058 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.059 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.059 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.059 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.059 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.059 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.059 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.059 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.059 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.059 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.059 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.059 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:01.059 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:01.060 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.060 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.060 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.060 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.060 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.060 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.060 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.060 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.060 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.060 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.060 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.061 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.061 INFO:teuthology.orchestra.run.smithi098.stdout: "retain_interval": { 2024-09-17T05:23:01.061 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "retain_interval", 2024-09-17T05:23:01.061 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-17T05:23:01.061 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.061 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.061 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "31536000", 2024-09-17T05:23:01.061 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.061 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.061 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.061 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-17T05:23:01.062 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.062 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.062 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.062 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.062 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:01.062 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:01.062 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.062 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:01.062 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.062 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:01.062 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.063 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.063 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.063 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.063 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.063 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.063 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.063 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.063 INFO:teuthology.orchestra.run.smithi098.stdout: "warn_recent_interval": { 2024-09-17T05:23:01.063 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "warn_recent_interval", 2024-09-17T05:23:01.063 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-17T05:23:01.063 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.064 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.064 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "1209600", 2024-09-17T05:23:01.064 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.064 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.064 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.064 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-17T05:23:01.064 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.064 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.064 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.064 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.065 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.065 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.065 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:01.065 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "dashboard", 2024-09-17T05:23:01.065 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:01.065 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:01.065 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:01.065 INFO:teuthology.orchestra.run.smithi098.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-17T05:23:01.065 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-17T05:23:01.065 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.065 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.066 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.066 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "10", 2024-09-17T05:23:01.066 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.066 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.066 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.066 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.066 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.066 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.066 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.066 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.066 INFO:teuthology.orchestra.run.smithi098.stdout: "ALERTMANAGER_API_HOST": { 2024-09-17T05:23:01.067 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-17T05:23:01.067 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.067 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.067 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.067 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.067 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.067 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.067 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.067 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.067 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.067 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.068 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.068 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.068 INFO:teuthology.orchestra.run.smithi098.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-17T05:23:01.068 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-17T05:23:01.068 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.068 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.068 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.068 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:01.068 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.068 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.068 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.069 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.069 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.069 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.069 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.069 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.069 INFO:teuthology.orchestra.run.smithi098.stdout: "AUDIT_API_ENABLED": { 2024-09-17T05:23:01.069 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "AUDIT_API_ENABLED", 2024-09-17T05:23:01.069 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.069 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.069 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.069 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.069 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.070 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.070 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.070 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.070 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.070 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.070 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.070 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.070 INFO:teuthology.orchestra.run.smithi098.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-17T05:23:01.070 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-17T05:23:01.070 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.070 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.070 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.071 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:01.071 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.071 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.071 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.071 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.071 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.071 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.071 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.071 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.071 INFO:teuthology.orchestra.run.smithi098.stdout: "ENABLE_BROWSABLE_API": { 2024-09-17T05:23:01.071 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-17T05:23:01.072 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.072 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.072 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.072 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:01.072 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.072 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.072 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.072 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.072 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.072 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.072 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.072 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.073 INFO:teuthology.orchestra.run.smithi098.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-17T05:23:01.073 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-17T05:23:01.073 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.073 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.073 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.073 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:01.073 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.073 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.073 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.073 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.073 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.074 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.074 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.074 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.074 INFO:teuthology.orchestra.run.smithi098.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-17T05:23:01.074 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-17T05:23:01.074 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.074 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.074 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.074 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:01.074 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.074 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.075 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.075 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.075 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.075 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.075 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.075 INFO:teuthology.orchestra.run.smithi098.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-17T05:23:01.075 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-17T05:23:01.075 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.075 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.075 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.076 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:01.076 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.076 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.076 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.076 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.076 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.076 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.076 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.076 INFO:teuthology.orchestra.run.smithi098.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-17T05:23:01.076 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-17T05:23:01.077 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.077 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.077 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.077 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:01.077 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.077 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.077 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.077 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.077 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.077 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.077 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.078 INFO:teuthology.orchestra.run.smithi098.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-17T05:23:01.078 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-17T05:23:01.078 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.078 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.078 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.078 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:01.078 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.078 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.078 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.078 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.078 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.079 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.079 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.079 INFO:teuthology.orchestra.run.smithi098.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-17T05:23:01.079 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-17T05:23:01.079 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.079 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.079 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.079 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:01.079 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.079 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.080 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.080 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.080 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.080 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.080 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.080 INFO:teuthology.orchestra.run.smithi098.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-17T05:23:01.080 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-17T05:23:01.080 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.080 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.080 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.081 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:01.081 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.081 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.081 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.081 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.081 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.081 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.081 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.081 INFO:teuthology.orchestra.run.smithi098.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-17T05:23:01.081 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-17T05:23:01.082 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.082 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.082 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.082 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.082 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.082 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.082 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.082 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.082 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.082 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.082 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.083 INFO:teuthology.orchestra.run.smithi098.stdout: "GRAFANA_API_PASSWORD": { 2024-09-17T05:23:01.083 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-17T05:23:01.083 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.083 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.083 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.083 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "admin", 2024-09-17T05:23:01.083 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.083 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.083 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.083 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.083 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.084 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.084 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.084 INFO:teuthology.orchestra.run.smithi098.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-17T05:23:01.084 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-17T05:23:01.084 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.084 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.084 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.084 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:01.084 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.084 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.085 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.085 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.085 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.085 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.085 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.085 INFO:teuthology.orchestra.run.smithi098.stdout: "GRAFANA_API_URL": { 2024-09-17T05:23:01.085 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "GRAFANA_API_URL", 2024-09-17T05:23:01.085 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.085 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.085 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.086 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.086 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.086 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.086 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.086 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.086 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.086 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.086 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.086 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.086 INFO:teuthology.orchestra.run.smithi098.stdout: "GRAFANA_API_USERNAME": { 2024-09-17T05:23:01.086 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-17T05:23:01.086 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.087 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.087 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.087 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "admin", 2024-09-17T05:23:01.087 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.087 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.087 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.087 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.087 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.087 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.087 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.087 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.088 INFO:teuthology.orchestra.run.smithi098.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-17T05:23:01.088 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-17T05:23:01.088 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.088 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.088 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.088 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.088 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.088 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.088 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.088 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.088 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.089 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.089 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.089 INFO:teuthology.orchestra.run.smithi098.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-17T05:23:01.089 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-17T05:23:01.089 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.089 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.089 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.089 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.089 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.089 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.089 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.090 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.090 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.090 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.090 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.090 INFO:teuthology.orchestra.run.smithi098.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-17T05:23:01.090 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-17T05:23:01.090 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.090 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.090 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.090 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:01.091 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.091 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.091 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.091 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.091 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.091 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.091 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.091 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.091 INFO:teuthology.orchestra.run.smithi098.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-17T05:23:01.091 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-17T05:23:01.091 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.091 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.092 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.092 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.092 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.092 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.092 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.092 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.092 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.092 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.092 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.092 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.092 INFO:teuthology.orchestra.run.smithi098.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-17T05:23:01.093 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-17T05:23:01.093 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.093 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.093 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.093 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "[]", 2024-09-17T05:23:01.093 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.093 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.093 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.093 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.093 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.093 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.094 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.094 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.094 INFO:teuthology.orchestra.run.smithi098.stdout: "MULTICLUSTER_CONFIG": { 2024-09-17T05:23:01.094 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-17T05:23:01.094 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.094 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.094 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.094 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "{}", 2024-09-17T05:23:01.094 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.094 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.094 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.095 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.095 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.095 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.095 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.095 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.095 INFO:teuthology.orchestra.run.smithi098.stdout: "PROMETHEUS_API_HOST": { 2024-09-17T05:23:01.095 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-17T05:23:01.095 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.095 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.095 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.095 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.095 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.096 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.096 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.096 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.096 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.096 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.096 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.096 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.096 INFO:teuthology.orchestra.run.smithi098.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-17T05:23:01.096 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-17T05:23:01.096 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.096 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.097 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.097 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:01.097 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.097 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.097 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.097 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.097 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.097 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.097 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.097 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.097 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-17T05:23:01.098 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-17T05:23:01.098 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.098 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.098 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.098 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.098 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.098 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.098 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.098 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.098 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.098 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.098 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.099 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.099 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-17T05:23:01.099 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-17T05:23:01.099 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.099 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.099 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.099 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.099 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.099 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.099 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.099 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.100 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.100 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.100 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.100 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.100 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-17T05:23:01.100 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-17T05:23:01.100 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.100 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.100 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.100 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:01.100 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.101 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.101 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.101 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.101 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.101 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.101 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.101 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-17T05:23:01.101 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-17T05:23:01.101 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.101 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.102 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.102 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:01.102 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.102 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.102 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.102 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.102 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.102 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.102 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.102 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-17T05:23:01.102 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-17T05:23:01.103 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.103 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.103 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.103 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.103 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.103 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.103 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.103 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.103 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.103 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.103 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.104 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.104 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-17T05:23:01.104 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-17T05:23:01.104 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.104 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.104 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.104 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.104 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.104 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.105 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.105 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.105 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.105 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.105 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.105 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.105 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-17T05:23:01.105 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-17T05:23:01.105 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.105 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.105 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.106 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.106 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.106 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.106 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.106 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.106 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.106 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.106 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.106 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.106 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_ENABLED": { 2024-09-17T05:23:01.106 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-17T05:23:01.107 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.107 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.107 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.107 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:01.107 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.107 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.107 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.107 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.107 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.107 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.107 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.107 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.108 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-17T05:23:01.108 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-17T05:23:01.108 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.108 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.108 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.108 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-17T05:23:01.108 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.108 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.108 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.108 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.109 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.109 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.109 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.109 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.109 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-17T05:23:01.109 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-17T05:23:01.109 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.109 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.109 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.109 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "10", 2024-09-17T05:23:01.109 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.110 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.110 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.110 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.110 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.110 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.110 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.110 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.110 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-17T05:23:01.110 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-17T05:23:01.110 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.110 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.110 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.111 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "8", 2024-09-17T05:23:01.111 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.111 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.111 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.111 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.111 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.111 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.111 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.111 INFO:teuthology.orchestra.run.smithi098.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-17T05:23:01.111 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-17T05:23:01.112 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.112 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.112 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.112 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "45", 2024-09-17T05:23:01.112 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.112 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.112 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.112 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.112 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.112 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.113 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.113 INFO:teuthology.orchestra.run.smithi098.stdout: "RGW_API_ACCESS_KEY": { 2024-09-17T05:23:01.113 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-17T05:23:01.113 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.113 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.113 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.113 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.113 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.114 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.114 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.114 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.114 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.114 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.114 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.114 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.114 INFO:teuthology.orchestra.run.smithi098.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-17T05:23:01.114 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-17T05:23:01.114 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.115 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.115 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.115 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "admin", 2024-09-17T05:23:01.115 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.115 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.115 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.115 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.115 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.115 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.115 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.116 INFO:teuthology.orchestra.run.smithi098.stdout: "RGW_API_SECRET_KEY": { 2024-09-17T05:23:01.116 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-17T05:23:01.116 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.116 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.116 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.116 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.116 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.116 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.116 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.116 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.116 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.116 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.117 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.117 INFO:teuthology.orchestra.run.smithi098.stdout: "RGW_API_SSL_VERIFY": { 2024-09-17T05:23:01.117 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-17T05:23:01.117 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.117 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.117 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.117 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:01.117 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.117 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.118 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.118 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.118 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.118 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.118 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.118 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.118 INFO:teuthology.orchestra.run.smithi098.stdout: "UNSAFE_TLS_v1_2": { 2024-09-17T05:23:01.118 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-17T05:23:01.118 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.118 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.119 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.119 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.119 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.119 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.119 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.119 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.119 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.119 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.119 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.119 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.119 INFO:teuthology.orchestra.run.smithi098.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-17T05:23:01.120 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-17T05:23:01.120 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.120 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.120 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.120 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:01.120 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.120 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.120 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.120 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.120 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.121 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.121 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.121 INFO:teuthology.orchestra.run.smithi098.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-17T05:23:01.121 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-17T05:23:01.121 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.121 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.121 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.121 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "10", 2024-09-17T05:23:01.121 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.122 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.122 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.122 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.122 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.122 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.122 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.122 INFO:teuthology.orchestra.run.smithi098.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-17T05:23:01.122 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-17T05:23:01.122 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.122 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.123 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.123 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "5", 2024-09-17T05:23:01.123 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.123 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.123 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.123 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.123 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.123 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.123 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.123 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.123 INFO:teuthology.orchestra.run.smithi098.stdout: "cross_origin_url": { 2024-09-17T05:23:01.124 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "cross_origin_url", 2024-09-17T05:23:01.124 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.124 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.124 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.124 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.124 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.124 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.124 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.124 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.124 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.124 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.125 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.125 INFO:teuthology.orchestra.run.smithi098.stdout: "crt_file": { 2024-09-17T05:23:01.125 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "crt_file", 2024-09-17T05:23:01.125 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.125 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.125 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.125 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.125 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.125 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.126 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.126 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.126 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.126 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.126 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.126 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.126 INFO:teuthology.orchestra.run.smithi098.stdout: "debug": { 2024-09-17T05:23:01.126 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "debug", 2024-09-17T05:23:01.126 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.126 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.126 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.126 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.127 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.127 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.127 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.127 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Enable/disable debug options", 2024-09-17T05:23:01.127 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.127 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.127 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.127 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.127 INFO:teuthology.orchestra.run.smithi098.stdout: "jwt_token_ttl": { 2024-09-17T05:23:01.127 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "jwt_token_ttl", 2024-09-17T05:23:01.128 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.128 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.128 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.128 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "28800", 2024-09-17T05:23:01.128 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.128 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.128 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.128 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.128 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.128 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.128 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.129 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.129 INFO:teuthology.orchestra.run.smithi098.stdout: "key_file": { 2024-09-17T05:23:01.129 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "key_file", 2024-09-17T05:23:01.129 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.129 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.129 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.129 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.129 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.129 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.129 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.130 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.130 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.130 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.130 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.130 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:01.130 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:01.130 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.130 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.130 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.130 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.131 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.131 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.131 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.131 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.131 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.131 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.131 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.131 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.131 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.131 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.132 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.132 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.132 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.132 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.132 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.132 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:01.132 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:01.132 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.132 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.132 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.133 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.133 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.133 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.133 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.133 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.133 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.133 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.133 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.133 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:01.134 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:01.134 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.134 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.134 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.134 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:01.134 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.134 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.134 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.134 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.134 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.135 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.135 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.135 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.135 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.135 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.135 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.135 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.135 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.135 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.135 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:01.136 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:01.136 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.136 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.136 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.136 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.136 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.136 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.136 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.136 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.136 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.136 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.137 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.137 INFO:teuthology.orchestra.run.smithi098.stdout: "motd": { 2024-09-17T05:23:01.137 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "motd", 2024-09-17T05:23:01.137 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.137 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.137 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.137 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.137 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.137 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.137 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.138 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "The message of the day", 2024-09-17T05:23:01.138 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.138 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.138 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.138 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.138 INFO:teuthology.orchestra.run.smithi098.stdout: "redirect_resolve_ip_addr": { 2024-09-17T05:23:01.138 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "redirect_resolve_ip_addr", 2024-09-17T05:23:01.138 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.138 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.138 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.138 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.139 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.139 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.139 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.139 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.139 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.139 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.139 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.139 INFO:teuthology.orchestra.run.smithi098.stdout: "server_addr": { 2024-09-17T05:23:01.139 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "server_addr", 2024-09-17T05:23:01.139 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.139 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.140 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.140 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "::", 2024-09-17T05:23:01.140 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.140 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.140 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.140 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.140 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.140 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.140 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.140 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.141 INFO:teuthology.orchestra.run.smithi098.stdout: "server_port": { 2024-09-17T05:23:01.141 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "server_port", 2024-09-17T05:23:01.141 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.141 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.141 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.141 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "8080", 2024-09-17T05:23:01.141 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.141 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.141 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.141 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.141 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.141 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.142 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.142 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:01.142 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:01.142 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.142 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:01.142 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.142 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:01.142 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.142 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.142 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.143 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.143 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.143 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.143 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.143 INFO:teuthology.orchestra.run.smithi098.stdout: "ssl": { 2024-09-17T05:23:01.143 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ssl", 2024-09-17T05:23:01.143 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.143 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.143 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.143 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:01.144 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.144 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.144 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.144 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.144 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.144 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.144 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.144 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.144 INFO:teuthology.orchestra.run.smithi098.stdout: "ssl_server_port": { 2024-09-17T05:23:01.144 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ssl_server_port", 2024-09-17T05:23:01.144 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.145 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.145 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.145 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "8443", 2024-09-17T05:23:01.145 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.145 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.145 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.145 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.145 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.145 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.145 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.145 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.146 INFO:teuthology.orchestra.run.smithi098.stdout: "sso_oauth2": { 2024-09-17T05:23:01.146 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sso_oauth2", 2024-09-17T05:23:01.146 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.146 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.146 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.146 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.146 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.146 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.146 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.146 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.146 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.147 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.147 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.147 INFO:teuthology.orchestra.run.smithi098.stdout: "standby_behaviour": { 2024-09-17T05:23:01.147 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "standby_behaviour", 2024-09-17T05:23:01.147 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.147 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.147 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.147 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "redirect", 2024-09-17T05:23:01.147 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.147 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.148 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.148 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.148 INFO:teuthology.orchestra.run.smithi098.stdout: "redirect" 2024-09-17T05:23:01.148 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.148 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.148 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.148 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.148 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.148 INFO:teuthology.orchestra.run.smithi098.stdout: "standby_error_status_code": { 2024-09-17T05:23:01.148 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "standby_error_status_code", 2024-09-17T05:23:01.149 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.149 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.149 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.149 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "500", 2024-09-17T05:23:01.149 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "400", 2024-09-17T05:23:01.149 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "599", 2024-09-17T05:23:01.149 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.149 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.149 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.149 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.149 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.150 INFO:teuthology.orchestra.run.smithi098.stdout: "url_prefix": { 2024-09-17T05:23:01.150 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "url_prefix", 2024-09-17T05:23:01.150 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.150 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.150 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.150 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.150 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.150 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.150 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.151 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.151 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.151 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.151 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.151 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.151 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.151 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:01.151 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "devicehealth", 2024-09-17T05:23:01.151 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:01.152 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:01.152 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:01.152 INFO:teuthology.orchestra.run.smithi098.stdout: "enable_monitoring": { 2024-09-17T05:23:01.152 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "enable_monitoring", 2024-09-17T05:23:01.152 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.152 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.152 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.152 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:01.152 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.152 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.152 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.152 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "monitor device health metrics", 2024-09-17T05:23:01.153 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.153 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.153 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.153 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:01.153 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:01.153 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.153 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.153 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.153 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.153 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.154 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.154 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.154 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.154 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.154 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.154 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.154 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.154 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.154 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.154 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.154 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.155 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.155 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.155 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.155 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:01.155 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:01.155 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.155 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.155 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.155 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.155 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.155 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.156 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.156 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.156 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.156 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.156 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.156 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.156 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:01.156 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:01.156 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.156 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.156 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.157 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:01.157 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.157 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.157 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.157 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.157 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.157 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.157 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.157 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.157 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.157 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.158 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.158 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.158 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.158 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.158 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:01.158 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:01.158 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.158 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.158 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.159 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.159 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.159 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.159 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.159 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.159 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.159 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.159 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.159 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.159 INFO:teuthology.orchestra.run.smithi098.stdout: "mark_out_threshold": { 2024-09-17T05:23:01.160 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "mark_out_threshold", 2024-09-17T05:23:01.160 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-17T05:23:01.160 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.160 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.160 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "2419200", 2024-09-17T05:23:01.160 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.160 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.160 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.160 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-17T05:23:01.160 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.161 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.161 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.161 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.161 INFO:teuthology.orchestra.run.smithi098.stdout: "pool_name": { 2024-09-17T05:23:01.161 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "pool_name", 2024-09-17T05:23:01.161 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.161 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.161 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.161 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "device_health_metrics", 2024-09-17T05:23:01.161 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.161 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.162 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.162 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-17T05:23:01.162 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.162 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.162 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.162 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.162 INFO:teuthology.orchestra.run.smithi098.stdout: "retention_period": { 2024-09-17T05:23:01.162 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "retention_period", 2024-09-17T05:23:01.162 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-17T05:23:01.162 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.162 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.162 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "15552000", 2024-09-17T05:23:01.163 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.163 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.163 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.163 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "how long to retain device health metrics", 2024-09-17T05:23:01.163 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.163 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.163 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.163 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.163 INFO:teuthology.orchestra.run.smithi098.stdout: "scrape_frequency": { 2024-09-17T05:23:01.163 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "scrape_frequency", 2024-09-17T05:23:01.164 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-17T05:23:01.164 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.164 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.164 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "86400", 2024-09-17T05:23:01.164 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.164 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.164 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.164 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-17T05:23:01.164 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.164 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.164 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.165 INFO:teuthology.orchestra.run.smithi098.stdout: "self_heal": { 2024-09-17T05:23:01.165 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "self_heal", 2024-09-17T05:23:01.165 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.165 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.165 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.165 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:01.165 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.165 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.165 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.165 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-17T05:23:01.166 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.166 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.166 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.166 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.166 INFO:teuthology.orchestra.run.smithi098.stdout: "sleep_interval": { 2024-09-17T05:23:01.166 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sleep_interval", 2024-09-17T05:23:01.166 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-17T05:23:01.166 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.166 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.166 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "600", 2024-09-17T05:23:01.167 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.167 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.167 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.167 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "how frequently to wake up and check device health", 2024-09-17T05:23:01.167 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.167 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.167 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.167 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.167 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:01.167 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:01.167 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.168 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:01.168 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.168 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:01.168 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.168 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.168 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.168 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.168 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.168 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.168 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.169 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.169 INFO:teuthology.orchestra.run.smithi098.stdout: "warn_threshold": { 2024-09-17T05:23:01.169 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "warn_threshold", 2024-09-17T05:23:01.169 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-17T05:23:01.169 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.169 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.169 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "7257600", 2024-09-17T05:23:01.169 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.169 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.169 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.169 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-17T05:23:01.170 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.170 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.170 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.170 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.170 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.170 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:01.170 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "diskprediction_local", 2024-09-17T05:23:01.170 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:01.170 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:01.170 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:01.171 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:01.171 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:01.171 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.171 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.171 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.171 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.171 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.171 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.171 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.171 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.171 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.172 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.172 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.172 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.172 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.172 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.172 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.172 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.172 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.172 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.172 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.172 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:01.173 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:01.173 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.173 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.173 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.173 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.173 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.173 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.173 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.173 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.173 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.173 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.174 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.174 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.174 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:01.174 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:01.174 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.174 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.174 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.174 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:01.174 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.174 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.174 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.174 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.175 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.175 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.175 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.175 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.175 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.175 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.175 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.175 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.175 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.175 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.175 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.176 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:01.176 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:01.176 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.176 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.176 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.176 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.176 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.176 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.176 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.176 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.176 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.177 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.177 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.177 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.177 INFO:teuthology.orchestra.run.smithi098.stdout: "predict_interval": { 2024-09-17T05:23:01.177 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "predict_interval", 2024-09-17T05:23:01.177 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.177 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.177 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.177 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "86400", 2024-09-17T05:23:01.177 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.177 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.178 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.178 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.178 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.178 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.178 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.178 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.178 INFO:teuthology.orchestra.run.smithi098.stdout: "predictor_model": { 2024-09-17T05:23:01.178 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "predictor_model", 2024-09-17T05:23:01.178 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.178 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.178 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.178 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "prophetstor", 2024-09-17T05:23:01.179 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.179 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.179 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.179 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.179 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.179 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.179 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.179 INFO:teuthology.orchestra.run.smithi098.stdout: "sleep_interval": { 2024-09-17T05:23:01.179 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sleep_interval", 2024-09-17T05:23:01.179 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.180 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.180 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.180 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "600", 2024-09-17T05:23:01.180 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.180 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.180 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.180 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.180 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.180 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.180 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.180 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.181 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:01.181 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:01.181 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.181 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:01.181 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.181 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:01.181 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.181 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.181 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.181 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.181 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.182 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.182 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.182 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.182 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.182 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.182 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:01.182 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "influx", 2024-09-17T05:23:01.182 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": false, 2024-09-17T05:23:01.182 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "influxdb python module not found", 2024-09-17T05:23:01.182 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:01.182 INFO:teuthology.orchestra.run.smithi098.stdout: "batch_size": { 2024-09-17T05:23:01.182 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "batch_size", 2024-09-17T05:23:01.183 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.183 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.183 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.183 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "5000", 2024-09-17T05:23:01.183 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.183 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.183 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.183 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-17T05:23:01.183 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.183 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.183 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.184 INFO:teuthology.orchestra.run.smithi098.stdout: "database": { 2024-09-17T05:23:01.184 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "database", 2024-09-17T05:23:01.184 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.184 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.184 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.184 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "ceph", 2024-09-17T05:23:01.184 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.184 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.184 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.184 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-17T05:23:01.184 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.185 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.185 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.185 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.185 INFO:teuthology.orchestra.run.smithi098.stdout: "hostname": { 2024-09-17T05:23:01.185 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "hostname", 2024-09-17T05:23:01.185 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.185 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.185 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.185 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.185 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.185 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.186 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.186 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "InfluxDB server hostname", 2024-09-17T05:23:01.186 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.186 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.186 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.186 INFO:teuthology.orchestra.run.smithi098.stdout: "interval": { 2024-09-17T05:23:01.186 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "interval", 2024-09-17T05:23:01.186 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-17T05:23:01.186 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.186 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.186 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "30", 2024-09-17T05:23:01.187 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "5", 2024-09-17T05:23:01.187 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.187 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.187 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-17T05:23:01.187 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.187 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.187 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.187 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:01.187 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:01.187 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.187 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.188 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.188 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.188 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.188 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.188 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.188 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.188 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.188 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.188 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.188 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.188 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.189 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.189 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.189 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.189 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.189 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.189 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:01.189 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:01.189 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.189 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.189 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.189 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.190 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.190 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.190 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.190 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.190 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.190 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.190 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.190 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:01.190 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:01.190 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.191 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.191 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.191 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:01.191 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.191 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.191 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.191 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.191 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.191 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.191 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.191 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.192 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.192 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.192 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.192 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.192 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.192 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.192 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:01.192 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:01.192 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.192 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.193 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.193 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.193 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.193 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.193 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.193 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.193 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.193 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.193 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.193 INFO:teuthology.orchestra.run.smithi098.stdout: "password": { 2024-09-17T05:23:01.193 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "password", 2024-09-17T05:23:01.194 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.194 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.194 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.194 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.194 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.194 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.194 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.194 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "password of InfluxDB server user", 2024-09-17T05:23:01.194 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.194 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.194 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.195 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.195 INFO:teuthology.orchestra.run.smithi098.stdout: "port": { 2024-09-17T05:23:01.195 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "port", 2024-09-17T05:23:01.195 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.195 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.195 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.195 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "8086", 2024-09-17T05:23:01.195 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.195 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.195 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.195 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "InfluxDB server port", 2024-09-17T05:23:01.195 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.196 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.196 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.196 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:01.196 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:01.196 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.196 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:01.196 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.196 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:01.196 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.196 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.197 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.197 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.197 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.197 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.197 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.197 INFO:teuthology.orchestra.run.smithi098.stdout: "ssl": { 2024-09-17T05:23:01.197 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ssl", 2024-09-17T05:23:01.197 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.197 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.197 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.197 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "false", 2024-09-17T05:23:01.198 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.198 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.198 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.198 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-17T05:23:01.198 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.198 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.198 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.198 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.198 INFO:teuthology.orchestra.run.smithi098.stdout: "threads": { 2024-09-17T05:23:01.198 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "threads", 2024-09-17T05:23:01.198 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.198 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.199 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.199 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "5", 2024-09-17T05:23:01.199 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "1", 2024-09-17T05:23:01.199 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "32", 2024-09-17T05:23:01.199 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.199 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-17T05:23:01.199 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.199 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.199 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.199 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.199 INFO:teuthology.orchestra.run.smithi098.stdout: "username": { 2024-09-17T05:23:01.200 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "username", 2024-09-17T05:23:01.200 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.200 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.200 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.200 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.200 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.200 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.200 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.200 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "username of InfluxDB server user", 2024-09-17T05:23:01.200 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.200 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.201 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.201 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.201 INFO:teuthology.orchestra.run.smithi098.stdout: "verify_ssl": { 2024-09-17T05:23:01.201 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "verify_ssl", 2024-09-17T05:23:01.201 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.201 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.201 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.201 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "true", 2024-09-17T05:23:01.201 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.201 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.201 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.202 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-17T05:23:01.202 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.202 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.202 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.202 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.202 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.202 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:01.202 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "insights", 2024-09-17T05:23:01.202 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:01.202 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:01.202 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:01.203 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:01.203 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:01.203 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.203 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.203 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.203 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.203 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.203 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.203 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.203 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.203 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.204 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.204 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.204 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.204 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.204 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.204 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.204 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.204 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.204 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.204 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.204 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:01.205 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:01.205 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.205 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.205 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.205 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.205 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.205 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.205 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.205 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.205 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.205 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.205 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.206 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.206 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:01.206 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:01.206 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.206 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.206 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.206 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:01.206 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.206 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.206 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.206 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.207 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.207 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.207 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.207 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.207 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.207 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.207 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.207 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.207 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.207 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.208 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:01.208 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:01.208 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.208 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.208 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.208 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.208 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.208 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.208 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.208 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.208 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.208 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.209 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.209 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.209 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:01.209 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:01.209 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.209 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:01.209 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.210 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:01.210 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.210 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.210 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.210 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.210 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.210 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.210 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.210 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.210 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.210 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.210 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:01.211 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "iostat", 2024-09-17T05:23:01.211 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:01.211 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:01.211 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:01.211 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:01.211 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:01.211 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.211 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.211 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.211 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.211 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.212 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.212 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.212 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.212 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.212 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.212 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.212 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.212 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.212 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.212 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.213 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.213 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.213 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.213 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.213 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:01.213 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:01.213 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.213 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.213 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.213 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.213 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.214 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.214 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.214 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.214 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.214 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.214 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.214 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.214 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:01.214 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:01.214 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.214 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.215 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.215 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:01.215 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.215 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.215 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.215 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.215 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.215 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.215 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.215 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.215 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.216 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.216 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.216 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.216 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.216 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.216 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.216 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:01.216 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:01.216 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.216 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.216 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.217 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.217 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.217 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.217 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.217 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.217 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.217 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.217 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.217 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.217 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:01.217 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:01.218 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.218 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:01.218 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.218 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:01.218 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.218 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.218 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.218 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.218 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.218 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.218 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.219 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.219 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.219 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.219 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:01.219 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "localpool", 2024-09-17T05:23:01.219 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:01.219 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:01.219 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:01.219 INFO:teuthology.orchestra.run.smithi098.stdout: "failure_domain": { 2024-09-17T05:23:01.219 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "failure_domain", 2024-09-17T05:23:01.219 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.219 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.220 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.220 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "host", 2024-09-17T05:23:01.220 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.220 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.220 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.220 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "failure domain for any created local pool", 2024-09-17T05:23:01.220 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-17T05:23:01.220 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.220 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.220 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.220 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:01.221 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:01.221 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.221 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.221 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.221 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.221 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.221 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.221 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.221 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.221 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.221 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.222 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.222 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.222 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.222 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.222 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.222 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.222 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.222 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.222 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.222 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:01.222 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:01.223 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.223 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.223 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.223 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.223 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.223 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.223 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.223 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.223 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.223 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.223 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.224 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.224 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:01.224 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:01.224 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.224 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.224 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.224 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:01.224 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.224 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.224 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.224 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.224 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.225 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.225 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.225 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.225 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.225 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.225 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.225 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.225 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.225 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.225 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.225 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:01.226 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:01.226 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.226 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.226 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.226 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.226 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.226 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.226 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.226 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.226 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.226 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.226 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.227 INFO:teuthology.orchestra.run.smithi098.stdout: "min_size": { 2024-09-17T05:23:01.227 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "min_size", 2024-09-17T05:23:01.227 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.227 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.227 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.227 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.227 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.227 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.227 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.227 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "default min_size for any created local pool", 2024-09-17T05:23:01.228 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-17T05:23:01.228 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.228 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.228 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.228 INFO:teuthology.orchestra.run.smithi098.stdout: "num_rep": { 2024-09-17T05:23:01.228 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "num_rep", 2024-09-17T05:23:01.228 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.228 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.228 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.228 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "3", 2024-09-17T05:23:01.228 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.228 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.229 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.229 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "default replica count for any created local pool", 2024-09-17T05:23:01.229 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.229 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.229 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.229 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.229 INFO:teuthology.orchestra.run.smithi098.stdout: "pg_num": { 2024-09-17T05:23:01.229 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "pg_num", 2024-09-17T05:23:01.229 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.229 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.229 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.230 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "128", 2024-09-17T05:23:01.230 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.230 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.230 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.230 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "default pg_num for any created local pool", 2024-09-17T05:23:01.230 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.230 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.230 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.230 INFO:teuthology.orchestra.run.smithi098.stdout: "prefix": { 2024-09-17T05:23:01.230 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "prefix", 2024-09-17T05:23:01.231 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.231 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.231 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.231 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.231 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.231 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.231 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.231 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "name prefix for any created local pool", 2024-09-17T05:23:01.231 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.231 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.231 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.231 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.232 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:01.232 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:01.232 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.232 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:01.232 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.232 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:01.232 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.232 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.232 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.232 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.232 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.233 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.233 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.233 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.233 INFO:teuthology.orchestra.run.smithi098.stdout: "subtree": { 2024-09-17T05:23:01.233 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "subtree", 2024-09-17T05:23:01.233 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.233 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.233 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.233 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "rack", 2024-09-17T05:23:01.233 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.233 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.234 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.234 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-17T05:23:01.234 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-17T05:23:01.234 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.234 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.234 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.234 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.234 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.234 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:01.234 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "mds_autoscaler", 2024-09-17T05:23:01.234 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:01.235 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:01.235 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:01.235 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:01.235 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:01.235 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.235 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.235 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.235 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.235 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.235 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.235 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.235 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.236 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.236 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.236 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.236 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.236 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.236 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.236 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.236 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.236 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.236 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.236 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.236 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:01.237 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:01.237 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.237 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.237 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.237 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.237 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.237 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.237 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.237 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.237 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.237 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.238 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.238 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.238 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:01.238 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:01.238 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.238 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.238 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.238 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:01.238 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.238 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.238 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.238 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.239 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.239 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.239 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.239 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.239 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.239 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.239 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.239 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.239 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.239 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.239 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.240 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:01.240 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:01.240 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.240 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.240 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.240 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.240 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.240 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.240 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.240 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.240 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.241 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.241 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.241 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.241 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:01.241 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:01.241 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.241 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:01.241 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.241 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:01.241 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.241 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.242 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.242 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.242 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.242 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.242 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.242 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.242 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.242 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.242 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:01.242 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "mirroring", 2024-09-17T05:23:01.243 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:01.243 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:01.243 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:01.243 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:01.243 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:01.243 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.243 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.243 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.243 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.243 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.243 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.243 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.244 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.244 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.244 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.244 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.244 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.244 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.244 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.244 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.244 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.244 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.245 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.245 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.245 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:01.245 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:01.245 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.245 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.245 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.245 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.245 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.245 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.245 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.245 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.246 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.246 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.246 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.246 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.246 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:01.246 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:01.246 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.246 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.246 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.246 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:01.246 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.246 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.247 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.247 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.247 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.247 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.247 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.247 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.247 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.247 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.247 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.247 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.247 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.248 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.248 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.248 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:01.248 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:01.248 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.248 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.248 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.248 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.248 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.248 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.248 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.249 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.249 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.249 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.249 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.249 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.249 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:01.249 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:01.249 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.249 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:01.249 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.249 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:01.249 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.250 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.250 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.250 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.250 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.250 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.250 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.250 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.250 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.250 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.250 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:01.250 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "nfs", 2024-09-17T05:23:01.251 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:01.251 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:01.251 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:01.251 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:01.251 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:01.251 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.251 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.251 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.251 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.251 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.251 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.251 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.252 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.252 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.252 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.252 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.252 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.252 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.252 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.252 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.252 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.252 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.253 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.253 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.253 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:01.253 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:01.253 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.253 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.253 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.253 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.253 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.253 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.253 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.254 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.254 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.254 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.254 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.254 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.254 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:01.254 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:01.254 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.254 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.254 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.254 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:01.255 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.255 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.255 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.255 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.255 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.255 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.255 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.255 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.255 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.255 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.255 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.256 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.256 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.256 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.256 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.256 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:01.256 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:01.256 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.256 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.256 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.256 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.256 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.256 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.257 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.257 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.257 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.257 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.257 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.257 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.257 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:01.257 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:01.257 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.257 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:01.257 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.258 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:01.258 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.258 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.258 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.258 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.258 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.258 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.258 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.258 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.258 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.258 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.259 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:01.259 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "orchestrator", 2024-09-17T05:23:01.259 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:01.259 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:01.259 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:01.259 INFO:teuthology.orchestra.run.smithi098.stdout: "fail_fs": { 2024-09-17T05:23:01.259 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "fail_fs", 2024-09-17T05:23:01.259 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.259 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.259 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.259 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.260 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.260 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.260 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.260 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-17T05:23:01.260 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.260 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.260 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.260 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.260 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:01.260 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:01.261 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.261 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.261 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.261 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.261 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.261 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.261 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.261 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.261 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.261 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.261 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.261 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.262 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.262 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.262 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.262 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.262 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.262 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.262 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.262 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:01.262 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:01.262 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.262 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.263 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.263 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.263 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.263 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.263 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.263 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.263 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.263 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.263 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.263 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.263 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:01.264 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:01.264 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.264 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.264 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.264 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:01.264 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.264 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.264 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.264 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.264 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.264 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.265 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.265 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.265 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.265 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.265 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.265 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.265 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.265 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.265 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.265 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:01.265 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:01.265 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.266 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.266 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.266 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.266 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.266 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.266 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.266 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.266 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.266 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.266 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.266 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.267 INFO:teuthology.orchestra.run.smithi098.stdout: "orchestrator": { 2024-09-17T05:23:01.267 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "orchestrator", 2024-09-17T05:23:01.267 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.267 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.267 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.267 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.267 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.267 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.267 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.267 INFO:teuthology.orchestra.run.smithi098.stdout: "cephadm", 2024-09-17T05:23:01.267 INFO:teuthology.orchestra.run.smithi098.stdout: "rook", 2024-09-17T05:23:01.267 INFO:teuthology.orchestra.run.smithi098.stdout: "test_orchestrator" 2024-09-17T05:23:01.268 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.268 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Orchestrator backend", 2024-09-17T05:23:01.268 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.268 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.268 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.268 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.268 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:01.268 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:01.268 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.268 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:01.268 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.269 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:01.269 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.269 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.269 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.269 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.269 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.269 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.269 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.269 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.269 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.269 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.269 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:01.270 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "osd_perf_query", 2024-09-17T05:23:01.270 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:01.270 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:01.270 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:01.270 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:01.270 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:01.270 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.270 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.270 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.270 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.270 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.270 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.271 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.271 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.271 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.271 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.271 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.271 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.271 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.271 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.271 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.271 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.271 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.272 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.272 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.272 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:01.272 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:01.272 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.272 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.272 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.272 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.272 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.272 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.272 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.272 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.273 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.273 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.273 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.273 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.273 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:01.273 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:01.273 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.273 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.273 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.273 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:01.273 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.274 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.274 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.274 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.274 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.274 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.274 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.274 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.274 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.274 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.274 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.274 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.275 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.275 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.275 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.275 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:01.275 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:01.275 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.275 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.275 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.275 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.275 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.275 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.275 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.276 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.276 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.276 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.276 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.276 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.276 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:01.276 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:01.276 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.276 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:01.276 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.276 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:01.277 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.277 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.277 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.277 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.277 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.277 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.277 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.277 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.277 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.277 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.277 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:01.277 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "osd_support", 2024-09-17T05:23:01.278 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:01.278 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:01.278 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:01.278 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:01.278 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:01.278 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.278 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.278 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.278 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.278 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.278 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.280 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.280 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.280 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.280 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.280 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.281 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.281 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.281 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.281 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.281 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.281 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.281 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.281 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.282 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:01.282 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:01.282 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.282 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.282 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.282 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.282 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.282 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.282 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.283 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.283 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.283 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.283 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.283 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.283 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:01.284 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:01.284 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.284 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.284 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.284 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:01.284 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.285 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.285 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.285 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.285 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.285 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.285 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.285 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.285 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.285 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.285 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.286 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.286 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.286 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.286 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.286 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:01.286 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:01.286 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.286 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.286 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.286 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.286 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.287 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.287 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.287 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.287 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.287 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.287 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.287 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.287 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:01.287 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:01.287 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.287 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:01.287 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.288 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:01.288 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.288 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.288 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.288 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.288 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.288 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.288 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.288 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.288 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.288 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.289 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:01.289 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "pg_autoscaler", 2024-09-17T05:23:01.289 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:01.289 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:01.289 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:01.289 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:01.289 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:01.289 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.289 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.289 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.289 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.289 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.290 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.290 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.290 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.290 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.290 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.290 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.290 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.290 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.290 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.290 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.290 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.291 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.291 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.291 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.291 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:01.291 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:01.291 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.291 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.291 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.291 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.291 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.291 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.291 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.292 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.292 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.292 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.292 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.292 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.292 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:01.292 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:01.292 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.292 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.292 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.293 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:01.293 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.293 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.293 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.293 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.293 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.293 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.293 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.293 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.293 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.293 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.294 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.294 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.294 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.294 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.294 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.294 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:01.294 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:01.294 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.294 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.294 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.294 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.294 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.295 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.295 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.295 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.295 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.295 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.295 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.295 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.295 INFO:teuthology.orchestra.run.smithi098.stdout: "sleep_interval": { 2024-09-17T05:23:01.295 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sleep_interval", 2024-09-17T05:23:01.295 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-17T05:23:01.295 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.295 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.296 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "60", 2024-09-17T05:23:01.296 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.296 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.296 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.296 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.296 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.296 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.296 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.296 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.296 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:01.296 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:01.297 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.297 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:01.297 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.297 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:01.297 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.297 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.297 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.297 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.297 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.297 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.297 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.298 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.298 INFO:teuthology.orchestra.run.smithi098.stdout: "threshold": { 2024-09-17T05:23:01.298 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "threshold", 2024-09-17T05:23:01.298 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "float", 2024-09-17T05:23:01.298 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.298 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.298 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "3.0", 2024-09-17T05:23:01.298 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "1.0", 2024-09-17T05:23:01.298 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.298 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.298 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "scaling threshold", 2024-09-17T05:23:01.299 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-17T05:23:01.299 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.299 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.299 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.299 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.299 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.299 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:01.299 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "progress", 2024-09-17T05:23:01.299 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:01.299 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:01.299 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:01.300 INFO:teuthology.orchestra.run.smithi098.stdout: "allow_pg_recovery_event": { 2024-09-17T05:23:01.300 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "allow_pg_recovery_event", 2024-09-17T05:23:01.300 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.300 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.300 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.300 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.300 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.300 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.300 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.300 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-17T05:23:01.300 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.301 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.301 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.301 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.301 INFO:teuthology.orchestra.run.smithi098.stdout: "enabled": { 2024-09-17T05:23:01.301 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "enabled", 2024-09-17T05:23:01.301 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.301 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.301 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.301 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:01.301 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.301 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.301 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.302 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.302 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.302 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.302 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.302 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.302 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:01.302 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:01.302 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.302 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.302 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.302 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.303 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.303 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.303 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.303 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.303 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.303 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.303 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.303 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.303 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.303 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.303 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.304 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.304 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.304 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.304 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.304 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:01.304 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:01.304 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.304 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.304 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.304 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.304 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.305 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.305 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.305 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.305 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.305 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.305 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.305 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.305 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:01.305 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:01.305 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.305 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.305 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.306 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:01.306 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.306 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.306 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.306 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.306 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.306 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.306 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.306 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.306 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.307 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.307 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.307 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.307 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.307 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.307 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.307 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:01.307 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:01.307 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.307 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.307 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.307 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.308 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.308 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.308 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.308 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.308 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.308 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.308 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.308 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.308 INFO:teuthology.orchestra.run.smithi098.stdout: "max_completed_events": { 2024-09-17T05:23:01.308 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "max_completed_events", 2024-09-17T05:23:01.308 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.309 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.309 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.309 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "50", 2024-09-17T05:23:01.309 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.309 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.309 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.309 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "number of past completed events to remember", 2024-09-17T05:23:01.309 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.309 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.309 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.309 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.310 INFO:teuthology.orchestra.run.smithi098.stdout: "sleep_interval": { 2024-09-17T05:23:01.310 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sleep_interval", 2024-09-17T05:23:01.310 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-17T05:23:01.310 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.310 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.310 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "5", 2024-09-17T05:23:01.310 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.310 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.310 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.310 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "how long the module is going to sleep", 2024-09-17T05:23:01.310 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.311 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.311 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.311 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.311 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:01.311 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:01.311 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.311 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:01.311 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.311 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:01.311 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.311 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.312 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.312 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.312 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.312 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.312 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.312 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.312 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.312 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.312 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:01.312 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "prometheus", 2024-09-17T05:23:01.312 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:01.312 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:01.313 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:01.313 INFO:teuthology.orchestra.run.smithi098.stdout: "cache": { 2024-09-17T05:23:01.313 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "cache", 2024-09-17T05:23:01.313 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.313 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.313 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.313 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:01.313 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.313 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.313 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.313 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.314 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.314 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.314 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.314 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.314 INFO:teuthology.orchestra.run.smithi098.stdout: "exclude_perf_counters": { 2024-09-17T05:23:01.314 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "exclude_perf_counters", 2024-09-17T05:23:01.314 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.314 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.314 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.314 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:01.314 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.315 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.315 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.315 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-17T05:23:01.315 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-17T05:23:01.315 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.315 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.315 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.315 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:01.315 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:01.315 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.315 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.316 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.316 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.316 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.316 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.316 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.316 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.316 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.316 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.316 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.316 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.316 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.317 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.317 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.317 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.317 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.317 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.317 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.317 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:01.317 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:01.317 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.317 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.317 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.318 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.318 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.318 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.318 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.318 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.318 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.318 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.318 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.318 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.318 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:01.318 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:01.319 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.319 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.319 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.319 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:01.319 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.319 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.319 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.319 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.319 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.319 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.319 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.320 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.320 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.320 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.320 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.320 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.320 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.320 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.320 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.320 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:01.320 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:01.320 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.321 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.321 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.321 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.321 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.321 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.321 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.321 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.321 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.321 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.321 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.321 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.322 INFO:teuthology.orchestra.run.smithi098.stdout: "rbd_stats_pools": { 2024-09-17T05:23:01.322 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rbd_stats_pools", 2024-09-17T05:23:01.322 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.322 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.322 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.322 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.322 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.322 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.322 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.322 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.322 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.323 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.323 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.323 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.323 INFO:teuthology.orchestra.run.smithi098.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-17T05:23:01.323 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-17T05:23:01.323 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.323 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.323 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.323 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "300", 2024-09-17T05:23:01.323 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.323 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.324 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.324 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.324 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.324 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.324 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.324 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.324 INFO:teuthology.orchestra.run.smithi098.stdout: "scrape_interval": { 2024-09-17T05:23:01.324 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "scrape_interval", 2024-09-17T05:23:01.324 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "float", 2024-09-17T05:23:01.324 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.324 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.324 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "15.0", 2024-09-17T05:23:01.325 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.325 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.325 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.325 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.325 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.325 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.325 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.325 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.325 INFO:teuthology.orchestra.run.smithi098.stdout: "server_addr": { 2024-09-17T05:23:01.325 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "server_addr", 2024-09-17T05:23:01.325 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.326 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.326 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.326 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "::", 2024-09-17T05:23:01.326 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.326 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.326 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.326 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-17T05:23:01.326 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.326 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.326 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.326 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.327 INFO:teuthology.orchestra.run.smithi098.stdout: "server_port": { 2024-09-17T05:23:01.327 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "server_port", 2024-09-17T05:23:01.327 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.327 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.327 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.327 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "9283", 2024-09-17T05:23:01.327 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.327 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.327 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.327 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-17T05:23:01.327 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.327 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.328 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.328 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.328 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:01.328 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:01.328 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.328 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:01.328 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.328 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:01.328 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.328 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.328 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.329 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.329 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.329 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.329 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.329 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.329 INFO:teuthology.orchestra.run.smithi098.stdout: "stale_cache_strategy": { 2024-09-17T05:23:01.329 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "stale_cache_strategy", 2024-09-17T05:23:01.329 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.329 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.329 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.329 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "log", 2024-09-17T05:23:01.329 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.330 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.330 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.330 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.330 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.330 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.330 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.330 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.330 INFO:teuthology.orchestra.run.smithi098.stdout: "standby_behaviour": { 2024-09-17T05:23:01.330 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "standby_behaviour", 2024-09-17T05:23:01.330 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.330 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.331 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.331 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "default", 2024-09-17T05:23:01.331 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.331 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.331 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.331 INFO:teuthology.orchestra.run.smithi098.stdout: "default", 2024-09-17T05:23:01.331 INFO:teuthology.orchestra.run.smithi098.stdout: "error" 2024-09-17T05:23:01.331 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.331 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.331 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.331 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.332 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.332 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.332 INFO:teuthology.orchestra.run.smithi098.stdout: "standby_error_status_code": { 2024-09-17T05:23:01.332 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "standby_error_status_code", 2024-09-17T05:23:01.332 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.332 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.332 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.332 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "500", 2024-09-17T05:23:01.332 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "400", 2024-09-17T05:23:01.332 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "599", 2024-09-17T05:23:01.333 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.333 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.333 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.333 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.333 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.333 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.333 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.333 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.333 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:01.333 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rbd_support", 2024-09-17T05:23:01.333 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:01.334 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:01.334 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:01.334 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:01.334 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:01.334 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.334 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.334 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.334 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.334 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.334 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.334 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.334 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.335 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.335 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.335 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.335 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.335 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.335 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.335 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.335 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.335 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.335 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.336 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:01.336 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:01.336 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.336 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.336 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.336 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.336 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.336 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.336 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.336 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.336 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.336 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.337 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.337 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.337 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:01.337 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:01.337 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.337 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.337 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.337 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:01.337 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.337 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.337 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.338 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.338 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.338 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.338 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.338 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.338 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.338 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.338 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.338 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.338 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.338 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.339 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.339 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:01.339 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:01.339 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.339 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.339 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.339 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.339 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.339 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.339 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.340 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.340 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.340 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.340 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.340 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.340 INFO:teuthology.orchestra.run.smithi098.stdout: "max_concurrent_snap_create": { 2024-09-17T05:23:01.340 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "max_concurrent_snap_create", 2024-09-17T05:23:01.340 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.340 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.340 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.340 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "10", 2024-09-17T05:23:01.341 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.341 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.341 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.341 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.341 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.341 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.341 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.341 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.341 INFO:teuthology.orchestra.run.smithi098.stdout: "mirror_snapshot_schedule": { 2024-09-17T05:23:01.341 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "mirror_snapshot_schedule", 2024-09-17T05:23:01.341 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.342 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.342 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.342 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.342 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.342 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.342 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.342 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.342 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.342 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.342 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.342 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.342 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:01.343 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:01.343 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.343 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:01.343 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.343 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:01.343 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.343 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.343 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.343 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.343 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.343 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.343 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.344 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.344 INFO:teuthology.orchestra.run.smithi098.stdout: "trash_purge_schedule": { 2024-09-17T05:23:01.344 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "trash_purge_schedule", 2024-09-17T05:23:01.344 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.344 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.344 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.344 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.344 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.344 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.344 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.344 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.345 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.345 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.345 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.345 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.345 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.345 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.345 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:01.345 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "restful", 2024-09-17T05:23:01.345 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:01.345 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:01.345 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:01.346 INFO:teuthology.orchestra.run.smithi098.stdout: "enable_auth": { 2024-09-17T05:23:01.346 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "enable_auth", 2024-09-17T05:23:01.346 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.346 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.346 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.346 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:01.346 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.346 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.346 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.346 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.346 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.346 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.347 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.347 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.347 INFO:teuthology.orchestra.run.smithi098.stdout: "key_file": { 2024-09-17T05:23:01.347 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "key_file", 2024-09-17T05:23:01.347 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.347 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.347 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.347 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.347 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.347 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.347 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.348 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.348 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.348 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.348 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.348 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.348 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:01.348 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:01.348 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.348 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.348 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.348 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.349 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.349 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.349 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.349 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.349 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.349 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.349 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.349 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.349 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.349 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.349 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.350 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.350 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.350 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.350 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.350 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:01.350 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:01.350 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.350 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.350 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.350 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.350 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.351 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.351 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.351 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.351 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.351 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.351 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.351 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.351 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:01.351 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:01.351 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.351 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.351 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.352 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:01.352 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.352 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.352 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.352 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.352 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.352 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.352 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.352 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.352 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.352 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.353 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.353 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.353 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.353 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.353 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.353 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:01.353 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:01.353 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.353 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.353 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.353 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.354 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.354 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.354 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.354 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.354 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.354 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.354 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.354 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.354 INFO:teuthology.orchestra.run.smithi098.stdout: "max_requests": { 2024-09-17T05:23:01.354 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "max_requests", 2024-09-17T05:23:01.354 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.355 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.355 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.355 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "500", 2024-09-17T05:23:01.355 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.355 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.355 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.355 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-17T05:23:01.355 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.355 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.355 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.355 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.356 INFO:teuthology.orchestra.run.smithi098.stdout: "server_addr": { 2024-09-17T05:23:01.356 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "server_addr", 2024-09-17T05:23:01.356 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.356 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.356 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.356 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.356 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.356 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.356 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.356 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.357 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.357 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.357 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.357 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.357 INFO:teuthology.orchestra.run.smithi098.stdout: "server_port": { 2024-09-17T05:23:01.357 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "server_port", 2024-09-17T05:23:01.357 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.357 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.357 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.357 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.358 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.358 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.358 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.358 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.358 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.358 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.358 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.358 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.358 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:01.358 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:01.358 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.359 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:01.359 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.359 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:01.359 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.359 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.359 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.359 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.359 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.359 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.359 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.359 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.360 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.360 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.360 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:01.360 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rgw", 2024-09-17T05:23:01.360 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:01.360 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:01.360 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:01.360 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:01.360 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:01.360 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.360 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.361 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.361 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.361 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.361 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.361 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.361 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.361 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.361 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.361 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.361 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.361 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.362 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.362 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.362 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.362 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.362 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.362 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.362 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:01.362 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:01.362 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.362 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.362 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.363 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.363 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.363 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.363 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.363 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.363 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.363 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.363 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.363 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.363 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:01.364 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:01.364 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.364 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.364 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.364 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:01.364 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.364 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.364 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.364 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.365 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.365 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.365 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.365 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.365 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.365 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.365 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.365 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.366 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.366 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.366 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.366 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:01.366 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:01.366 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.366 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.366 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.366 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.366 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.367 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.367 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.367 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.367 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.367 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.367 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.367 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.367 INFO:teuthology.orchestra.run.smithi098.stdout: "secondary_zone_period_retry_limit": { 2024-09-17T05:23:01.367 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-17T05:23:01.367 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.368 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.368 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.368 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "5", 2024-09-17T05:23:01.368 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.368 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.368 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.368 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-17T05:23:01.368 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.368 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.368 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.368 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.369 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:01.369 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:01.369 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.369 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:01.369 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.369 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:01.369 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.369 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.369 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.369 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.369 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.370 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.370 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.370 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.370 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.370 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.370 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:01.370 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rook", 2024-09-17T05:23:01.370 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:01.370 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:01.370 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:01.370 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:01.370 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:01.371 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.371 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.371 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.371 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.371 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.371 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.371 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.371 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.371 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.371 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.371 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.372 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.372 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.372 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.372 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.372 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.372 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.372 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.372 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.372 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:01.372 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:01.373 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.373 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.373 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.373 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.373 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.373 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.373 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.373 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.373 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.373 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.373 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.374 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.374 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:01.374 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:01.374 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.374 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.374 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.374 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:01.374 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.374 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.374 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.375 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.375 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.375 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.375 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.375 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.375 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.375 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.375 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.375 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.375 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.376 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.376 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.376 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:01.376 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:01.376 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.376 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.376 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.377 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.377 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.377 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.377 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.377 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.377 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.377 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.377 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.377 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.377 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:01.377 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:01.378 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.378 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:01.378 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.378 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:01.378 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.378 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.378 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.378 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.378 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.378 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.378 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.379 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.379 INFO:teuthology.orchestra.run.smithi098.stdout: "storage_class": { 2024-09-17T05:23:01.379 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "storage_class", 2024-09-17T05:23:01.379 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.379 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.379 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.379 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "local", 2024-09-17T05:23:01.379 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.379 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.379 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.379 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-17T05:23:01.380 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.380 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.380 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.380 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.380 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.380 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.380 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:01.380 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "selftest", 2024-09-17T05:23:01.380 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:01.380 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:01.380 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:01.381 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:01.381 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:01.381 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.381 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.381 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.381 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.381 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.381 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.381 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.381 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.381 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.381 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.382 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.382 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.382 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.382 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.382 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.382 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.382 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.382 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.382 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.382 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:01.383 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:01.383 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.383 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.383 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.383 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.383 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.383 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.383 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.383 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.383 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.383 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.384 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.384 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.384 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:01.384 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:01.384 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.384 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.384 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.384 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:01.384 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.384 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.385 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.385 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.385 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.385 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.385 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.385 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.385 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.385 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.385 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.385 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.385 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.386 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.386 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.386 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:01.386 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:01.386 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.386 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.386 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.386 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.386 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.386 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.386 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.387 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.387 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.387 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.387 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.387 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.387 INFO:teuthology.orchestra.run.smithi098.stdout: "roption1": { 2024-09-17T05:23:01.387 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "roption1", 2024-09-17T05:23:01.387 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.387 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.387 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.387 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.388 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.388 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.388 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.388 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.388 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.388 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.388 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.388 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.388 INFO:teuthology.orchestra.run.smithi098.stdout: "roption2": { 2024-09-17T05:23:01.388 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "roption2", 2024-09-17T05:23:01.388 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.389 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.389 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.389 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "xyz", 2024-09-17T05:23:01.389 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.389 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.389 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.389 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.389 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.389 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.389 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.389 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.390 INFO:teuthology.orchestra.run.smithi098.stdout: "rwoption1": { 2024-09-17T05:23:01.390 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rwoption1", 2024-09-17T05:23:01.390 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.390 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.390 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.390 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.390 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.390 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.390 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.390 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.390 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.391 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.391 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.391 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.391 INFO:teuthology.orchestra.run.smithi098.stdout: "rwoption2": { 2024-09-17T05:23:01.391 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rwoption2", 2024-09-17T05:23:01.391 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.391 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.391 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.391 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.391 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.391 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.392 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.392 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.392 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.392 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.392 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.392 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.392 INFO:teuthology.orchestra.run.smithi098.stdout: "rwoption3": { 2024-09-17T05:23:01.392 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rwoption3", 2024-09-17T05:23:01.392 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "float", 2024-09-17T05:23:01.392 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.392 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.393 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.393 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.393 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.393 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.393 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.393 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.393 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.393 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.393 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.393 INFO:teuthology.orchestra.run.smithi098.stdout: "rwoption4": { 2024-09-17T05:23:01.393 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rwoption4", 2024-09-17T05:23:01.393 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.394 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.394 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.394 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.394 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.394 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.394 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.394 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.394 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.394 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.394 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.394 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.395 INFO:teuthology.orchestra.run.smithi098.stdout: "rwoption5": { 2024-09-17T05:23:01.395 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rwoption5", 2024-09-17T05:23:01.395 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.395 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.395 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.395 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.395 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.395 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.395 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.395 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.395 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.396 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.396 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.396 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.396 INFO:teuthology.orchestra.run.smithi098.stdout: "rwoption6": { 2024-09-17T05:23:01.396 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rwoption6", 2024-09-17T05:23:01.396 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.396 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.396 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.396 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:01.396 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.396 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.397 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.397 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.397 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.397 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.397 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.397 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.397 INFO:teuthology.orchestra.run.smithi098.stdout: "rwoption7": { 2024-09-17T05:23:01.397 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rwoption7", 2024-09-17T05:23:01.397 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.397 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.397 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.397 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.398 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "1", 2024-09-17T05:23:01.398 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "42", 2024-09-17T05:23:01.398 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.398 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.398 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.398 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.398 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.398 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.398 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:01.398 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:01.398 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.399 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:01.399 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.399 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:01.399 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.399 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.399 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.399 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.399 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.399 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.399 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.399 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.400 INFO:teuthology.orchestra.run.smithi098.stdout: "testkey": { 2024-09-17T05:23:01.400 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "testkey", 2024-09-17T05:23:01.400 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.400 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.400 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.400 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.400 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.400 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.400 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.400 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.400 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.401 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.401 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.401 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.401 INFO:teuthology.orchestra.run.smithi098.stdout: "testlkey": { 2024-09-17T05:23:01.401 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "testlkey", 2024-09-17T05:23:01.401 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.401 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.401 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.401 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.401 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.401 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.402 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.402 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.402 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.402 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.402 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.402 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.402 INFO:teuthology.orchestra.run.smithi098.stdout: "testnewline": { 2024-09-17T05:23:01.402 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "testnewline", 2024-09-17T05:23:01.402 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.402 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.402 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.402 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.403 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.403 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.403 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.403 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.403 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.403 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.403 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.403 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.403 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.403 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:01.404 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "smb", 2024-09-17T05:23:01.404 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:01.404 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:01.404 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:01.404 INFO:teuthology.orchestra.run.smithi098.stdout: "internal_store_backend": { 2024-09-17T05:23:01.404 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "internal_store_backend", 2024-09-17T05:23:01.404 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.404 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:01.404 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.404 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.404 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.405 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.405 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.405 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-17T05:23:01.405 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.405 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.405 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.405 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.405 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:01.405 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:01.405 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.405 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.406 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.406 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.406 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.406 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.406 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.406 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.406 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.406 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.406 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.406 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.407 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.407 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.407 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.407 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.407 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.407 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.407 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.407 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:01.407 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:01.407 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.407 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.407 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.408 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.408 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.408 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.408 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.408 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.408 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.408 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.408 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.408 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.408 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:01.408 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:01.409 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.409 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.409 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.409 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:01.409 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.409 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.409 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.409 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.409 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.409 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.409 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.409 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.410 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.410 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.410 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.410 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.410 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.410 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.410 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:01.410 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:01.410 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.410 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.411 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.411 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.411 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.411 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.411 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.411 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.411 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.411 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.411 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.411 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:01.412 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:01.412 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.412 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:01.412 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.412 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:01.412 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.412 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.412 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.412 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.412 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.412 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.413 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.413 INFO:teuthology.orchestra.run.smithi098.stdout: "update_orchestration": { 2024-09-17T05:23:01.413 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "update_orchestration", 2024-09-17T05:23:01.413 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.413 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.413 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.413 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:01.413 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.413 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.413 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.413 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-17T05:23:01.414 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.414 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.414 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.414 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.414 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.414 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:01.414 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "snap_schedule", 2024-09-17T05:23:01.414 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:01.414 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:01.414 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:01.415 INFO:teuthology.orchestra.run.smithi098.stdout: "allow_m_granularity": { 2024-09-17T05:23:01.415 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "allow_m_granularity", 2024-09-17T05:23:01.415 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.415 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.415 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.415 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.415 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.415 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.415 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.415 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "allow minute scheduled snapshots", 2024-09-17T05:23:01.415 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.416 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.416 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.416 INFO:teuthology.orchestra.run.smithi098.stdout: "dump_on_update": { 2024-09-17T05:23:01.416 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "dump_on_update", 2024-09-17T05:23:01.416 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.416 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.416 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.416 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.416 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.416 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.417 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.417 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "dump database to debug log on update", 2024-09-17T05:23:01.417 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.417 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.417 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.417 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.417 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:01.417 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:01.417 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.417 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.417 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.417 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.418 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.418 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.418 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.418 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.418 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.418 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.418 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.418 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.418 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.418 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.418 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.418 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.419 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.419 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.419 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:01.419 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:01.419 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.419 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.419 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.419 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.419 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.419 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.420 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.420 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.420 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.420 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.420 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.420 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:01.420 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:01.420 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.420 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.421 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.421 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:01.421 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.421 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.421 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.421 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.421 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.421 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.421 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.421 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.421 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.421 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.422 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.422 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.422 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.422 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.422 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:01.422 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:01.422 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.422 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.422 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.422 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.423 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.423 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.423 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.423 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.423 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.423 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.423 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.423 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:01.423 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:01.423 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.423 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:01.424 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.424 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:01.424 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.424 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.424 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.424 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.424 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.424 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.424 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.424 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.424 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.425 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:01.425 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "stats", 2024-09-17T05:23:01.425 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:01.425 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:01.425 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:01.425 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:01.425 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:01.425 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.425 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.425 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.426 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.426 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.426 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.426 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.426 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.426 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.426 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.426 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.426 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.426 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.426 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.427 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.427 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.427 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.427 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.427 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.427 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:01.427 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:01.427 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.427 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.427 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.427 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.427 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.428 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.428 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.428 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.428 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.428 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.428 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.428 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.428 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:01.428 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:01.428 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.428 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.429 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.429 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:01.429 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.429 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.429 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.429 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.429 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.429 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.429 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.429 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.429 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.430 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.430 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.430 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.430 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.430 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.430 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.430 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:01.430 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:01.430 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.430 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.430 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.431 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.431 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.431 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.431 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.431 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.431 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.431 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.431 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.431 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.431 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:01.431 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:01.431 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.432 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:01.432 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.432 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:01.432 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.432 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.432 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.432 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.432 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.432 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.432 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.433 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.433 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.433 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.433 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:01.433 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "status", 2024-09-17T05:23:01.433 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:01.433 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:01.433 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:01.433 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:01.433 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:01.433 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.434 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.434 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.434 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.434 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.434 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.434 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.434 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.434 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.434 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.434 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.434 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.434 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.435 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.435 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.435 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.435 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.435 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.435 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.435 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:01.435 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:01.435 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.435 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.435 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.436 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.436 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.436 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.436 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.436 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.436 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.436 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.436 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.436 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.436 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:01.436 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:01.437 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.437 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.437 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.437 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:01.437 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.437 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.437 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.437 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.437 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.437 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.437 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.437 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.438 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.438 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.438 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.438 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.438 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.438 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.438 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.438 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:01.438 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:01.438 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.438 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.439 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.439 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.439 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.439 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.439 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.439 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.439 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.439 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.439 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.439 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.440 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:01.440 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:01.440 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.440 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:01.440 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.440 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:01.440 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.440 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.440 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.440 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.440 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.441 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.441 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.441 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.441 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.441 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.441 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:01.441 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "telegraf", 2024-09-17T05:23:01.441 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:01.441 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:01.441 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:01.442 INFO:teuthology.orchestra.run.smithi098.stdout: "address": { 2024-09-17T05:23:01.442 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "address", 2024-09-17T05:23:01.442 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.442 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.442 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.442 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-17T05:23:01.442 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.442 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.442 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.442 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.442 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.443 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.443 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.443 INFO:teuthology.orchestra.run.smithi098.stdout: "interval": { 2024-09-17T05:23:01.443 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "interval", 2024-09-17T05:23:01.443 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-17T05:23:01.443 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.443 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.443 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "15", 2024-09-17T05:23:01.443 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.443 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.444 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.444 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.444 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.444 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.444 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.444 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.444 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:01.444 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:01.444 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.444 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.444 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.445 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.445 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.445 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.445 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.445 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.445 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.445 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.445 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.445 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.445 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.445 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.446 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.446 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.446 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.446 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.446 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.446 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:01.446 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:01.446 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.446 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.446 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.446 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.447 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.447 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.447 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.447 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.447 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.447 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.447 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.447 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.447 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:01.447 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:01.447 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.448 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.448 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.448 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:01.448 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.448 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.448 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.448 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.448 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.448 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.448 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.448 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.448 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.449 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.449 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.449 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.449 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.449 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.449 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.449 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:01.449 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:01.449 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.449 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.449 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.450 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.450 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.450 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.450 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.450 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.450 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.450 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.450 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.450 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.450 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:01.450 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:01.450 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.451 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:01.451 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.451 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:01.451 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.451 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.451 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.451 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.451 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.451 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.451 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.451 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.452 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.452 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.452 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:01.452 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "telemetry", 2024-09-17T05:23:01.452 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:01.452 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:01.452 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:01.452 INFO:teuthology.orchestra.run.smithi098.stdout: "channel_basic": { 2024-09-17T05:23:01.452 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "channel_basic", 2024-09-17T05:23:01.452 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.452 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.453 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.453 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:01.453 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.453 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.453 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.453 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-17T05:23:01.453 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.453 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.453 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.453 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.453 INFO:teuthology.orchestra.run.smithi098.stdout: "channel_crash": { 2024-09-17T05:23:01.453 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "channel_crash", 2024-09-17T05:23:01.454 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.454 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.454 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.454 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:01.454 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.454 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.454 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.454 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-17T05:23:01.454 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.454 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.454 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.455 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.455 INFO:teuthology.orchestra.run.smithi098.stdout: "channel_device": { 2024-09-17T05:23:01.455 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "channel_device", 2024-09-17T05:23:01.455 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.455 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.455 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.455 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:01.455 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.455 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.455 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.455 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-17T05:23:01.456 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.456 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.456 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.456 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.456 INFO:teuthology.orchestra.run.smithi098.stdout: "channel_ident": { 2024-09-17T05:23:01.456 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "channel_ident", 2024-09-17T05:23:01.456 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.456 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.456 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.456 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.456 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.457 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.457 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.457 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-17T05:23:01.457 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.457 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.457 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.457 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.457 INFO:teuthology.orchestra.run.smithi098.stdout: "channel_perf": { 2024-09-17T05:23:01.457 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "channel_perf", 2024-09-17T05:23:01.457 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.457 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.457 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.458 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.458 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.458 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.458 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.458 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-17T05:23:01.458 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.458 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.458 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.458 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.458 INFO:teuthology.orchestra.run.smithi098.stdout: "contact": { 2024-09-17T05:23:01.458 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "contact", 2024-09-17T05:23:01.459 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.459 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.459 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.459 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.459 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.459 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.459 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.459 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.459 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.459 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.459 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.459 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.460 INFO:teuthology.orchestra.run.smithi098.stdout: "description": { 2024-09-17T05:23:01.460 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "description", 2024-09-17T05:23:01.460 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.460 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.460 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.460 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.460 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.460 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.460 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.460 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.461 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.461 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.461 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.461 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.461 INFO:teuthology.orchestra.run.smithi098.stdout: "device_url": { 2024-09-17T05:23:01.461 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "device_url", 2024-09-17T05:23:01.461 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.461 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.461 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.461 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-17T05:23:01.461 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.462 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.462 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.462 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.462 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.462 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.462 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.462 INFO:teuthology.orchestra.run.smithi098.stdout: "enabled": { 2024-09-17T05:23:01.462 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "enabled", 2024-09-17T05:23:01.462 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.463 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.463 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.463 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.463 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.463 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.463 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.463 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.463 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.463 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.463 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.463 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.464 INFO:teuthology.orchestra.run.smithi098.stdout: "interval": { 2024-09-17T05:23:01.464 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "interval", 2024-09-17T05:23:01.464 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.464 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.464 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.464 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "24", 2024-09-17T05:23:01.464 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "8", 2024-09-17T05:23:01.464 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.464 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.464 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.464 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.464 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.465 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.465 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.465 INFO:teuthology.orchestra.run.smithi098.stdout: "last_opt_revision": { 2024-09-17T05:23:01.465 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "last_opt_revision", 2024-09-17T05:23:01.465 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.465 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.465 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.465 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "1", 2024-09-17T05:23:01.465 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.465 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.465 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.466 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.466 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.466 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.466 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.466 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.466 INFO:teuthology.orchestra.run.smithi098.stdout: "leaderboard": { 2024-09-17T05:23:01.466 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "leaderboard", 2024-09-17T05:23:01.466 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.466 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.466 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.466 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.466 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.467 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.467 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.467 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.467 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.467 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.467 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.467 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.467 INFO:teuthology.orchestra.run.smithi098.stdout: "leaderboard_description": { 2024-09-17T05:23:01.467 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "leaderboard_description", 2024-09-17T05:23:01.467 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.468 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.468 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.468 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.468 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.468 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.468 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.468 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.468 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.468 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.468 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.468 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.468 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:01.469 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:01.469 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.469 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.469 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.469 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.469 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.469 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.469 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.469 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.469 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.469 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.470 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.470 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.470 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.470 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.470 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.470 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.470 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.470 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.470 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.470 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:01.470 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:01.470 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.471 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.471 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.471 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.471 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.471 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.471 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.471 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.471 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.471 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.471 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.471 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.472 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:01.472 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:01.472 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.472 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.472 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.472 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:01.472 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.472 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.472 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.472 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.472 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.473 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.473 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.473 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.473 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.473 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.473 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.473 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.473 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.473 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.473 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.473 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:01.473 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:01.474 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.474 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.474 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.474 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.474 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.474 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.474 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.474 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.474 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.474 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.474 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.474 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.475 INFO:teuthology.orchestra.run.smithi098.stdout: "organization": { 2024-09-17T05:23:01.475 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "organization", 2024-09-17T05:23:01.475 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.475 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.475 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.475 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.475 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.475 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.475 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.475 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.475 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.476 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.476 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.476 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.476 INFO:teuthology.orchestra.run.smithi098.stdout: "proxy": { 2024-09-17T05:23:01.476 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "proxy", 2024-09-17T05:23:01.476 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.476 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.476 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.476 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.476 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.476 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.477 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.477 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.477 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.477 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.477 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.477 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.477 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:01.477 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:01.477 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.477 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:01.477 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.477 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:01.478 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.478 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.478 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.478 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.478 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.478 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.478 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.478 INFO:teuthology.orchestra.run.smithi098.stdout: "url": { 2024-09-17T05:23:01.478 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "url", 2024-09-17T05:23:01.478 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.479 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.479 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.479 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-17T05:23:01.479 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.479 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.479 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.479 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.479 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.479 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.479 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.479 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.479 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.480 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.480 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:01.480 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "test_orchestrator", 2024-09-17T05:23:01.480 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:01.480 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:01.480 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:01.480 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:01.480 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:01.480 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.480 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.480 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.481 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.481 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.481 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.481 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.481 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.481 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.481 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.481 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.481 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.481 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.484 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.484 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.484 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.484 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.484 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.484 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.485 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:01.485 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:01.485 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.485 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.485 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.485 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.485 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.485 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.485 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.485 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.485 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.485 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.486 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.486 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.486 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:01.486 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:01.486 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.486 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.486 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.486 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:01.486 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.486 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.486 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.487 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.487 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.487 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.487 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.487 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.487 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.487 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.487 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.487 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.487 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.487 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.487 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.488 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:01.488 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:01.488 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.488 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.488 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.488 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.488 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.488 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.488 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.488 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.488 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.489 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.489 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.489 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.489 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:01.489 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:01.489 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.489 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:01.489 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.489 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:01.489 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.489 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.490 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.490 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.490 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.490 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.490 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.490 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.490 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.490 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.490 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:01.490 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "volumes", 2024-09-17T05:23:01.490 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:01.490 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:01.491 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:01.491 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:01.491 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:01.491 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.491 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.491 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.491 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.491 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.491 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.491 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.491 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.492 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.492 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.492 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.492 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.492 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.492 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.492 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.492 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.492 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.492 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.492 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.493 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:01.493 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:01.493 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.493 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.493 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.493 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.493 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.493 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.493 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.493 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.493 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.494 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.494 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.494 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.494 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:01.494 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:01.494 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.494 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.494 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.494 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:01.494 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.494 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.495 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.495 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.495 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.495 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.495 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.495 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.495 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.495 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.495 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.495 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.495 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.495 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.496 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.496 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:01.496 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:01.496 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.496 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.496 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.496 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.496 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.496 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.496 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.496 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.497 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.497 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.497 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.497 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.497 INFO:teuthology.orchestra.run.smithi098.stdout: "max_concurrent_clones": { 2024-09-17T05:23:01.497 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "max_concurrent_clones", 2024-09-17T05:23:01.497 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.497 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.497 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.497 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "4", 2024-09-17T05:23:01.497 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.497 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.498 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.498 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-17T05:23:01.498 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.498 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.498 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.498 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.498 INFO:teuthology.orchestra.run.smithi098.stdout: "periodic_async_work": { 2024-09-17T05:23:01.498 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "periodic_async_work", 2024-09-17T05:23:01.498 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.498 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.498 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.499 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.499 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.499 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.499 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.499 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Periodically check for async work", 2024-09-17T05:23:01.499 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.499 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.499 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.499 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.499 INFO:teuthology.orchestra.run.smithi098.stdout: "snapshot_clone_delay": { 2024-09-17T05:23:01.499 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "snapshot_clone_delay", 2024-09-17T05:23:01.499 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.500 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.500 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.500 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:01.500 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.500 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.500 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.500 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-17T05:23:01.500 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.500 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.500 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.501 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.501 INFO:teuthology.orchestra.run.smithi098.stdout: "snapshot_clone_no_wait": { 2024-09-17T05:23:01.501 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "snapshot_clone_no_wait", 2024-09-17T05:23:01.501 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.501 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.501 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.501 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-17T05:23:01.501 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.501 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.501 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.501 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-17T05:23:01.502 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.502 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.502 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.502 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.502 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:01.502 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:01.502 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.502 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:01.502 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.502 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:01.502 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.502 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.503 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.503 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.503 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.503 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.503 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.503 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.503 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.503 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.503 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:01.503 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "zabbix", 2024-09-17T05:23:01.503 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-17T05:23:01.503 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-17T05:23:01.504 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-17T05:23:01.504 INFO:teuthology.orchestra.run.smithi098.stdout: "discovery_interval": { 2024-09-17T05:23:01.504 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "discovery_interval", 2024-09-17T05:23:01.504 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "uint", 2024-09-17T05:23:01.504 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.504 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.504 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "100", 2024-09-17T05:23:01.504 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.504 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.504 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.504 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.505 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.505 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.505 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.505 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.505 INFO:teuthology.orchestra.run.smithi098.stdout: "identifier": { 2024-09-17T05:23:01.505 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "identifier", 2024-09-17T05:23:01.505 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.505 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.505 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.505 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.505 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.505 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.506 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.506 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.506 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.506 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.506 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.506 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.506 INFO:teuthology.orchestra.run.smithi098.stdout: "interval": { 2024-09-17T05:23:01.506 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "interval", 2024-09-17T05:23:01.506 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-17T05:23:01.506 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.506 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.507 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "60", 2024-09-17T05:23:01.507 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.507 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.507 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.507 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.507 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.507 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.507 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.507 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.507 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-17T05:23:01.507 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-17T05:23:01.507 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.508 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.508 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.508 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.508 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.508 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.508 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.508 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.508 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.508 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.508 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.508 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.509 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.509 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.509 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.509 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.509 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.509 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.509 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.509 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-17T05:23:01.509 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-17T05:23:01.509 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.509 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.510 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.510 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.510 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.510 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.510 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.510 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.510 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.510 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.510 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.510 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.510 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-17T05:23:01.510 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-17T05:23:01.511 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.511 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.511 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.511 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-17T05:23:01.511 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.511 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.511 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-17T05:23:01.511 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-17T05:23:01.511 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-17T05:23:01.511 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-17T05:23:01.511 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-17T05:23:01.512 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-17T05:23:01.512 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-17T05:23:01.512 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.512 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.512 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.512 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.512 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.512 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.512 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-17T05:23:01.512 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-17T05:23:01.512 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-17T05:23:01.513 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.513 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.513 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-17T05:23:01.513 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.513 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.513 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.513 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.513 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.513 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.513 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.513 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.513 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-17T05:23:01.514 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:23:01.514 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.514 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-17T05:23:01.514 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-17T05:23:01.514 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-17T05:23:01.514 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.514 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.514 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.514 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.514 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.515 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.515 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.515 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.515 INFO:teuthology.orchestra.run.smithi098.stdout: "zabbix_host": { 2024-09-17T05:23:01.515 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "zabbix_host", 2024-09-17T05:23:01.515 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.515 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.515 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.515 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-17T05:23:01.515 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.515 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.515 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.516 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.516 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.516 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.516 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.516 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.516 INFO:teuthology.orchestra.run.smithi098.stdout: "zabbix_port": { 2024-09-17T05:23:01.516 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "zabbix_port", 2024-09-17T05:23:01.516 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-17T05:23:01.516 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.516 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.516 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "10051", 2024-09-17T05:23:01.517 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.517 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.517 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.517 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.517 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.517 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.517 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.517 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.517 INFO:teuthology.orchestra.run.smithi098.stdout: "zabbix_sender": { 2024-09-17T05:23:01.517 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "zabbix_sender", 2024-09-17T05:23:01.517 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-17T05:23:01.518 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-17T05:23:01.518 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-17T05:23:01.518 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-17T05:23:01.518 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-17T05:23:01.518 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-17T05:23:01.518 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-17T05:23:01.518 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-17T05:23:01.518 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-17T05:23:01.518 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-17T05:23:01.518 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-17T05:23:01.518 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.519 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.519 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.519 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.519 INFO:teuthology.orchestra.run.smithi098.stdout: "services": {}, 2024-09-17T05:23:01.519 INFO:teuthology.orchestra.run.smithi098.stdout: "always_on_modules": { 2024-09-17T05:23:01.519 INFO:teuthology.orchestra.run.smithi098.stdout: "octopus": [ 2024-09-17T05:23:01.519 INFO:teuthology.orchestra.run.smithi098.stdout: "balancer", 2024-09-17T05:23:01.519 INFO:teuthology.orchestra.run.smithi098.stdout: "crash", 2024-09-17T05:23:01.519 INFO:teuthology.orchestra.run.smithi098.stdout: "devicehealth", 2024-09-17T05:23:01.519 INFO:teuthology.orchestra.run.smithi098.stdout: "orchestrator", 2024-09-17T05:23:01.519 INFO:teuthology.orchestra.run.smithi098.stdout: "pg_autoscaler", 2024-09-17T05:23:01.520 INFO:teuthology.orchestra.run.smithi098.stdout: "progress", 2024-09-17T05:23:01.520 INFO:teuthology.orchestra.run.smithi098.stdout: "rbd_support", 2024-09-17T05:23:01.520 INFO:teuthology.orchestra.run.smithi098.stdout: "status", 2024-09-17T05:23:01.520 INFO:teuthology.orchestra.run.smithi098.stdout: "telemetry", 2024-09-17T05:23:01.520 INFO:teuthology.orchestra.run.smithi098.stdout: "volumes" 2024-09-17T05:23:01.520 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.520 INFO:teuthology.orchestra.run.smithi098.stdout: "pacific": [ 2024-09-17T05:23:01.520 INFO:teuthology.orchestra.run.smithi098.stdout: "balancer", 2024-09-17T05:23:01.520 INFO:teuthology.orchestra.run.smithi098.stdout: "crash", 2024-09-17T05:23:01.520 INFO:teuthology.orchestra.run.smithi098.stdout: "devicehealth", 2024-09-17T05:23:01.520 INFO:teuthology.orchestra.run.smithi098.stdout: "orchestrator", 2024-09-17T05:23:01.521 INFO:teuthology.orchestra.run.smithi098.stdout: "pg_autoscaler", 2024-09-17T05:23:01.521 INFO:teuthology.orchestra.run.smithi098.stdout: "progress", 2024-09-17T05:23:01.521 INFO:teuthology.orchestra.run.smithi098.stdout: "rbd_support", 2024-09-17T05:23:01.521 INFO:teuthology.orchestra.run.smithi098.stdout: "status", 2024-09-17T05:23:01.521 INFO:teuthology.orchestra.run.smithi098.stdout: "telemetry", 2024-09-17T05:23:01.521 INFO:teuthology.orchestra.run.smithi098.stdout: "volumes" 2024-09-17T05:23:01.521 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.521 INFO:teuthology.orchestra.run.smithi098.stdout: "quincy": [ 2024-09-17T05:23:01.521 INFO:teuthology.orchestra.run.smithi098.stdout: "balancer", 2024-09-17T05:23:01.521 INFO:teuthology.orchestra.run.smithi098.stdout: "crash", 2024-09-17T05:23:01.521 INFO:teuthology.orchestra.run.smithi098.stdout: "devicehealth", 2024-09-17T05:23:01.521 INFO:teuthology.orchestra.run.smithi098.stdout: "orchestrator", 2024-09-17T05:23:01.522 INFO:teuthology.orchestra.run.smithi098.stdout: "pg_autoscaler", 2024-09-17T05:23:01.522 INFO:teuthology.orchestra.run.smithi098.stdout: "progress", 2024-09-17T05:23:01.522 INFO:teuthology.orchestra.run.smithi098.stdout: "rbd_support", 2024-09-17T05:23:01.522 INFO:teuthology.orchestra.run.smithi098.stdout: "status", 2024-09-17T05:23:01.522 INFO:teuthology.orchestra.run.smithi098.stdout: "telemetry", 2024-09-17T05:23:01.522 INFO:teuthology.orchestra.run.smithi098.stdout: "volumes" 2024-09-17T05:23:01.522 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.522 INFO:teuthology.orchestra.run.smithi098.stdout: "reef": [ 2024-09-17T05:23:01.522 INFO:teuthology.orchestra.run.smithi098.stdout: "balancer", 2024-09-17T05:23:01.522 INFO:teuthology.orchestra.run.smithi098.stdout: "crash", 2024-09-17T05:23:01.522 INFO:teuthology.orchestra.run.smithi098.stdout: "devicehealth", 2024-09-17T05:23:01.523 INFO:teuthology.orchestra.run.smithi098.stdout: "orchestrator", 2024-09-17T05:23:01.523 INFO:teuthology.orchestra.run.smithi098.stdout: "pg_autoscaler", 2024-09-17T05:23:01.523 INFO:teuthology.orchestra.run.smithi098.stdout: "progress", 2024-09-17T05:23:01.523 INFO:teuthology.orchestra.run.smithi098.stdout: "rbd_support", 2024-09-17T05:23:01.523 INFO:teuthology.orchestra.run.smithi098.stdout: "status", 2024-09-17T05:23:01.523 INFO:teuthology.orchestra.run.smithi098.stdout: "telemetry", 2024-09-17T05:23:01.523 INFO:teuthology.orchestra.run.smithi098.stdout: "volumes" 2024-09-17T05:23:01.523 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T05:23:01.523 INFO:teuthology.orchestra.run.smithi098.stdout: "squid": [ 2024-09-17T05:23:01.523 INFO:teuthology.orchestra.run.smithi098.stdout: "balancer", 2024-09-17T05:23:01.523 INFO:teuthology.orchestra.run.smithi098.stdout: "crash", 2024-09-17T05:23:01.523 INFO:teuthology.orchestra.run.smithi098.stdout: "devicehealth", 2024-09-17T05:23:01.524 INFO:teuthology.orchestra.run.smithi098.stdout: "orchestrator", 2024-09-17T05:23:01.524 INFO:teuthology.orchestra.run.smithi098.stdout: "pg_autoscaler", 2024-09-17T05:23:01.524 INFO:teuthology.orchestra.run.smithi098.stdout: "progress", 2024-09-17T05:23:01.524 INFO:teuthology.orchestra.run.smithi098.stdout: "rbd_support", 2024-09-17T05:23:01.524 INFO:teuthology.orchestra.run.smithi098.stdout: "status", 2024-09-17T05:23:01.524 INFO:teuthology.orchestra.run.smithi098.stdout: "telemetry", 2024-09-17T05:23:01.524 INFO:teuthology.orchestra.run.smithi098.stdout: "volumes" 2024-09-17T05:23:01.524 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T05:23:01.524 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.524 INFO:teuthology.orchestra.run.smithi098.stdout: "last_failure_osd_epoch": 0, 2024-09-17T05:23:01.525 INFO:teuthology.orchestra.run.smithi098.stdout: "active_clients": [ 2024-09-17T05:23:01.525 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:01.525 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "devicehealth", 2024-09-17T05:23:01.525 INFO:teuthology.orchestra.run.smithi098.stdout: "addrvec": [ 2024-09-17T05:23:01.525 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:01.525 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "v2", 2024-09-17T05:23:01.525 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": "172.21.15.167:0", 2024-09-17T05:23:01.525 INFO:teuthology.orchestra.run.smithi098.stdout: "nonce": 2086901431 2024-09-17T05:23:01.525 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.525 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T05:23:01.525 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.525 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:01.526 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "libcephsqlite", 2024-09-17T05:23:01.526 INFO:teuthology.orchestra.run.smithi098.stdout: "addrvec": [ 2024-09-17T05:23:01.526 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:01.526 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "v2", 2024-09-17T05:23:01.526 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": "172.21.15.167:0", 2024-09-17T05:23:01.526 INFO:teuthology.orchestra.run.smithi098.stdout: "nonce": 3518990224 2024-09-17T05:23:01.526 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.526 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T05:23:01.526 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.526 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:01.526 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rbd_support", 2024-09-17T05:23:01.526 INFO:teuthology.orchestra.run.smithi098.stdout: "addrvec": [ 2024-09-17T05:23:01.527 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:01.527 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "v2", 2024-09-17T05:23:01.527 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": "172.21.15.167:0", 2024-09-17T05:23:01.527 INFO:teuthology.orchestra.run.smithi098.stdout: "nonce": 4069849884 2024-09-17T05:23:01.527 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.527 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T05:23:01.527 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.527 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:01.527 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "volumes", 2024-09-17T05:23:01.527 INFO:teuthology.orchestra.run.smithi098.stdout: "addrvec": [ 2024-09-17T05:23:01.527 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:01.528 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "v2", 2024-09-17T05:23:01.528 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": "172.21.15.167:0", 2024-09-17T05:23:01.528 INFO:teuthology.orchestra.run.smithi098.stdout: "nonce": 1941511249 2024-09-17T05:23:01.528 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.528 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T05:23:01.528 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.528 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:01.528 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "volumes", 2024-09-17T05:23:01.528 INFO:teuthology.orchestra.run.smithi098.stdout: "addrvec": [ 2024-09-17T05:23:01.528 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:01.528 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "v2", 2024-09-17T05:23:01.528 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": "172.21.15.167:0", 2024-09-17T05:23:01.529 INFO:teuthology.orchestra.run.smithi098.stdout: "nonce": 2757709951 2024-09-17T05:23:01.529 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.529 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T05:23:01.529 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.529 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:01.529 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "volumes", 2024-09-17T05:23:01.529 INFO:teuthology.orchestra.run.smithi098.stdout: "addrvec": [ 2024-09-17T05:23:01.529 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:01.529 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "v2", 2024-09-17T05:23:01.529 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": "172.21.15.167:0", 2024-09-17T05:23:01.529 INFO:teuthology.orchestra.run.smithi098.stdout: "nonce": 4292144645 2024-09-17T05:23:01.529 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.530 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T05:23:01.530 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T05:23:01.530 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:01.530 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "volumes", 2024-09-17T05:23:01.530 INFO:teuthology.orchestra.run.smithi098.stdout: "addrvec": [ 2024-09-17T05:23:01.530 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T05:23:01.530 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "v2", 2024-09-17T05:23:01.530 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": "172.21.15.167:0", 2024-09-17T05:23:01.530 INFO:teuthology.orchestra.run.smithi098.stdout: "nonce": 462501976 2024-09-17T05:23:01.530 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.530 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T05:23:01.531 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T05:23:01.531 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T05:23:01.531 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T05:23:01.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.389+0000 7f0716e52640 1 -- 172.21.15.98:0/3637581905 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f06f4078d40 msgr2=0x7f06f407b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:01.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.389+0000 7f0716e52640 1 --2- 172.21.15.98:0/3637581905 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f06f4078d40 0x7f06f407b200 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0704005fd0 tx=0x7f0704005850 comp rx=0 tx=0).stop 2024-09-17T05:23:01.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.389+0000 7f0716e52640 1 -- 172.21.15.98:0/3637581905 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f071015e0d0 msgr2=0x7f0710152b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:01.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.389+0000 7f0716e52640 1 --2- 172.21.15.98:0/3637581905 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f071015e0d0 0x7f0710152b80 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f070800c770 tx=0x7f070800cc30 comp rx=0 tx=0).stop 2024-09-17T05:23:01.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.389+0000 7f0716e52640 1 -- 172.21.15.98:0/3637581905 shutdown_connections 2024-09-17T05:23:01.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.389+0000 7f0716e52640 1 --2- 172.21.15.98:0/3637581905 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f06f4078d40 0x7f06f407b200 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:01.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.389+0000 7f0716e52640 1 --2- 172.21.15.98:0/3637581905 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f071015e0d0 0x7f0710152b80 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:01.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.389+0000 7f0716e52640 1 --2- 172.21.15.98:0/3637581905 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07100d2050 0x7f0710160730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:01.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.389+0000 7f0716e52640 1 --2- 172.21.15.98:0/3637581905 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f07100d1440 0x7f07100b18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:01.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.389+0000 7f0716e52640 1 -- 172.21.15.98:0/3637581905 >> 172.21.15.98:0/3637581905 conn(0x7f07100d3fe0 msgr2=0x7f07100b3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:01.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.390+0000 7f0716e52640 1 -- 172.21.15.98:0/3637581905 shutdown_connections 2024-09-17T05:23:01.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:00.390+0000 7f0716e52640 1 -- 172.21.15.98:0/3637581905 wait complete. 2024-09-17T05:23:01.538 DEBUG:tasks.check_counter:Getting stats from x 2024-09-17T05:23:01.538 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mgr.x.asok perf dump 2024-09-17T05:23:01.652 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-17T05:23:01.652 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-0": { 2024-09-17T05:23:01.652 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 263, 2024-09-17T05:23:01.652 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 172, 2024-09-17T05:23:01.652 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 2241426, 2024-09-17T05:23:01.652 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 134253, 2024-09-17T05:23:01.652 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 65, 2024-09-17T05:23:01.653 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 20, 2024-09-17T05:23:01.653 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 0.055724615, 2024-09-17T05:23:01.653 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 0.006870283, 2024-09-17T05:23:01.653 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 0.051574955, 2024-09-17T05:23:01.653 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.000021901, 2024-09-17T05:23:01.653 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2024-09-17T05:23:01.653 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 155, 2024-09-17T05:23:01.653 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.011617513, 2024-09-17T05:23:01.653 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000074951 2024-09-17T05:23:01.653 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.653 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2024-09-17T05:23:01.653 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 205, 2024-09-17T05:23:01.653 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000029705, 2024-09-17T05:23:01.654 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000144 2024-09-17T05:23:01.654 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.654 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 2240544, 2024-09-17T05:23:01.654 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 133744 2024-09-17T05:23:01.654 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.654 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-1": { 2024-09-17T05:23:01.654 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 421, 2024-09-17T05:23:01.654 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 213, 2024-09-17T05:23:01.654 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 2792592, 2024-09-17T05:23:01.654 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 573200, 2024-09-17T05:23:01.654 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 108, 2024-09-17T05:23:01.654 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 17, 2024-09-17T05:23:01.654 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 0.076009864, 2024-09-17T05:23:01.655 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 0.009804543, 2024-09-17T05:23:01.655 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 0.079287464, 2024-09-17T05:23:01.655 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.000078010, 2024-09-17T05:23:01.655 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2024-09-17T05:23:01.655 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 198, 2024-09-17T05:23:01.655 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.017915190, 2024-09-17T05:23:01.655 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000090480 2024-09-17T05:23:01.655 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.655 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2024-09-17T05:23:01.655 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 296, 2024-09-17T05:23:01.655 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000042233, 2024-09-17T05:23:01.655 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000142 2024-09-17T05:23:01.655 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.656 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 2792592, 2024-09-17T05:23:01.656 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 573200 2024-09-17T05:23:01.656 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.656 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-2": { 2024-09-17T05:23:01.656 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 613, 2024-09-17T05:23:01.656 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 428, 2024-09-17T05:23:01.656 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 3183728, 2024-09-17T05:23:01.656 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 4937488, 2024-09-17T05:23:01.656 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 99, 2024-09-17T05:23:01.656 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 20, 2024-09-17T05:23:01.656 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 0.114596529, 2024-09-17T05:23:01.656 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 0.027111547, 2024-09-17T05:23:01.656 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 0.108458941, 2024-09-17T05:23:01.657 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.001678383, 2024-09-17T05:23:01.657 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2024-09-17T05:23:01.657 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 418, 2024-09-17T05:23:01.657 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.038183235, 2024-09-17T05:23:01.657 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000091347 2024-09-17T05:23:01.657 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.657 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2024-09-17T05:23:01.657 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.657 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.657 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.657 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.657 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 3183728, 2024-09-17T05:23:01.657 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 4937488 2024-09-17T05:23:01.658 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.658 INFO:teuthology.orchestra.run.smithi167.stdout: "cct": { 2024-09-17T05:23:01.658 INFO:teuthology.orchestra.run.smithi167.stdout: "total_workers": 0, 2024-09-17T05:23:01.658 INFO:teuthology.orchestra.run.smithi167.stdout: "unhealthy_workers": 0 2024-09-17T05:23:01.658 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.658 INFO:teuthology.orchestra.run.smithi167.stdout: "client": { 2024-09-17T05:23:01.658 INFO:teuthology.orchestra.run.smithi167.stdout: "reply": { 2024-09-17T05:23:01.658 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.658 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.658 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.658 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.658 INFO:teuthology.orchestra.run.smithi167.stdout: "lat": { 2024-09-17T05:23:01.658 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.659 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.659 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.659 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.659 INFO:teuthology.orchestra.run.smithi167.stdout: "wrlat": { 2024-09-17T05:23:01.659 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.659 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.659 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.659 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.659 INFO:teuthology.orchestra.run.smithi167.stdout: "rdlat": { 2024-09-17T05:23:01.659 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.659 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.659 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.659 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.659 INFO:teuthology.orchestra.run.smithi167.stdout: "fsync": { 2024-09-17T05:23:01.660 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.660 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.660 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.660 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.660 INFO:teuthology.orchestra.run.smithi167.stdout: "mdavg": 0.000000000, 2024-09-17T05:23:01.660 INFO:teuthology.orchestra.run.smithi167.stdout: "mdsqsum": 0, 2024-09-17T05:23:01.660 INFO:teuthology.orchestra.run.smithi167.stdout: "mdops": 0, 2024-09-17T05:23:01.660 INFO:teuthology.orchestra.run.smithi167.stdout: "readavg": 0.000000000, 2024-09-17T05:23:01.660 INFO:teuthology.orchestra.run.smithi167.stdout: "readsqsum": 0, 2024-09-17T05:23:01.660 INFO:teuthology.orchestra.run.smithi167.stdout: "rdops": 0, 2024-09-17T05:23:01.660 INFO:teuthology.orchestra.run.smithi167.stdout: "writeavg": 0.000000000, 2024-09-17T05:23:01.660 INFO:teuthology.orchestra.run.smithi167.stdout: "writesqsum": 0, 2024-09-17T05:23:01.660 INFO:teuthology.orchestra.run.smithi167.stdout: "rdops": 0 2024-09-17T05:23:01.661 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.661 INFO:teuthology.orchestra.run.smithi167.stdout: "client-0x55ddde3d9900": { 2024-09-17T05:23:01.661 INFO:teuthology.orchestra.run.smithi167.stdout: "reply": { 2024-09-17T05:23:01.661 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 71, 2024-09-17T05:23:01.661 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 3.155327671, 2024-09-17T05:23:01.661 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.044441234 2024-09-17T05:23:01.661 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.661 INFO:teuthology.orchestra.run.smithi167.stdout: "lat": { 2024-09-17T05:23:01.661 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 71, 2024-09-17T05:23:01.661 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 3.155327671, 2024-09-17T05:23:01.661 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.044441234 2024-09-17T05:23:01.661 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.661 INFO:teuthology.orchestra.run.smithi167.stdout: "wrlat": { 2024-09-17T05:23:01.662 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 18, 2024-09-17T05:23:01.662 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000445548, 2024-09-17T05:23:01.662 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000024752 2024-09-17T05:23:01.662 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.662 INFO:teuthology.orchestra.run.smithi167.stdout: "rdlat": { 2024-09-17T05:23:01.662 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 18, 2024-09-17T05:23:01.662 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000536402, 2024-09-17T05:23:01.662 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000029800 2024-09-17T05:23:01.662 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.662 INFO:teuthology.orchestra.run.smithi167.stdout: "fsync": { 2024-09-17T05:23:01.662 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 3, 2024-09-17T05:23:01.662 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.010730491, 2024-09-17T05:23:01.662 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.003576830 2024-09-17T05:23:01.662 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.663 INFO:teuthology.orchestra.run.smithi167.stdout: "mdavg": 0.044441217, 2024-09-17T05:23:01.663 INFO:teuthology.orchestra.run.smithi167.stdout: "mdsqsum": 9255729393681256448, 2024-09-17T05:23:01.663 INFO:teuthology.orchestra.run.smithi167.stdout: "mdops": 71, 2024-09-17T05:23:01.663 INFO:teuthology.orchestra.run.smithi167.stdout: "readavg": 0.000029796, 2024-09-17T05:23:01.663 INFO:teuthology.orchestra.run.smithi167.stdout: "readsqsum": 906085119, 2024-09-17T05:23:01.663 INFO:teuthology.orchestra.run.smithi167.stdout: "rdops": 18, 2024-09-17T05:23:01.663 INFO:teuthology.orchestra.run.smithi167.stdout: "writeavg": 0.000024748, 2024-09-17T05:23:01.663 INFO:teuthology.orchestra.run.smithi167.stdout: "writesqsum": 3235090113, 2024-09-17T05:23:01.663 INFO:teuthology.orchestra.run.smithi167.stdout: "rdops": 18 2024-09-17T05:23:01.663 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.663 INFO:teuthology.orchestra.run.smithi167.stdout: "client-0x55dddebfe320": { 2024-09-17T05:23:01.663 INFO:teuthology.orchestra.run.smithi167.stdout: "reply": { 2024-09-17T05:23:01.663 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 53, 2024-09-17T05:23:01.664 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.066518301, 2024-09-17T05:23:01.664 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.001255062 2024-09-17T05:23:01.664 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.664 INFO:teuthology.orchestra.run.smithi167.stdout: "lat": { 2024-09-17T05:23:01.664 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 53, 2024-09-17T05:23:01.664 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.066518301, 2024-09-17T05:23:01.664 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.001255062 2024-09-17T05:23:01.664 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.664 INFO:teuthology.orchestra.run.smithi167.stdout: "wrlat": { 2024-09-17T05:23:01.664 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.664 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.664 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.664 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.665 INFO:teuthology.orchestra.run.smithi167.stdout: "rdlat": { 2024-09-17T05:23:01.665 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.665 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.665 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.665 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.665 INFO:teuthology.orchestra.run.smithi167.stdout: "fsync": { 2024-09-17T05:23:01.665 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.665 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.665 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.665 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.665 INFO:teuthology.orchestra.run.smithi167.stdout: "mdavg": 0.001255049, 2024-09-17T05:23:01.665 INFO:teuthology.orchestra.run.smithi167.stdout: "mdsqsum": 127397027551630, 2024-09-17T05:23:01.665 INFO:teuthology.orchestra.run.smithi167.stdout: "mdops": 53, 2024-09-17T05:23:01.666 INFO:teuthology.orchestra.run.smithi167.stdout: "readavg": 0.000000000, 2024-09-17T05:23:01.666 INFO:teuthology.orchestra.run.smithi167.stdout: "readsqsum": 0, 2024-09-17T05:23:01.666 INFO:teuthology.orchestra.run.smithi167.stdout: "rdops": 0, 2024-09-17T05:23:01.666 INFO:teuthology.orchestra.run.smithi167.stdout: "writeavg": 0.000000000, 2024-09-17T05:23:01.666 INFO:teuthology.orchestra.run.smithi167.stdout: "writesqsum": 0, 2024-09-17T05:23:01.666 INFO:teuthology.orchestra.run.smithi167.stdout: "rdops": 0 2024-09-17T05:23:01.666 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.666 INFO:teuthology.orchestra.run.smithi167.stdout: "client-0x55dddebfe960": { 2024-09-17T05:23:01.666 INFO:teuthology.orchestra.run.smithi167.stdout: "reply": { 2024-09-17T05:23:01.666 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 22, 2024-09-17T05:23:01.666 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 3.394062049, 2024-09-17T05:23:01.666 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.154275547 2024-09-17T05:23:01.666 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.666 INFO:teuthology.orchestra.run.smithi167.stdout: "lat": { 2024-09-17T05:23:01.667 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 22, 2024-09-17T05:23:01.667 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 3.394062049, 2024-09-17T05:23:01.667 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.154275547 2024-09-17T05:23:01.667 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.667 INFO:teuthology.orchestra.run.smithi167.stdout: "wrlat": { 2024-09-17T05:23:01.667 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.667 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.667 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.667 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.667 INFO:teuthology.orchestra.run.smithi167.stdout: "rdlat": { 2024-09-17T05:23:01.667 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.667 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.667 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.668 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.668 INFO:teuthology.orchestra.run.smithi167.stdout: "fsync": { 2024-09-17T05:23:01.668 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.668 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.668 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.668 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.668 INFO:teuthology.orchestra.run.smithi167.stdout: "mdavg": 0.154275543, 2024-09-17T05:23:01.668 INFO:teuthology.orchestra.run.smithi167.stdout: "mdsqsum": 10864852012217405440, 2024-09-17T05:23:01.668 INFO:teuthology.orchestra.run.smithi167.stdout: "mdops": 22, 2024-09-17T05:23:01.668 INFO:teuthology.orchestra.run.smithi167.stdout: "readavg": 0.000000000, 2024-09-17T05:23:01.668 INFO:teuthology.orchestra.run.smithi167.stdout: "readsqsum": 0, 2024-09-17T05:23:01.668 INFO:teuthology.orchestra.run.smithi167.stdout: "rdops": 0, 2024-09-17T05:23:01.668 INFO:teuthology.orchestra.run.smithi167.stdout: "writeavg": 0.000000000, 2024-09-17T05:23:01.669 INFO:teuthology.orchestra.run.smithi167.stdout: "writesqsum": 0, 2024-09-17T05:23:01.669 INFO:teuthology.orchestra.run.smithi167.stdout: "rdops": 0 2024-09-17T05:23:01.669 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.669 INFO:teuthology.orchestra.run.smithi167.stdout: "finisher-Mgr": { 2024-09-17T05:23:01.669 INFO:teuthology.orchestra.run.smithi167.stdout: "queue_len": 0, 2024-09-17T05:23:01.669 INFO:teuthology.orchestra.run.smithi167.stdout: "complete_latency": { 2024-09-17T05:23:01.669 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 2, 2024-09-17T05:23:01.669 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.034342468, 2024-09-17T05:23:01.669 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.017171234 2024-09-17T05:23:01.669 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-17T05:23:01.669 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.669 INFO:teuthology.orchestra.run.smithi167.stdout: "finisher-MgrStandby": { 2024-09-17T05:23:01.669 INFO:teuthology.orchestra.run.smithi167.stdout: "queue_len": 0, 2024-09-17T05:23:01.669 INFO:teuthology.orchestra.run.smithi167.stdout: "complete_latency": { 2024-09-17T05:23:01.670 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.670 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.670 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.670 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-17T05:23:01.670 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.670 INFO:teuthology.orchestra.run.smithi167.stdout: "finisher-balancer": { 2024-09-17T05:23:01.670 INFO:teuthology.orchestra.run.smithi167.stdout: "queue_len": 0, 2024-09-17T05:23:01.670 INFO:teuthology.orchestra.run.smithi167.stdout: "complete_latency": { 2024-09-17T05:23:01.670 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.670 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.670 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.670 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-17T05:23:01.670 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.671 INFO:teuthology.orchestra.run.smithi167.stdout: "finisher-cmd_finisher": { 2024-09-17T05:23:01.671 INFO:teuthology.orchestra.run.smithi167.stdout: "queue_len": 0, 2024-09-17T05:23:01.671 INFO:teuthology.orchestra.run.smithi167.stdout: "complete_latency": { 2024-09-17T05:23:01.671 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 13, 2024-09-17T05:23:01.671 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000722098, 2024-09-17T05:23:01.671 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000055546 2024-09-17T05:23:01.671 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-17T05:23:01.671 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.671 INFO:teuthology.orchestra.run.smithi167.stdout: "finisher-crash": { 2024-09-17T05:23:01.671 INFO:teuthology.orchestra.run.smithi167.stdout: "queue_len": 0, 2024-09-17T05:23:01.671 INFO:teuthology.orchestra.run.smithi167.stdout: "complete_latency": { 2024-09-17T05:23:01.671 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.671 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.672 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.672 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-17T05:23:01.672 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.672 INFO:teuthology.orchestra.run.smithi167.stdout: "finisher-devicehealth": { 2024-09-17T05:23:01.672 INFO:teuthology.orchestra.run.smithi167.stdout: "queue_len": 0, 2024-09-17T05:23:01.672 INFO:teuthology.orchestra.run.smithi167.stdout: "complete_latency": { 2024-09-17T05:23:01.672 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.672 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.672 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.672 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-17T05:23:01.672 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.672 INFO:teuthology.orchestra.run.smithi167.stdout: "finisher-iostat": { 2024-09-17T05:23:01.672 INFO:teuthology.orchestra.run.smithi167.stdout: "queue_len": 0, 2024-09-17T05:23:01.673 INFO:teuthology.orchestra.run.smithi167.stdout: "complete_latency": { 2024-09-17T05:23:01.673 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.673 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.673 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.673 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-17T05:23:01.673 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.673 INFO:teuthology.orchestra.run.smithi167.stdout: "finisher-nfs": { 2024-09-17T05:23:01.673 INFO:teuthology.orchestra.run.smithi167.stdout: "queue_len": 0, 2024-09-17T05:23:01.673 INFO:teuthology.orchestra.run.smithi167.stdout: "complete_latency": { 2024-09-17T05:23:01.673 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.673 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.673 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.673 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-17T05:23:01.673 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.674 INFO:teuthology.orchestra.run.smithi167.stdout: "finisher-orchestrator": { 2024-09-17T05:23:01.674 INFO:teuthology.orchestra.run.smithi167.stdout: "queue_len": 0, 2024-09-17T05:23:01.674 INFO:teuthology.orchestra.run.smithi167.stdout: "complete_latency": { 2024-09-17T05:23:01.674 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.674 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.674 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.674 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-17T05:23:01.674 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.674 INFO:teuthology.orchestra.run.smithi167.stdout: "finisher-pg_autoscaler": { 2024-09-17T05:23:01.674 INFO:teuthology.orchestra.run.smithi167.stdout: "queue_len": 0, 2024-09-17T05:23:01.674 INFO:teuthology.orchestra.run.smithi167.stdout: "complete_latency": { 2024-09-17T05:23:01.674 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.674 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.675 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.675 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-17T05:23:01.675 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.675 INFO:teuthology.orchestra.run.smithi167.stdout: "finisher-progress": { 2024-09-17T05:23:01.675 INFO:teuthology.orchestra.run.smithi167.stdout: "queue_len": 0, 2024-09-17T05:23:01.675 INFO:teuthology.orchestra.run.smithi167.stdout: "complete_latency": { 2024-09-17T05:23:01.675 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.675 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.675 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.675 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-17T05:23:01.675 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.675 INFO:teuthology.orchestra.run.smithi167.stdout: "finisher-rbd_support": { 2024-09-17T05:23:01.675 INFO:teuthology.orchestra.run.smithi167.stdout: "queue_len": 0, 2024-09-17T05:23:01.676 INFO:teuthology.orchestra.run.smithi167.stdout: "complete_latency": { 2024-09-17T05:23:01.676 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.676 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.676 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.676 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-17T05:23:01.676 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.676 INFO:teuthology.orchestra.run.smithi167.stdout: "finisher-restful": { 2024-09-17T05:23:01.676 INFO:teuthology.orchestra.run.smithi167.stdout: "queue_len": 0, 2024-09-17T05:23:01.676 INFO:teuthology.orchestra.run.smithi167.stdout: "complete_latency": { 2024-09-17T05:23:01.676 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 13, 2024-09-17T05:23:01.676 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.002723188, 2024-09-17T05:23:01.676 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000209476 2024-09-17T05:23:01.677 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-17T05:23:01.677 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.677 INFO:teuthology.orchestra.run.smithi167.stdout: "finisher-status": { 2024-09-17T05:23:01.677 INFO:teuthology.orchestra.run.smithi167.stdout: "queue_len": 0, 2024-09-17T05:23:01.677 INFO:teuthology.orchestra.run.smithi167.stdout: "complete_latency": { 2024-09-17T05:23:01.677 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.677 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.677 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.677 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-17T05:23:01.677 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.677 INFO:teuthology.orchestra.run.smithi167.stdout: "finisher-telemetry": { 2024-09-17T05:23:01.677 INFO:teuthology.orchestra.run.smithi167.stdout: "queue_len": 0, 2024-09-17T05:23:01.677 INFO:teuthology.orchestra.run.smithi167.stdout: "complete_latency": { 2024-09-17T05:23:01.677 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.678 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.678 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.678 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-17T05:23:01.678 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.678 INFO:teuthology.orchestra.run.smithi167.stdout: "finisher-volumes": { 2024-09-17T05:23:01.678 INFO:teuthology.orchestra.run.smithi167.stdout: "queue_len": 0, 2024-09-17T05:23:01.678 INFO:teuthology.orchestra.run.smithi167.stdout: "complete_latency": { 2024-09-17T05:23:01.678 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 9, 2024-09-17T05:23:01.678 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 3.210157083, 2024-09-17T05:23:01.678 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.356684120 2024-09-17T05:23:01.678 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-17T05:23:01.678 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.678 INFO:teuthology.orchestra.run.smithi167.stdout: "libcephsqlite_striper": { 2024-09-17T05:23:01.679 INFO:teuthology.orchestra.run.smithi167.stdout: "update_metadata": 5, 2024-09-17T05:23:01.679 INFO:teuthology.orchestra.run.smithi167.stdout: "update_allocated": 2, 2024-09-17T05:23:01.679 INFO:teuthology.orchestra.run.smithi167.stdout: "update_size": 3, 2024-09-17T05:23:01.679 INFO:teuthology.orchestra.run.smithi167.stdout: "update_version": 5, 2024-09-17T05:23:01.679 INFO:teuthology.orchestra.run.smithi167.stdout: "shrink": 0, 2024-09-17T05:23:01.679 INFO:teuthology.orchestra.run.smithi167.stdout: "shrink_bytes": 0, 2024-09-17T05:23:01.679 INFO:teuthology.orchestra.run.smithi167.stdout: "lock": 6, 2024-09-17T05:23:01.679 INFO:teuthology.orchestra.run.smithi167.stdout: "unlock": 6 2024-09-17T05:23:01.679 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.679 INFO:teuthology.orchestra.run.smithi167.stdout: "libcephsqlite_vfs": { 2024-09-17T05:23:01.679 INFO:teuthology.orchestra.run.smithi167.stdout: "op_open": { 2024-09-17T05:23:01.679 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 2, 2024-09-17T05:23:01.679 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.155997330, 2024-09-17T05:23:01.680 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.077998665 2024-09-17T05:23:01.680 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.680 INFO:teuthology.orchestra.run.smithi167.stdout: "op_delete": { 2024-09-17T05:23:01.680 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.680 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.680 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.680 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.680 INFO:teuthology.orchestra.run.smithi167.stdout: "op_access": { 2024-09-17T05:23:01.680 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.680 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.681 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.681 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.681 INFO:teuthology.orchestra.run.smithi167.stdout: "op_fullpathname": { 2024-09-17T05:23:01.681 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 1, 2024-09-17T05:23:01.681 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.681 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.681 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.681 INFO:teuthology.orchestra.run.smithi167.stdout: "op_currenttime": { 2024-09-17T05:23:01.681 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 4, 2024-09-17T05:23:01.681 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.681 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.681 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.681 INFO:teuthology.orchestra.run.smithi167.stdout: "opf_close": { 2024-09-17T05:23:01.682 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.682 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.682 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.682 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.682 INFO:teuthology.orchestra.run.smithi167.stdout: "opf_read": { 2024-09-17T05:23:01.682 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 10, 2024-09-17T05:23:01.682 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.004999915, 2024-09-17T05:23:01.682 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000499991 2024-09-17T05:23:01.682 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.682 INFO:teuthology.orchestra.run.smithi167.stdout: "opf_write": { 2024-09-17T05:23:01.682 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 53, 2024-09-17T05:23:01.682 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.006999881, 2024-09-17T05:23:01.682 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000132073 2024-09-17T05:23:01.682 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.683 INFO:teuthology.orchestra.run.smithi167.stdout: "opf_truncate": { 2024-09-17T05:23:01.683 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.683 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.683 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.683 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.683 INFO:teuthology.orchestra.run.smithi167.stdout: "opf_sync": { 2024-09-17T05:23:01.683 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 12, 2024-09-17T05:23:01.683 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.041999282, 2024-09-17T05:23:01.683 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.003499940 2024-09-17T05:23:01.683 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.683 INFO:teuthology.orchestra.run.smithi167.stdout: "opf_filesize": { 2024-09-17T05:23:01.683 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 10, 2024-09-17T05:23:01.683 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.684 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.684 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.684 INFO:teuthology.orchestra.run.smithi167.stdout: "opf_lock": { 2024-09-17T05:23:01.684 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 14, 2024-09-17T05:23:01.684 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.011999794, 2024-09-17T05:23:01.684 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000857128 2024-09-17T05:23:01.684 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.684 INFO:teuthology.orchestra.run.smithi167.stdout: "opf_unlock": { 2024-09-17T05:23:01.684 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 10, 2024-09-17T05:23:01.684 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.007999865, 2024-09-17T05:23:01.684 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000799986 2024-09-17T05:23:01.684 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.684 INFO:teuthology.orchestra.run.smithi167.stdout: "opf_checkreservedlock": { 2024-09-17T05:23:01.685 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 4, 2024-09-17T05:23:01.685 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.685 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.685 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.685 INFO:teuthology.orchestra.run.smithi167.stdout: "opf_filecontrol": { 2024-09-17T05:23:01.685 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 16, 2024-09-17T05:23:01.685 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.685 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.685 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.685 INFO:teuthology.orchestra.run.smithi167.stdout: "opf_sectorsize": { 2024-09-17T05:23:01.685 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.685 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.685 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.686 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.686 INFO:teuthology.orchestra.run.smithi167.stdout: "opf_devicecharacteristics": { 2024-09-17T05:23:01.686 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 17, 2024-09-17T05:23:01.686 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.686 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.686 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-17T05:23:01.686 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.686 INFO:teuthology.orchestra.run.smithi167.stdout: "mempool": { 2024-09-17T05:23:01.686 INFO:teuthology.orchestra.run.smithi167.stdout: "bloom_filter_bytes": 0, 2024-09-17T05:23:01.686 INFO:teuthology.orchestra.run.smithi167.stdout: "bloom_filter_items": 0, 2024-09-17T05:23:01.686 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_alloc_bytes": 0, 2024-09-17T05:23:01.686 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_alloc_items": 0, 2024-09-17T05:23:01.686 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_data_bytes": 0, 2024-09-17T05:23:01.687 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_data_items": 0, 2024-09-17T05:23:01.687 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-17T05:23:01.687 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_onode_items": 0, 2024-09-17T05:23:01.687 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-17T05:23:01.687 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_meta_items": 0, 2024-09-17T05:23:01.687 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_other_bytes": 0, 2024-09-17T05:23:01.687 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_other_items": 0, 2024-09-17T05:23:01.687 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-17T05:23:01.687 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_buffer_items": 0, 2024-09-17T05:23:01.687 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_extent_bytes": 0, 2024-09-17T05:23:01.687 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_extent_items": 0, 2024-09-17T05:23:01.687 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_blob_bytes": 0, 2024-09-17T05:23:01.687 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_blob_items": 0, 2024-09-17T05:23:01.688 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-17T05:23:01.688 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_shared_blob_items": 0, 2024-09-17T05:23:01.688 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-17T05:23:01.688 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_inline_bl_items": 0, 2024-09-17T05:23:01.688 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_fsck_bytes": 0, 2024-09-17T05:23:01.688 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_fsck_items": 0, 2024-09-17T05:23:01.688 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_txc_bytes": 0, 2024-09-17T05:23:01.688 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_txc_items": 0, 2024-09-17T05:23:01.688 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-17T05:23:01.688 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_deferred_items": 0, 2024-09-17T05:23:01.688 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_bytes": 0, 2024-09-17T05:23:01.688 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_items": 0, 2024-09-17T05:23:01.688 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_bytes": 0, 2024-09-17T05:23:01.689 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_items": 0, 2024-09-17T05:23:01.689 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_reader_bytes": 0, 2024-09-17T05:23:01.689 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_reader_items": 0, 2024-09-17T05:23:01.689 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_writer_bytes": 0, 2024-09-17T05:23:01.689 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_writer_items": 0, 2024-09-17T05:23:01.689 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_anon_bytes": 1695385, 2024-09-17T05:23:01.689 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_anon_items": 322, 2024-09-17T05:23:01.689 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_meta_bytes": 1496, 2024-09-17T05:23:01.689 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_meta_items": 17, 2024-09-17T05:23:01.689 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_bytes": 0, 2024-09-17T05:23:01.689 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_items": 0, 2024-09-17T05:23:01.689 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_mapbl_bytes": 0, 2024-09-17T05:23:01.689 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_mapbl_items": 0, 2024-09-17T05:23:01.689 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_pglog_bytes": 0, 2024-09-17T05:23:01.690 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_pglog_items": 0, 2024-09-17T05:23:01.690 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_bytes": 48184, 2024-09-17T05:23:01.690 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_items": 822, 2024-09-17T05:23:01.690 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_mapping_bytes": 0, 2024-09-17T05:23:01.690 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_mapping_items": 0, 2024-09-17T05:23:01.690 INFO:teuthology.orchestra.run.smithi167.stdout: "pgmap_bytes": 12992, 2024-09-17T05:23:01.690 INFO:teuthology.orchestra.run.smithi167.stdout: "pgmap_items": 311, 2024-09-17T05:23:01.690 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_co_bytes": 0, 2024-09-17T05:23:01.690 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_co_items": 0, 2024-09-17T05:23:01.690 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_1_bytes": 0, 2024-09-17T05:23:01.690 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_1_items": 0, 2024-09-17T05:23:01.690 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_2_bytes": 0, 2024-09-17T05:23:01.690 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_2_items": 0 2024-09-17T05:23:01.691 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.691 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": { 2024-09-17T05:23:01.691 INFO:teuthology.orchestra.run.smithi167.stdout: "cache_hit": 0, 2024-09-17T05:23:01.691 INFO:teuthology.orchestra.run.smithi167.stdout: "cache_miss": 0 2024-09-17T05:23:01.691 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.691 INFO:teuthology.orchestra.run.smithi167.stdout: "objectcacher-libcephfs": { 2024-09-17T05:23:01.691 INFO:teuthology.orchestra.run.smithi167.stdout: "cache_ops_hit": 0, 2024-09-17T05:23:01.691 INFO:teuthology.orchestra.run.smithi167.stdout: "cache_ops_miss": 0, 2024-09-17T05:23:01.691 INFO:teuthology.orchestra.run.smithi167.stdout: "cache_bytes_hit": 0, 2024-09-17T05:23:01.691 INFO:teuthology.orchestra.run.smithi167.stdout: "cache_bytes_miss": 0, 2024-09-17T05:23:01.691 INFO:teuthology.orchestra.run.smithi167.stdout: "data_read": 0, 2024-09-17T05:23:01.691 INFO:teuthology.orchestra.run.smithi167.stdout: "data_written": 0, 2024-09-17T05:23:01.691 INFO:teuthology.orchestra.run.smithi167.stdout: "data_flushed": 0, 2024-09-17T05:23:01.691 INFO:teuthology.orchestra.run.smithi167.stdout: "data_overwritten_while_flushing": 0, 2024-09-17T05:23:01.692 INFO:teuthology.orchestra.run.smithi167.stdout: "write_ops_blocked": 0, 2024-09-17T05:23:01.692 INFO:teuthology.orchestra.run.smithi167.stdout: "write_bytes_blocked": 0, 2024-09-17T05:23:01.692 INFO:teuthology.orchestra.run.smithi167.stdout: "write_time_blocked": 0.000000000 2024-09-17T05:23:01.692 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.692 INFO:teuthology.orchestra.run.smithi167.stdout: "objectcacher-libcephfs-0x55ddde3d97c0": { 2024-09-17T05:23:01.692 INFO:teuthology.orchestra.run.smithi167.stdout: "cache_ops_hit": 9, 2024-09-17T05:23:01.692 INFO:teuthology.orchestra.run.smithi167.stdout: "cache_ops_miss": 0, 2024-09-17T05:23:01.692 INFO:teuthology.orchestra.run.smithi167.stdout: "cache_bytes_hit": 1230, 2024-09-17T05:23:01.692 INFO:teuthology.orchestra.run.smithi167.stdout: "cache_bytes_miss": 0, 2024-09-17T05:23:01.692 INFO:teuthology.orchestra.run.smithi167.stdout: "data_read": 1230, 2024-09-17T05:23:01.692 INFO:teuthology.orchestra.run.smithi167.stdout: "data_written": 410, 2024-09-17T05:23:01.692 INFO:teuthology.orchestra.run.smithi167.stdout: "data_flushed": 410, 2024-09-17T05:23:01.693 INFO:teuthology.orchestra.run.smithi167.stdout: "data_overwritten_while_flushing": 0, 2024-09-17T05:23:01.693 INFO:teuthology.orchestra.run.smithi167.stdout: "write_ops_blocked": 0, 2024-09-17T05:23:01.693 INFO:teuthology.orchestra.run.smithi167.stdout: "write_bytes_blocked": 0, 2024-09-17T05:23:01.693 INFO:teuthology.orchestra.run.smithi167.stdout: "write_time_blocked": 0.000000000 2024-09-17T05:23:01.693 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.693 INFO:teuthology.orchestra.run.smithi167.stdout: "objectcacher-libcephfs-0x55dddebfe280": { 2024-09-17T05:23:01.693 INFO:teuthology.orchestra.run.smithi167.stdout: "cache_ops_hit": 0, 2024-09-17T05:23:01.693 INFO:teuthology.orchestra.run.smithi167.stdout: "cache_ops_miss": 0, 2024-09-17T05:23:01.693 INFO:teuthology.orchestra.run.smithi167.stdout: "cache_bytes_hit": 0, 2024-09-17T05:23:01.693 INFO:teuthology.orchestra.run.smithi167.stdout: "cache_bytes_miss": 0, 2024-09-17T05:23:01.693 INFO:teuthology.orchestra.run.smithi167.stdout: "data_read": 0, 2024-09-17T05:23:01.693 INFO:teuthology.orchestra.run.smithi167.stdout: "data_written": 0, 2024-09-17T05:23:01.693 INFO:teuthology.orchestra.run.smithi167.stdout: "data_flushed": 0, 2024-09-17T05:23:01.694 INFO:teuthology.orchestra.run.smithi167.stdout: "data_overwritten_while_flushing": 0, 2024-09-17T05:23:01.694 INFO:teuthology.orchestra.run.smithi167.stdout: "write_ops_blocked": 0, 2024-09-17T05:23:01.694 INFO:teuthology.orchestra.run.smithi167.stdout: "write_bytes_blocked": 0, 2024-09-17T05:23:01.694 INFO:teuthology.orchestra.run.smithi167.stdout: "write_time_blocked": 0.000000000 2024-09-17T05:23:01.694 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.694 INFO:teuthology.orchestra.run.smithi167.stdout: "objectcacher-libcephfs-0x55dddebfe820": { 2024-09-17T05:23:01.694 INFO:teuthology.orchestra.run.smithi167.stdout: "cache_ops_hit": 0, 2024-09-17T05:23:01.694 INFO:teuthology.orchestra.run.smithi167.stdout: "cache_ops_miss": 0, 2024-09-17T05:23:01.694 INFO:teuthology.orchestra.run.smithi167.stdout: "cache_bytes_hit": 0, 2024-09-17T05:23:01.694 INFO:teuthology.orchestra.run.smithi167.stdout: "cache_bytes_miss": 0, 2024-09-17T05:23:01.694 INFO:teuthology.orchestra.run.smithi167.stdout: "data_read": 0, 2024-09-17T05:23:01.694 INFO:teuthology.orchestra.run.smithi167.stdout: "data_written": 0, 2024-09-17T05:23:01.694 INFO:teuthology.orchestra.run.smithi167.stdout: "data_flushed": 0, 2024-09-17T05:23:01.694 INFO:teuthology.orchestra.run.smithi167.stdout: "data_overwritten_while_flushing": 0, 2024-09-17T05:23:01.695 INFO:teuthology.orchestra.run.smithi167.stdout: "write_ops_blocked": 0, 2024-09-17T05:23:01.695 INFO:teuthology.orchestra.run.smithi167.stdout: "write_bytes_blocked": 0, 2024-09-17T05:23:01.695 INFO:teuthology.orchestra.run.smithi167.stdout: "write_time_blocked": 0.000000000 2024-09-17T05:23:01.695 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.695 INFO:teuthology.orchestra.run.smithi167.stdout: "objecter": { 2024-09-17T05:23:01.695 INFO:teuthology.orchestra.run.smithi167.stdout: "op_active": 0, 2024-09-17T05:23:01.695 INFO:teuthology.orchestra.run.smithi167.stdout: "op_laggy": 0, 2024-09-17T05:23:01.695 INFO:teuthology.orchestra.run.smithi167.stdout: "op_send": 0, 2024-09-17T05:23:01.695 INFO:teuthology.orchestra.run.smithi167.stdout: "op_send_bytes": 0, 2024-09-17T05:23:01.695 INFO:teuthology.orchestra.run.smithi167.stdout: "op_resend": 0, 2024-09-17T05:23:01.695 INFO:teuthology.orchestra.run.smithi167.stdout: "op_reply": 0, 2024-09-17T05:23:01.695 INFO:teuthology.orchestra.run.smithi167.stdout: "op_latency": { 2024-09-17T05:23:01.695 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.696 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.696 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.696 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.696 INFO:teuthology.orchestra.run.smithi167.stdout: "op_inflight": 0, 2024-09-17T05:23:01.696 INFO:teuthology.orchestra.run.smithi167.stdout: "oplen_avg": { 2024-09-17T05:23:01.696 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.696 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0 2024-09-17T05:23:01.696 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.696 INFO:teuthology.orchestra.run.smithi167.stdout: "op": 0, 2024-09-17T05:23:01.696 INFO:teuthology.orchestra.run.smithi167.stdout: "op_r": 0, 2024-09-17T05:23:01.696 INFO:teuthology.orchestra.run.smithi167.stdout: "op_w": 0, 2024-09-17T05:23:01.696 INFO:teuthology.orchestra.run.smithi167.stdout: "op_rmw": 0, 2024-09-17T05:23:01.696 INFO:teuthology.orchestra.run.smithi167.stdout: "op_pg": 0, 2024-09-17T05:23:01.697 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_stat": 0, 2024-09-17T05:23:01.697 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_create": 0, 2024-09-17T05:23:01.697 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_read": 0, 2024-09-17T05:23:01.697 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_write": 0, 2024-09-17T05:23:01.697 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_writefull": 0, 2024-09-17T05:23:01.697 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_writesame": 0, 2024-09-17T05:23:01.697 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_append": 0, 2024-09-17T05:23:01.697 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_zero": 0, 2024-09-17T05:23:01.697 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_truncate": 0, 2024-09-17T05:23:01.697 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_delete": 0, 2024-09-17T05:23:01.697 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_mapext": 0, 2024-09-17T05:23:01.697 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_sparse_read": 0, 2024-09-17T05:23:01.697 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_clonerange": 0, 2024-09-17T05:23:01.698 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_getxattr": 0, 2024-09-17T05:23:01.698 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_setxattr": 0, 2024-09-17T05:23:01.698 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_cmpxattr": 0, 2024-09-17T05:23:01.698 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_rmxattr": 0, 2024-09-17T05:23:01.698 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_resetxattrs": 0, 2024-09-17T05:23:01.698 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_call": 0, 2024-09-17T05:23:01.698 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_watch": 0, 2024-09-17T05:23:01.698 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_notify": 0, 2024-09-17T05:23:01.698 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_src_cmpxattr": 0, 2024-09-17T05:23:01.698 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_pgls": 0, 2024-09-17T05:23:01.698 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_pgls_filter": 0, 2024-09-17T05:23:01.698 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_other": 0, 2024-09-17T05:23:01.698 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_active": 0, 2024-09-17T05:23:01.699 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_send": 0, 2024-09-17T05:23:01.699 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_resend": 0, 2024-09-17T05:23:01.699 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_ping": 0, 2024-09-17T05:23:01.699 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_active": 0, 2024-09-17T05:23:01.699 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_send": 0, 2024-09-17T05:23:01.699 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_resend": 0, 2024-09-17T05:23:01.699 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_active": 0, 2024-09-17T05:23:01.699 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_send": 0, 2024-09-17T05:23:01.699 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_resend": 0, 2024-09-17T05:23:01.699 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_active": 0, 2024-09-17T05:23:01.699 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_send": 0, 2024-09-17T05:23:01.699 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_resend": 0, 2024-09-17T05:23:01.699 INFO:teuthology.orchestra.run.smithi167.stdout: "command_active": 0, 2024-09-17T05:23:01.700 INFO:teuthology.orchestra.run.smithi167.stdout: "command_send": 8, 2024-09-17T05:23:01.700 INFO:teuthology.orchestra.run.smithi167.stdout: "command_resend": 0, 2024-09-17T05:23:01.700 INFO:teuthology.orchestra.run.smithi167.stdout: "map_epoch": 35, 2024-09-17T05:23:01.700 INFO:teuthology.orchestra.run.smithi167.stdout: "map_full": 0, 2024-09-17T05:23:01.700 INFO:teuthology.orchestra.run.smithi167.stdout: "map_inc": 34, 2024-09-17T05:23:01.700 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_sessions": 8, 2024-09-17T05:23:01.700 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_session_open": 8, 2024-09-17T05:23:01.700 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_session_close": 0, 2024-09-17T05:23:01.700 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_laggy": 0, 2024-09-17T05:23:01.700 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_wr": 0, 2024-09-17T05:23:01.700 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_rd": 0, 2024-09-17T05:23:01.700 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_del": 0 2024-09-17T05:23:01.700 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.701 INFO:teuthology.orchestra.run.smithi167.stdout: "objecter-0x55dddda6a0a0": { 2024-09-17T05:23:01.701 INFO:teuthology.orchestra.run.smithi167.stdout: "op_active": 0, 2024-09-17T05:23:01.701 INFO:teuthology.orchestra.run.smithi167.stdout: "op_laggy": 0, 2024-09-17T05:23:01.701 INFO:teuthology.orchestra.run.smithi167.stdout: "op_send": 0, 2024-09-17T05:23:01.701 INFO:teuthology.orchestra.run.smithi167.stdout: "op_send_bytes": 0, 2024-09-17T05:23:01.701 INFO:teuthology.orchestra.run.smithi167.stdout: "op_resend": 0, 2024-09-17T05:23:01.701 INFO:teuthology.orchestra.run.smithi167.stdout: "op_reply": 0, 2024-09-17T05:23:01.701 INFO:teuthology.orchestra.run.smithi167.stdout: "op_latency": { 2024-09-17T05:23:01.701 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.701 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.701 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.701 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.701 INFO:teuthology.orchestra.run.smithi167.stdout: "op_inflight": 0, 2024-09-17T05:23:01.702 INFO:teuthology.orchestra.run.smithi167.stdout: "oplen_avg": { 2024-09-17T05:23:01.702 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.702 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0 2024-09-17T05:23:01.702 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.702 INFO:teuthology.orchestra.run.smithi167.stdout: "op": 0, 2024-09-17T05:23:01.702 INFO:teuthology.orchestra.run.smithi167.stdout: "op_r": 0, 2024-09-17T05:23:01.702 INFO:teuthology.orchestra.run.smithi167.stdout: "op_w": 0, 2024-09-17T05:23:01.702 INFO:teuthology.orchestra.run.smithi167.stdout: "op_rmw": 0, 2024-09-17T05:23:01.702 INFO:teuthology.orchestra.run.smithi167.stdout: "op_pg": 0, 2024-09-17T05:23:01.702 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_stat": 0, 2024-09-17T05:23:01.702 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_create": 0, 2024-09-17T05:23:01.702 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_read": 0, 2024-09-17T05:23:01.702 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_write": 0, 2024-09-17T05:23:01.703 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_writefull": 0, 2024-09-17T05:23:01.703 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_writesame": 0, 2024-09-17T05:23:01.703 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_append": 0, 2024-09-17T05:23:01.703 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_zero": 0, 2024-09-17T05:23:01.703 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_truncate": 0, 2024-09-17T05:23:01.703 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_delete": 0, 2024-09-17T05:23:01.703 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_mapext": 0, 2024-09-17T05:23:01.703 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_sparse_read": 0, 2024-09-17T05:23:01.703 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_clonerange": 0, 2024-09-17T05:23:01.703 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_getxattr": 0, 2024-09-17T05:23:01.703 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_setxattr": 0, 2024-09-17T05:23:01.704 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_cmpxattr": 0, 2024-09-17T05:23:01.704 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_rmxattr": 0, 2024-09-17T05:23:01.704 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_resetxattrs": 0, 2024-09-17T05:23:01.704 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_call": 0, 2024-09-17T05:23:01.704 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_watch": 0, 2024-09-17T05:23:01.704 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_notify": 0, 2024-09-17T05:23:01.704 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_src_cmpxattr": 0, 2024-09-17T05:23:01.704 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_pgls": 0, 2024-09-17T05:23:01.704 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_pgls_filter": 0, 2024-09-17T05:23:01.704 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_other": 0, 2024-09-17T05:23:01.704 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_active": 0, 2024-09-17T05:23:01.704 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_send": 0, 2024-09-17T05:23:01.704 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_resend": 0, 2024-09-17T05:23:01.705 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_ping": 0, 2024-09-17T05:23:01.705 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_active": 0, 2024-09-17T05:23:01.705 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_send": 0, 2024-09-17T05:23:01.705 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_resend": 0, 2024-09-17T05:23:01.705 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_active": 0, 2024-09-17T05:23:01.705 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_send": 0, 2024-09-17T05:23:01.705 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_resend": 0, 2024-09-17T05:23:01.705 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_active": 0, 2024-09-17T05:23:01.705 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_send": 0, 2024-09-17T05:23:01.705 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_resend": 0, 2024-09-17T05:23:01.705 INFO:teuthology.orchestra.run.smithi167.stdout: "command_active": 0, 2024-09-17T05:23:01.705 INFO:teuthology.orchestra.run.smithi167.stdout: "command_send": 0, 2024-09-17T05:23:01.705 INFO:teuthology.orchestra.run.smithi167.stdout: "command_resend": 0, 2024-09-17T05:23:01.706 INFO:teuthology.orchestra.run.smithi167.stdout: "map_epoch": 0, 2024-09-17T05:23:01.706 INFO:teuthology.orchestra.run.smithi167.stdout: "map_full": 0, 2024-09-17T05:23:01.706 INFO:teuthology.orchestra.run.smithi167.stdout: "map_inc": 0, 2024-09-17T05:23:01.706 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_sessions": 0, 2024-09-17T05:23:01.706 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_session_open": 0, 2024-09-17T05:23:01.706 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_session_close": 0, 2024-09-17T05:23:01.706 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_laggy": 0, 2024-09-17T05:23:01.706 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_wr": 0, 2024-09-17T05:23:01.706 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_rd": 0, 2024-09-17T05:23:01.706 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_del": 0 2024-09-17T05:23:01.706 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.706 INFO:teuthology.orchestra.run.smithi167.stdout: "objecter-0x55dddda6a5a0": { 2024-09-17T05:23:01.706 INFO:teuthology.orchestra.run.smithi167.stdout: "op_active": 0, 2024-09-17T05:23:01.707 INFO:teuthology.orchestra.run.smithi167.stdout: "op_laggy": 0, 2024-09-17T05:23:01.707 INFO:teuthology.orchestra.run.smithi167.stdout: "op_send": 98, 2024-09-17T05:23:01.707 INFO:teuthology.orchestra.run.smithi167.stdout: "op_send_bytes": 1643971, 2024-09-17T05:23:01.707 INFO:teuthology.orchestra.run.smithi167.stdout: "op_resend": 0, 2024-09-17T05:23:01.707 INFO:teuthology.orchestra.run.smithi167.stdout: "op_reply": 98, 2024-09-17T05:23:01.707 INFO:teuthology.orchestra.run.smithi167.stdout: "op_latency": { 2024-09-17T05:23:01.707 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 98, 2024-09-17T05:23:01.707 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.429992661, 2024-09-17T05:23:01.707 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.004387680 2024-09-17T05:23:01.707 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.707 INFO:teuthology.orchestra.run.smithi167.stdout: "op_inflight": 0, 2024-09-17T05:23:01.707 INFO:teuthology.orchestra.run.smithi167.stdout: "oplen_avg": { 2024-09-17T05:23:01.707 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 98, 2024-09-17T05:23:01.708 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 189 2024-09-17T05:23:01.708 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.708 INFO:teuthology.orchestra.run.smithi167.stdout: "op": 98, 2024-09-17T05:23:01.708 INFO:teuthology.orchestra.run.smithi167.stdout: "op_r": 26, 2024-09-17T05:23:01.708 INFO:teuthology.orchestra.run.smithi167.stdout: "op_w": 72, 2024-09-17T05:23:01.708 INFO:teuthology.orchestra.run.smithi167.stdout: "op_rmw": 0, 2024-09-17T05:23:01.708 INFO:teuthology.orchestra.run.smithi167.stdout: "op_pg": 0, 2024-09-17T05:23:01.708 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_stat": 0, 2024-09-17T05:23:01.708 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_create": 2, 2024-09-17T05:23:01.708 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_read": 10, 2024-09-17T05:23:01.708 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_write": 53, 2024-09-17T05:23:01.708 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_writefull": 0, 2024-09-17T05:23:01.708 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_writesame": 0, 2024-09-17T05:23:01.709 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_append": 0, 2024-09-17T05:23:01.709 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_zero": 0, 2024-09-17T05:23:01.709 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_truncate": 0, 2024-09-17T05:23:01.709 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_delete": 0, 2024-09-17T05:23:01.709 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_mapext": 0, 2024-09-17T05:23:01.709 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_sparse_read": 0, 2024-09-17T05:23:01.709 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_clonerange": 0, 2024-09-17T05:23:01.709 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_getxattr": 64, 2024-09-17T05:23:01.709 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_setxattr": 36, 2024-09-17T05:23:01.709 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_cmpxattr": 12, 2024-09-17T05:23:01.709 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_rmxattr": 0, 2024-09-17T05:23:01.709 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_resetxattrs": 0, 2024-09-17T05:23:01.709 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_call": 12, 2024-09-17T05:23:01.710 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_watch": 0, 2024-09-17T05:23:01.710 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_notify": 0, 2024-09-17T05:23:01.710 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_src_cmpxattr": 0, 2024-09-17T05:23:01.710 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_pgls": 0, 2024-09-17T05:23:01.710 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_pgls_filter": 0, 2024-09-17T05:23:01.710 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_other": 0, 2024-09-17T05:23:01.710 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_active": 0, 2024-09-17T05:23:01.710 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_send": 0, 2024-09-17T05:23:01.710 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_resend": 0, 2024-09-17T05:23:01.710 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_ping": 0, 2024-09-17T05:23:01.710 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_active": 0, 2024-09-17T05:23:01.710 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_send": 0, 2024-09-17T05:23:01.710 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_resend": 0, 2024-09-17T05:23:01.710 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_active": 0, 2024-09-17T05:23:01.711 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_send": 0, 2024-09-17T05:23:01.711 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_resend": 0, 2024-09-17T05:23:01.711 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_active": 0, 2024-09-17T05:23:01.711 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_send": 0, 2024-09-17T05:23:01.711 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_resend": 0, 2024-09-17T05:23:01.711 INFO:teuthology.orchestra.run.smithi167.stdout: "command_active": 0, 2024-09-17T05:23:01.711 INFO:teuthology.orchestra.run.smithi167.stdout: "command_send": 0, 2024-09-17T05:23:01.711 INFO:teuthology.orchestra.run.smithi167.stdout: "command_resend": 0, 2024-09-17T05:23:01.711 INFO:teuthology.orchestra.run.smithi167.stdout: "map_epoch": 16, 2024-09-17T05:23:01.711 INFO:teuthology.orchestra.run.smithi167.stdout: "map_full": 0, 2024-09-17T05:23:01.711 INFO:teuthology.orchestra.run.smithi167.stdout: "map_inc": 6, 2024-09-17T05:23:01.711 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_sessions": 1, 2024-09-17T05:23:01.711 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_session_open": 1, 2024-09-17T05:23:01.712 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_session_close": 0, 2024-09-17T05:23:01.712 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_laggy": 0, 2024-09-17T05:23:01.712 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_wr": 0, 2024-09-17T05:23:01.712 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_rd": 0, 2024-09-17T05:23:01.712 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_del": 0 2024-09-17T05:23:01.712 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.712 INFO:teuthology.orchestra.run.smithi167.stdout: "objecter-0x55dddda6a780": { 2024-09-17T05:23:01.712 INFO:teuthology.orchestra.run.smithi167.stdout: "op_active": 0, 2024-09-17T05:23:01.712 INFO:teuthology.orchestra.run.smithi167.stdout: "op_laggy": 0, 2024-09-17T05:23:01.712 INFO:teuthology.orchestra.run.smithi167.stdout: "op_send": 1, 2024-09-17T05:23:01.712 INFO:teuthology.orchestra.run.smithi167.stdout: "op_send_bytes": 39, 2024-09-17T05:23:01.712 INFO:teuthology.orchestra.run.smithi167.stdout: "op_resend": 0, 2024-09-17T05:23:01.712 INFO:teuthology.orchestra.run.smithi167.stdout: "op_reply": 1, 2024-09-17T05:23:01.713 INFO:teuthology.orchestra.run.smithi167.stdout: "op_latency": { 2024-09-17T05:23:01.713 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 1, 2024-09-17T05:23:01.713 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000999983, 2024-09-17T05:23:01.713 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000999983 2024-09-17T05:23:01.713 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.713 INFO:teuthology.orchestra.run.smithi167.stdout: "op_inflight": 0, 2024-09-17T05:23:01.713 INFO:teuthology.orchestra.run.smithi167.stdout: "oplen_avg": { 2024-09-17T05:23:01.713 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 1, 2024-09-17T05:23:01.713 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 1 2024-09-17T05:23:01.713 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.713 INFO:teuthology.orchestra.run.smithi167.stdout: "op": 1, 2024-09-17T05:23:01.713 INFO:teuthology.orchestra.run.smithi167.stdout: "op_r": 1, 2024-09-17T05:23:01.713 INFO:teuthology.orchestra.run.smithi167.stdout: "op_w": 0, 2024-09-17T05:23:01.714 INFO:teuthology.orchestra.run.smithi167.stdout: "op_rmw": 0, 2024-09-17T05:23:01.714 INFO:teuthology.orchestra.run.smithi167.stdout: "op_pg": 0, 2024-09-17T05:23:01.714 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_stat": 0, 2024-09-17T05:23:01.714 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_create": 0, 2024-09-17T05:23:01.714 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_read": 0, 2024-09-17T05:23:01.714 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_write": 0, 2024-09-17T05:23:01.714 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_writefull": 0, 2024-09-17T05:23:01.714 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_writesame": 0, 2024-09-17T05:23:01.714 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_append": 0, 2024-09-17T05:23:01.714 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_zero": 0, 2024-09-17T05:23:01.714 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_truncate": 0, 2024-09-17T05:23:01.714 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_delete": 0, 2024-09-17T05:23:01.714 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_mapext": 0, 2024-09-17T05:23:01.715 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_sparse_read": 0, 2024-09-17T05:23:01.715 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_clonerange": 0, 2024-09-17T05:23:01.715 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_getxattr": 0, 2024-09-17T05:23:01.715 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_setxattr": 0, 2024-09-17T05:23:01.715 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_cmpxattr": 0, 2024-09-17T05:23:01.715 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_rmxattr": 0, 2024-09-17T05:23:01.715 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_resetxattrs": 0, 2024-09-17T05:23:01.715 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_call": 0, 2024-09-17T05:23:01.715 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_watch": 0, 2024-09-17T05:23:01.715 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_notify": 0, 2024-09-17T05:23:01.715 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_src_cmpxattr": 0, 2024-09-17T05:23:01.715 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_pgls": 0, 2024-09-17T05:23:01.715 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_pgls_filter": 0, 2024-09-17T05:23:01.716 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_other": 1, 2024-09-17T05:23:01.716 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_active": 0, 2024-09-17T05:23:01.716 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_send": 0, 2024-09-17T05:23:01.716 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_resend": 0, 2024-09-17T05:23:01.716 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_ping": 0, 2024-09-17T05:23:01.716 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_active": 0, 2024-09-17T05:23:01.716 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_send": 0, 2024-09-17T05:23:01.716 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_resend": 0, 2024-09-17T05:23:01.716 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_active": 0, 2024-09-17T05:23:01.716 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_send": 0, 2024-09-17T05:23:01.716 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_resend": 0, 2024-09-17T05:23:01.716 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_active": 0, 2024-09-17T05:23:01.716 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_send": 0, 2024-09-17T05:23:01.717 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_resend": 0, 2024-09-17T05:23:01.717 INFO:teuthology.orchestra.run.smithi167.stdout: "command_active": 0, 2024-09-17T05:23:01.717 INFO:teuthology.orchestra.run.smithi167.stdout: "command_send": 0, 2024-09-17T05:23:01.717 INFO:teuthology.orchestra.run.smithi167.stdout: "command_resend": 0, 2024-09-17T05:23:01.717 INFO:teuthology.orchestra.run.smithi167.stdout: "map_epoch": 0, 2024-09-17T05:23:01.717 INFO:teuthology.orchestra.run.smithi167.stdout: "map_full": 0, 2024-09-17T05:23:01.717 INFO:teuthology.orchestra.run.smithi167.stdout: "map_inc": 0, 2024-09-17T05:23:01.717 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_sessions": 1, 2024-09-17T05:23:01.717 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_session_open": 1, 2024-09-17T05:23:01.717 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_session_close": 0, 2024-09-17T05:23:01.717 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_laggy": 0, 2024-09-17T05:23:01.717 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_wr": 0, 2024-09-17T05:23:01.717 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_rd": 0, 2024-09-17T05:23:01.718 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_del": 0 2024-09-17T05:23:01.718 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.718 INFO:teuthology.orchestra.run.smithi167.stdout: "objecter-0x55dddda6aaa0": { 2024-09-17T05:23:01.718 INFO:teuthology.orchestra.run.smithi167.stdout: "op_active": 0, 2024-09-17T05:23:01.718 INFO:teuthology.orchestra.run.smithi167.stdout: "op_laggy": 0, 2024-09-17T05:23:01.718 INFO:teuthology.orchestra.run.smithi167.stdout: "op_send": 0, 2024-09-17T05:23:01.718 INFO:teuthology.orchestra.run.smithi167.stdout: "op_send_bytes": 0, 2024-09-17T05:23:01.718 INFO:teuthology.orchestra.run.smithi167.stdout: "op_resend": 0, 2024-09-17T05:23:01.718 INFO:teuthology.orchestra.run.smithi167.stdout: "op_reply": 0, 2024-09-17T05:23:01.718 INFO:teuthology.orchestra.run.smithi167.stdout: "op_latency": { 2024-09-17T05:23:01.718 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.718 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.718 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.719 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.719 INFO:teuthology.orchestra.run.smithi167.stdout: "op_inflight": 0, 2024-09-17T05:23:01.719 INFO:teuthology.orchestra.run.smithi167.stdout: "oplen_avg": { 2024-09-17T05:23:01.719 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.719 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0 2024-09-17T05:23:01.719 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.719 INFO:teuthology.orchestra.run.smithi167.stdout: "op": 0, 2024-09-17T05:23:01.719 INFO:teuthology.orchestra.run.smithi167.stdout: "op_r": 0, 2024-09-17T05:23:01.719 INFO:teuthology.orchestra.run.smithi167.stdout: "op_w": 0, 2024-09-17T05:23:01.719 INFO:teuthology.orchestra.run.smithi167.stdout: "op_rmw": 0, 2024-09-17T05:23:01.719 INFO:teuthology.orchestra.run.smithi167.stdout: "op_pg": 0, 2024-09-17T05:23:01.719 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_stat": 0, 2024-09-17T05:23:01.719 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_create": 0, 2024-09-17T05:23:01.720 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_read": 0, 2024-09-17T05:23:01.720 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_write": 0, 2024-09-17T05:23:01.720 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_writefull": 0, 2024-09-17T05:23:01.720 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_writesame": 0, 2024-09-17T05:23:01.720 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_append": 0, 2024-09-17T05:23:01.720 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_zero": 0, 2024-09-17T05:23:01.720 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_truncate": 0, 2024-09-17T05:23:01.720 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_delete": 0, 2024-09-17T05:23:01.720 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_mapext": 0, 2024-09-17T05:23:01.720 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_sparse_read": 0, 2024-09-17T05:23:01.720 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_clonerange": 0, 2024-09-17T05:23:01.720 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_getxattr": 0, 2024-09-17T05:23:01.720 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_setxattr": 0, 2024-09-17T05:23:01.721 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_cmpxattr": 0, 2024-09-17T05:23:01.721 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_rmxattr": 0, 2024-09-17T05:23:01.721 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_resetxattrs": 0, 2024-09-17T05:23:01.721 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_call": 0, 2024-09-17T05:23:01.721 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_watch": 0, 2024-09-17T05:23:01.721 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_notify": 0, 2024-09-17T05:23:01.721 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_src_cmpxattr": 0, 2024-09-17T05:23:01.721 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_pgls": 0, 2024-09-17T05:23:01.721 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_pgls_filter": 0, 2024-09-17T05:23:01.721 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_other": 0, 2024-09-17T05:23:01.721 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_active": 0, 2024-09-17T05:23:01.721 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_send": 0, 2024-09-17T05:23:01.721 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_resend": 0, 2024-09-17T05:23:01.721 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_ping": 0, 2024-09-17T05:23:01.722 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_active": 0, 2024-09-17T05:23:01.722 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_send": 0, 2024-09-17T05:23:01.722 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_resend": 0, 2024-09-17T05:23:01.722 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_active": 0, 2024-09-17T05:23:01.722 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_send": 0, 2024-09-17T05:23:01.722 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_resend": 0, 2024-09-17T05:23:01.722 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_active": 0, 2024-09-17T05:23:01.722 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_send": 0, 2024-09-17T05:23:01.722 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_resend": 0, 2024-09-17T05:23:01.722 INFO:teuthology.orchestra.run.smithi167.stdout: "command_active": 0, 2024-09-17T05:23:01.722 INFO:teuthology.orchestra.run.smithi167.stdout: "command_send": 0, 2024-09-17T05:23:01.722 INFO:teuthology.orchestra.run.smithi167.stdout: "command_resend": 0, 2024-09-17T05:23:01.723 INFO:teuthology.orchestra.run.smithi167.stdout: "map_epoch": 0, 2024-09-17T05:23:01.723 INFO:teuthology.orchestra.run.smithi167.stdout: "map_full": 0, 2024-09-17T05:23:01.723 INFO:teuthology.orchestra.run.smithi167.stdout: "map_inc": 0, 2024-09-17T05:23:01.723 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_sessions": 0, 2024-09-17T05:23:01.723 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_session_open": 0, 2024-09-17T05:23:01.723 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_session_close": 0, 2024-09-17T05:23:01.723 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_laggy": 0, 2024-09-17T05:23:01.723 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_wr": 0, 2024-09-17T05:23:01.723 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_rd": 0, 2024-09-17T05:23:01.723 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_del": 0 2024-09-17T05:23:01.723 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.723 INFO:teuthology.orchestra.run.smithi167.stdout: "objecter-0x55ddde3d8500": { 2024-09-17T05:23:01.723 INFO:teuthology.orchestra.run.smithi167.stdout: "op_active": 0, 2024-09-17T05:23:01.723 INFO:teuthology.orchestra.run.smithi167.stdout: "op_laggy": 0, 2024-09-17T05:23:01.724 INFO:teuthology.orchestra.run.smithi167.stdout: "op_send": 0, 2024-09-17T05:23:01.724 INFO:teuthology.orchestra.run.smithi167.stdout: "op_send_bytes": 0, 2024-09-17T05:23:01.724 INFO:teuthology.orchestra.run.smithi167.stdout: "op_resend": 0, 2024-09-17T05:23:01.724 INFO:teuthology.orchestra.run.smithi167.stdout: "op_reply": 0, 2024-09-17T05:23:01.724 INFO:teuthology.orchestra.run.smithi167.stdout: "op_latency": { 2024-09-17T05:23:01.724 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.724 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.724 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.724 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.724 INFO:teuthology.orchestra.run.smithi167.stdout: "op_inflight": 0, 2024-09-17T05:23:01.724 INFO:teuthology.orchestra.run.smithi167.stdout: "oplen_avg": { 2024-09-17T05:23:01.724 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.724 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0 2024-09-17T05:23:01.725 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.725 INFO:teuthology.orchestra.run.smithi167.stdout: "op": 0, 2024-09-17T05:23:01.725 INFO:teuthology.orchestra.run.smithi167.stdout: "op_r": 0, 2024-09-17T05:23:01.725 INFO:teuthology.orchestra.run.smithi167.stdout: "op_w": 0, 2024-09-17T05:23:01.725 INFO:teuthology.orchestra.run.smithi167.stdout: "op_rmw": 0, 2024-09-17T05:23:01.725 INFO:teuthology.orchestra.run.smithi167.stdout: "op_pg": 0, 2024-09-17T05:23:01.725 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_stat": 0, 2024-09-17T05:23:01.725 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_create": 0, 2024-09-17T05:23:01.725 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_read": 0, 2024-09-17T05:23:01.725 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_write": 0, 2024-09-17T05:23:01.725 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_writefull": 0, 2024-09-17T05:23:01.725 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_writesame": 0, 2024-09-17T05:23:01.725 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_append": 0, 2024-09-17T05:23:01.726 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_zero": 0, 2024-09-17T05:23:01.726 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_truncate": 0, 2024-09-17T05:23:01.726 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_delete": 0, 2024-09-17T05:23:01.726 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_mapext": 0, 2024-09-17T05:23:01.726 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_sparse_read": 0, 2024-09-17T05:23:01.726 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_clonerange": 0, 2024-09-17T05:23:01.726 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_getxattr": 0, 2024-09-17T05:23:01.726 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_setxattr": 0, 2024-09-17T05:23:01.726 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_cmpxattr": 0, 2024-09-17T05:23:01.726 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_rmxattr": 0, 2024-09-17T05:23:01.726 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_resetxattrs": 0, 2024-09-17T05:23:01.726 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_call": 0, 2024-09-17T05:23:01.726 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_watch": 0, 2024-09-17T05:23:01.727 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_notify": 0, 2024-09-17T05:23:01.727 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_src_cmpxattr": 0, 2024-09-17T05:23:01.727 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_pgls": 0, 2024-09-17T05:23:01.727 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_pgls_filter": 0, 2024-09-17T05:23:01.727 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_other": 0, 2024-09-17T05:23:01.727 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_active": 0, 2024-09-17T05:23:01.727 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_send": 0, 2024-09-17T05:23:01.727 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_resend": 0, 2024-09-17T05:23:01.727 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_ping": 0, 2024-09-17T05:23:01.727 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_active": 0, 2024-09-17T05:23:01.727 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_send": 0, 2024-09-17T05:23:01.727 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_resend": 0, 2024-09-17T05:23:01.727 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_active": 0, 2024-09-17T05:23:01.727 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_send": 0, 2024-09-17T05:23:01.728 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_resend": 0, 2024-09-17T05:23:01.728 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_active": 0, 2024-09-17T05:23:01.728 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_send": 0, 2024-09-17T05:23:01.728 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_resend": 0, 2024-09-17T05:23:01.728 INFO:teuthology.orchestra.run.smithi167.stdout: "command_active": 0, 2024-09-17T05:23:01.728 INFO:teuthology.orchestra.run.smithi167.stdout: "command_send": 0, 2024-09-17T05:23:01.728 INFO:teuthology.orchestra.run.smithi167.stdout: "command_resend": 0, 2024-09-17T05:23:01.728 INFO:teuthology.orchestra.run.smithi167.stdout: "map_epoch": 0, 2024-09-17T05:23:01.728 INFO:teuthology.orchestra.run.smithi167.stdout: "map_full": 0, 2024-09-17T05:23:01.728 INFO:teuthology.orchestra.run.smithi167.stdout: "map_inc": 0, 2024-09-17T05:23:01.728 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_sessions": 0, 2024-09-17T05:23:01.728 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_session_open": 0, 2024-09-17T05:23:01.729 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_session_close": 0, 2024-09-17T05:23:01.729 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_laggy": 0, 2024-09-17T05:23:01.729 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_wr": 0, 2024-09-17T05:23:01.729 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_rd": 0, 2024-09-17T05:23:01.729 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_del": 0 2024-09-17T05:23:01.729 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.729 INFO:teuthology.orchestra.run.smithi167.stdout: "objecter-0x55ddde3d9860": { 2024-09-17T05:23:01.729 INFO:teuthology.orchestra.run.smithi167.stdout: "op_active": 0, 2024-09-17T05:23:01.729 INFO:teuthology.orchestra.run.smithi167.stdout: "op_laggy": 0, 2024-09-17T05:23:01.729 INFO:teuthology.orchestra.run.smithi167.stdout: "op_send": 3, 2024-09-17T05:23:01.729 INFO:teuthology.orchestra.run.smithi167.stdout: "op_send_bytes": 410, 2024-09-17T05:23:01.729 INFO:teuthology.orchestra.run.smithi167.stdout: "op_resend": 0, 2024-09-17T05:23:01.729 INFO:teuthology.orchestra.run.smithi167.stdout: "op_reply": 3, 2024-09-17T05:23:01.729 INFO:teuthology.orchestra.run.smithi167.stdout: "op_latency": { 2024-09-17T05:23:01.730 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 3, 2024-09-17T05:23:01.730 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.008999842, 2024-09-17T05:23:01.730 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.002999947 2024-09-17T05:23:01.730 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.730 INFO:teuthology.orchestra.run.smithi167.stdout: "op_inflight": 0, 2024-09-17T05:23:01.730 INFO:teuthology.orchestra.run.smithi167.stdout: "oplen_avg": { 2024-09-17T05:23:01.730 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 3, 2024-09-17T05:23:01.730 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 3 2024-09-17T05:23:01.730 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.730 INFO:teuthology.orchestra.run.smithi167.stdout: "op": 3, 2024-09-17T05:23:01.730 INFO:teuthology.orchestra.run.smithi167.stdout: "op_r": 0, 2024-09-17T05:23:01.730 INFO:teuthology.orchestra.run.smithi167.stdout: "op_w": 3, 2024-09-17T05:23:01.730 INFO:teuthology.orchestra.run.smithi167.stdout: "op_rmw": 0, 2024-09-17T05:23:01.731 INFO:teuthology.orchestra.run.smithi167.stdout: "op_pg": 0, 2024-09-17T05:23:01.731 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_stat": 0, 2024-09-17T05:23:01.731 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_create": 0, 2024-09-17T05:23:01.731 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_read": 0, 2024-09-17T05:23:01.731 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_write": 3, 2024-09-17T05:23:01.731 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_writefull": 0, 2024-09-17T05:23:01.731 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_writesame": 0, 2024-09-17T05:23:01.731 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_append": 0, 2024-09-17T05:23:01.731 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_zero": 0, 2024-09-17T05:23:01.731 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_truncate": 0, 2024-09-17T05:23:01.731 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_delete": 0, 2024-09-17T05:23:01.731 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_mapext": 0, 2024-09-17T05:23:01.731 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_sparse_read": 0, 2024-09-17T05:23:01.732 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_clonerange": 0, 2024-09-17T05:23:01.732 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_getxattr": 0, 2024-09-17T05:23:01.732 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_setxattr": 0, 2024-09-17T05:23:01.732 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_cmpxattr": 0, 2024-09-17T05:23:01.732 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_rmxattr": 0, 2024-09-17T05:23:01.732 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_resetxattrs": 0, 2024-09-17T05:23:01.732 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_call": 0, 2024-09-17T05:23:01.732 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_watch": 0, 2024-09-17T05:23:01.732 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_notify": 0, 2024-09-17T05:23:01.732 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_src_cmpxattr": 0, 2024-09-17T05:23:01.732 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_pgls": 0, 2024-09-17T05:23:01.732 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_pgls_filter": 0, 2024-09-17T05:23:01.732 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_other": 0, 2024-09-17T05:23:01.733 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_active": 0, 2024-09-17T05:23:01.733 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_send": 0, 2024-09-17T05:23:01.733 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_resend": 0, 2024-09-17T05:23:01.733 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_ping": 0, 2024-09-17T05:23:01.733 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_active": 0, 2024-09-17T05:23:01.733 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_send": 0, 2024-09-17T05:23:01.733 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_resend": 0, 2024-09-17T05:23:01.733 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_active": 0, 2024-09-17T05:23:01.733 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_send": 0, 2024-09-17T05:23:01.733 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_resend": 0, 2024-09-17T05:23:01.733 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_active": 0, 2024-09-17T05:23:01.733 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_send": 0, 2024-09-17T05:23:01.733 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_resend": 0, 2024-09-17T05:23:01.733 INFO:teuthology.orchestra.run.smithi167.stdout: "command_active": 0, 2024-09-17T05:23:01.734 INFO:teuthology.orchestra.run.smithi167.stdout: "command_send": 0, 2024-09-17T05:23:01.734 INFO:teuthology.orchestra.run.smithi167.stdout: "command_resend": 0, 2024-09-17T05:23:01.734 INFO:teuthology.orchestra.run.smithi167.stdout: "map_epoch": 0, 2024-09-17T05:23:01.734 INFO:teuthology.orchestra.run.smithi167.stdout: "map_full": 0, 2024-09-17T05:23:01.734 INFO:teuthology.orchestra.run.smithi167.stdout: "map_inc": 0, 2024-09-17T05:23:01.734 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_sessions": 2, 2024-09-17T05:23:01.734 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_session_open": 2, 2024-09-17T05:23:01.734 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_session_close": 0, 2024-09-17T05:23:01.734 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_laggy": 0, 2024-09-17T05:23:01.734 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_wr": 0, 2024-09-17T05:23:01.734 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_rd": 0, 2024-09-17T05:23:01.734 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_del": 0 2024-09-17T05:23:01.734 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.735 INFO:teuthology.orchestra.run.smithi167.stdout: "objecter-0x55dddebfe8c0": { 2024-09-17T05:23:01.735 INFO:teuthology.orchestra.run.smithi167.stdout: "op_active": 0, 2024-09-17T05:23:01.735 INFO:teuthology.orchestra.run.smithi167.stdout: "op_laggy": 0, 2024-09-17T05:23:01.735 INFO:teuthology.orchestra.run.smithi167.stdout: "op_send": 0, 2024-09-17T05:23:01.735 INFO:teuthology.orchestra.run.smithi167.stdout: "op_send_bytes": 0, 2024-09-17T05:23:01.735 INFO:teuthology.orchestra.run.smithi167.stdout: "op_resend": 0, 2024-09-17T05:23:01.735 INFO:teuthology.orchestra.run.smithi167.stdout: "op_reply": 0, 2024-09-17T05:23:01.735 INFO:teuthology.orchestra.run.smithi167.stdout: "op_latency": { 2024-09-17T05:23:01.735 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.735 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.735 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.735 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.735 INFO:teuthology.orchestra.run.smithi167.stdout: "op_inflight": 0, 2024-09-17T05:23:01.736 INFO:teuthology.orchestra.run.smithi167.stdout: "oplen_avg": { 2024-09-17T05:23:01.736 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.736 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0 2024-09-17T05:23:01.736 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.736 INFO:teuthology.orchestra.run.smithi167.stdout: "op": 0, 2024-09-17T05:23:01.736 INFO:teuthology.orchestra.run.smithi167.stdout: "op_r": 0, 2024-09-17T05:23:01.736 INFO:teuthology.orchestra.run.smithi167.stdout: "op_w": 0, 2024-09-17T05:23:01.736 INFO:teuthology.orchestra.run.smithi167.stdout: "op_rmw": 0, 2024-09-17T05:23:01.736 INFO:teuthology.orchestra.run.smithi167.stdout: "op_pg": 0, 2024-09-17T05:23:01.736 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_stat": 0, 2024-09-17T05:23:01.736 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_create": 0, 2024-09-17T05:23:01.736 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_read": 0, 2024-09-17T05:23:01.736 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_write": 0, 2024-09-17T05:23:01.737 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_writefull": 0, 2024-09-17T05:23:01.737 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_writesame": 0, 2024-09-17T05:23:01.737 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_append": 0, 2024-09-17T05:23:01.737 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_zero": 0, 2024-09-17T05:23:01.737 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_truncate": 0, 2024-09-17T05:23:01.737 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_delete": 0, 2024-09-17T05:23:01.737 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_mapext": 0, 2024-09-17T05:23:01.737 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_sparse_read": 0, 2024-09-17T05:23:01.737 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_clonerange": 0, 2024-09-17T05:23:01.737 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_getxattr": 0, 2024-09-17T05:23:01.737 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_setxattr": 0, 2024-09-17T05:23:01.737 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_cmpxattr": 0, 2024-09-17T05:23:01.737 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_rmxattr": 0, 2024-09-17T05:23:01.737 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_resetxattrs": 0, 2024-09-17T05:23:01.738 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_call": 0, 2024-09-17T05:23:01.738 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_watch": 0, 2024-09-17T05:23:01.738 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_notify": 0, 2024-09-17T05:23:01.738 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_src_cmpxattr": 0, 2024-09-17T05:23:01.738 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_pgls": 0, 2024-09-17T05:23:01.738 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_pgls_filter": 0, 2024-09-17T05:23:01.738 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_other": 0, 2024-09-17T05:23:01.738 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_active": 0, 2024-09-17T05:23:01.738 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_send": 0, 2024-09-17T05:23:01.738 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_resend": 0, 2024-09-17T05:23:01.738 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_ping": 0, 2024-09-17T05:23:01.738 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_active": 0, 2024-09-17T05:23:01.738 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_send": 0, 2024-09-17T05:23:01.739 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_resend": 0, 2024-09-17T05:23:01.739 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_active": 0, 2024-09-17T05:23:01.739 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_send": 0, 2024-09-17T05:23:01.739 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_resend": 0, 2024-09-17T05:23:01.739 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_active": 0, 2024-09-17T05:23:01.739 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_send": 0, 2024-09-17T05:23:01.739 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_resend": 0, 2024-09-17T05:23:01.739 INFO:teuthology.orchestra.run.smithi167.stdout: "command_active": 0, 2024-09-17T05:23:01.739 INFO:teuthology.orchestra.run.smithi167.stdout: "command_send": 0, 2024-09-17T05:23:01.739 INFO:teuthology.orchestra.run.smithi167.stdout: "command_resend": 0, 2024-09-17T05:23:01.739 INFO:teuthology.orchestra.run.smithi167.stdout: "map_epoch": 0, 2024-09-17T05:23:01.739 INFO:teuthology.orchestra.run.smithi167.stdout: "map_full": 0, 2024-09-17T05:23:01.739 INFO:teuthology.orchestra.run.smithi167.stdout: "map_inc": 0, 2024-09-17T05:23:01.740 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_sessions": 0, 2024-09-17T05:23:01.740 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_session_open": 0, 2024-09-17T05:23:01.740 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_session_close": 0, 2024-09-17T05:23:01.740 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_laggy": 0, 2024-09-17T05:23:01.740 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_wr": 0, 2024-09-17T05:23:01.740 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_rd": 0, 2024-09-17T05:23:01.740 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_del": 0 2024-09-17T05:23:01.740 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.741 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-mgr_client_bytes": { 2024-09-17T05:23:01.741 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-17T05:23:01.741 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 134217728, 2024-09-17T05:23:01.741 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-17T05:23:01.741 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 59, 2024-09-17T05:23:01.741 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 175452, 2024-09-17T05:23:01.741 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-17T05:23:01.741 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 59, 2024-09-17T05:23:01.741 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-09-17T05:23:01.741 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-09-17T05:23:01.741 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 81, 2024-09-17T05:23:01.741 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 175452, 2024-09-17T05:23:01.741 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-17T05:23:01.741 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.742 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.742 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.742 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-17T05:23:01.742 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.742 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-mgr_client_messages": { 2024-09-17T05:23:01.742 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-17T05:23:01.742 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 512, 2024-09-17T05:23:01.742 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-17T05:23:01.742 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 59, 2024-09-17T05:23:01.742 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 59, 2024-09-17T05:23:01.742 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-17T05:23:01.742 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 59, 2024-09-17T05:23:01.742 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-09-17T05:23:01.743 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-09-17T05:23:01.743 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 59, 2024-09-17T05:23:01.743 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 59, 2024-09-17T05:23:01.743 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-17T05:23:01.743 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.743 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.743 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.743 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-17T05:23:01.743 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.743 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-mgr_mds_bytes": { 2024-09-17T05:23:01.743 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-17T05:23:01.743 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 134217728, 2024-09-17T05:23:01.743 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-17T05:23:01.743 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 71, 2024-09-17T05:23:01.744 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 840374, 2024-09-17T05:23:01.744 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-17T05:23:01.744 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 71, 2024-09-17T05:23:01.744 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-09-17T05:23:01.744 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-09-17T05:23:01.744 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 71, 2024-09-17T05:23:01.744 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 840374, 2024-09-17T05:23:01.744 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-17T05:23:01.744 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.744 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.744 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.744 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-17T05:23:01.745 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.745 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-mgr_mds_messsages": { 2024-09-17T05:23:01.745 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-17T05:23:01.745 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 128, 2024-09-17T05:23:01.745 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-17T05:23:01.745 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 71, 2024-09-17T05:23:01.745 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 71, 2024-09-17T05:23:01.745 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-17T05:23:01.745 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 71, 2024-09-17T05:23:01.745 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-09-17T05:23:01.745 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-09-17T05:23:01.745 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 71, 2024-09-17T05:23:01.745 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 71, 2024-09-17T05:23:01.745 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-17T05:23:01.746 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.746 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.746 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.746 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-17T05:23:01.746 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.746 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-mgr_mon_bytes": { 2024-09-17T05:23:01.746 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-17T05:23:01.746 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 134217728, 2024-09-17T05:23:01.746 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-17T05:23:01.746 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 57, 2024-09-17T05:23:01.746 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 445310, 2024-09-17T05:23:01.746 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-17T05:23:01.747 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 57, 2024-09-17T05:23:01.747 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-09-17T05:23:01.747 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-09-17T05:23:01.747 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 57, 2024-09-17T05:23:01.747 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 445310, 2024-09-17T05:23:01.747 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-17T05:23:01.747 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.747 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.747 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.747 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-17T05:23:01.747 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.747 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-mgr_mon_messsages": { 2024-09-17T05:23:01.747 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-17T05:23:01.748 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 128, 2024-09-17T05:23:01.748 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-17T05:23:01.748 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 57, 2024-09-17T05:23:01.748 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 57, 2024-09-17T05:23:01.748 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-17T05:23:01.748 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 57, 2024-09-17T05:23:01.748 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-09-17T05:23:01.748 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-09-17T05:23:01.748 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 57, 2024-09-17T05:23:01.748 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 57, 2024-09-17T05:23:01.748 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-17T05:23:01.748 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.748 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.749 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.749 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-17T05:23:01.749 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.749 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-mgr_osd_bytes": { 2024-09-17T05:23:01.749 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-17T05:23:01.749 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 536870912, 2024-09-17T05:23:01.749 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-17T05:23:01.749 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 295, 2024-09-17T05:23:01.749 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 3904312, 2024-09-17T05:23:01.749 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-17T05:23:01.749 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 295, 2024-09-17T05:23:01.749 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-09-17T05:23:01.749 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-09-17T05:23:01.749 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 295, 2024-09-17T05:23:01.750 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 3904312, 2024-09-17T05:23:01.750 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-17T05:23:01.750 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.750 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.750 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.750 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-17T05:23:01.750 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.750 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-mgr_osd_messsages": { 2024-09-17T05:23:01.750 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-17T05:23:01.750 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 8192, 2024-09-17T05:23:01.750 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-17T05:23:01.750 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 295, 2024-09-17T05:23:01.750 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 295, 2024-09-17T05:23:01.751 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-17T05:23:01.751 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 295, 2024-09-17T05:23:01.751 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-09-17T05:23:01.751 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-09-17T05:23:01.751 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 295, 2024-09-17T05:23:01.751 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 295, 2024-09-17T05:23:01.751 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-17T05:23:01.751 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.751 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.751 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.751 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-17T05:23:01.751 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.751 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-msgr_dispatch_throttler-client": { 2024-09-17T05:23:01.752 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-17T05:23:01.752 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 104857600, 2024-09-17T05:23:01.752 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-17T05:23:01.752 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 181, 2024-09-17T05:23:01.752 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 69463, 2024-09-17T05:23:01.752 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-17T05:23:01.752 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 181, 2024-09-17T05:23:01.752 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-09-17T05:23:01.752 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-09-17T05:23:01.752 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 181, 2024-09-17T05:23:01.752 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 69463, 2024-09-17T05:23:01.752 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-17T05:23:01.752 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.753 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.753 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.753 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-17T05:23:01.753 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.753 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-msgr_dispatch_throttler-client-0x55dddebfe0a0": { 2024-09-17T05:23:01.753 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-17T05:23:01.753 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 104857600, 2024-09-17T05:23:01.753 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-17T05:23:01.753 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 83, 2024-09-17T05:23:01.753 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 44255, 2024-09-17T05:23:01.753 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-17T05:23:01.753 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 83, 2024-09-17T05:23:01.753 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-09-17T05:23:01.753 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-09-17T05:23:01.754 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 83, 2024-09-17T05:23:01.754 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 44255, 2024-09-17T05:23:01.754 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-17T05:23:01.754 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.754 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.754 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.754 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-17T05:23:01.754 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.754 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-msgr_dispatch_throttler-client-0x55dddebfe640": { 2024-09-17T05:23:01.754 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-17T05:23:01.754 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 104857600, 2024-09-17T05:23:01.754 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-17T05:23:01.754 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 40, 2024-09-17T05:23:01.755 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 22265, 2024-09-17T05:23:01.755 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-17T05:23:01.755 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 40, 2024-09-17T05:23:01.755 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-09-17T05:23:01.755 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-09-17T05:23:01.755 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 40, 2024-09-17T05:23:01.755 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 22265, 2024-09-17T05:23:01.755 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-17T05:23:01.755 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.755 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.755 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.755 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-17T05:23:01.755 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.756 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-msgr_dispatch_throttler-mgr": { 2024-09-17T05:23:01.756 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-17T05:23:01.756 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 104857600, 2024-09-17T05:23:01.756 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-17T05:23:01.756 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 336, 2024-09-17T05:23:01.756 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 815370, 2024-09-17T05:23:01.756 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-17T05:23:01.756 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 336, 2024-09-17T05:23:01.756 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-09-17T05:23:01.756 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-09-17T05:23:01.756 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 336, 2024-09-17T05:23:01.756 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 815370, 2024-09-17T05:23:01.756 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-17T05:23:01.757 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.757 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.757 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.757 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-17T05:23:01.757 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.757 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-msgr_dispatch_throttler-mgr-0x55dddc554280": { 2024-09-17T05:23:01.757 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-17T05:23:01.757 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 104857600, 2024-09-17T05:23:01.757 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-17T05:23:01.757 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 482, 2024-09-17T05:23:01.757 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 5365448, 2024-09-17T05:23:01.757 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-17T05:23:01.757 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 482, 2024-09-17T05:23:01.758 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-09-17T05:23:01.758 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-09-17T05:23:01.758 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 482, 2024-09-17T05:23:01.758 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 5365448, 2024-09-17T05:23:01.758 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-17T05:23:01.758 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.758 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.758 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.758 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-17T05:23:01.758 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.758 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-msgr_dispatch_throttler-radosclient": { 2024-09-17T05:23:01.758 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-17T05:23:01.758 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 104857600, 2024-09-17T05:23:01.758 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-17T05:23:01.759 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 110, 2024-09-17T05:23:01.759 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 488442, 2024-09-17T05:23:01.759 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-17T05:23:01.759 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 110, 2024-09-17T05:23:01.759 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-09-17T05:23:01.759 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-09-17T05:23:01.759 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 110, 2024-09-17T05:23:01.759 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 488442, 2024-09-17T05:23:01.759 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-17T05:23:01.759 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.759 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.759 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.759 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-17T05:23:01.760 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.760 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-msgr_dispatch_throttler-radosclient-0x55dddda6aa00": { 2024-09-17T05:23:01.760 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-17T05:23:01.760 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 104857600, 2024-09-17T05:23:01.760 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-17T05:23:01.760 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 10, 2024-09-17T05:23:01.760 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 459110, 2024-09-17T05:23:01.760 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-17T05:23:01.760 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 10, 2024-09-17T05:23:01.760 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-09-17T05:23:01.760 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-09-17T05:23:01.760 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 10, 2024-09-17T05:23:01.760 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 459110, 2024-09-17T05:23:01.761 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-17T05:23:01.761 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.761 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.761 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.761 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-17T05:23:01.761 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.761 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-msgr_dispatch_throttler-radosclient-0x55dddda6ac80": { 2024-09-17T05:23:01.761 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-17T05:23:01.761 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 104857600, 2024-09-17T05:23:01.761 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-17T05:23:01.761 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 11, 2024-09-17T05:23:01.761 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 459134, 2024-09-17T05:23:01.761 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-17T05:23:01.761 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 11, 2024-09-17T05:23:01.762 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-09-17T05:23:01.762 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-09-17T05:23:01.762 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 11, 2024-09-17T05:23:01.762 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 459134, 2024-09-17T05:23:01.762 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-17T05:23:01.762 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.762 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.762 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.762 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-17T05:23:01.762 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.762 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-msgr_dispatch_throttler-radosclient-0x55ddde3d8140": { 2024-09-17T05:23:01.762 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-17T05:23:01.762 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 104857600, 2024-09-17T05:23:01.763 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-17T05:23:01.763 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 9, 2024-09-17T05:23:01.763 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 310494, 2024-09-17T05:23:01.763 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-17T05:23:01.763 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 9, 2024-09-17T05:23:01.763 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-09-17T05:23:01.763 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-09-17T05:23:01.763 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 9, 2024-09-17T05:23:01.763 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 310494, 2024-09-17T05:23:01.763 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-17T05:23:01.763 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.763 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.763 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.764 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-17T05:23:01.764 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.764 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-objecter_bytes": { 2024-09-17T05:23:01.764 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-17T05:23:01.764 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 104857600, 2024-09-17T05:23:01.764 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-17T05:23:01.764 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2024-09-17T05:23:01.764 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2024-09-17T05:23:01.764 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-17T05:23:01.764 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2024-09-17T05:23:01.764 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-09-17T05:23:01.764 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-09-17T05:23:01.764 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 0, 2024-09-17T05:23:01.764 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 0, 2024-09-17T05:23:01.765 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-17T05:23:01.765 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.765 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.765 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.765 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-17T05:23:01.765 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.765 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-objecter_bytes-0x55dddc555f40": { 2024-09-17T05:23:01.765 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-17T05:23:01.765 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 104857600, 2024-09-17T05:23:01.765 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-17T05:23:01.765 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 98, 2024-09-17T05:23:01.765 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 1643087, 2024-09-17T05:23:01.765 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-17T05:23:01.766 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 98, 2024-09-17T05:23:01.766 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-09-17T05:23:01.766 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-09-17T05:23:01.766 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 98, 2024-09-17T05:23:01.766 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 1643087, 2024-09-17T05:23:01.766 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-17T05:23:01.766 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.766 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.766 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.766 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-17T05:23:01.766 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.766 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-objecter_bytes-0x55dddda6a960": { 2024-09-17T05:23:01.766 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-17T05:23:01.767 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 104857600, 2024-09-17T05:23:01.767 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-17T05:23:01.767 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2024-09-17T05:23:01.767 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2024-09-17T05:23:01.767 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-17T05:23:01.767 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2024-09-17T05:23:01.767 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-09-17T05:23:01.767 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-09-17T05:23:01.767 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 0, 2024-09-17T05:23:01.767 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 0, 2024-09-17T05:23:01.767 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-17T05:23:01.767 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.767 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.767 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.768 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-17T05:23:01.768 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.768 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-objecter_bytes-0x55dddda6abe0": { 2024-09-17T05:23:01.768 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-17T05:23:01.768 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 104857600, 2024-09-17T05:23:01.768 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-17T05:23:01.768 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2024-09-17T05:23:01.768 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2024-09-17T05:23:01.768 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-17T05:23:01.768 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2024-09-17T05:23:01.768 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-09-17T05:23:01.768 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-09-17T05:23:01.768 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 0, 2024-09-17T05:23:01.769 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 0, 2024-09-17T05:23:01.769 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-17T05:23:01.769 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.769 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.769 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.769 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-17T05:23:01.769 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.769 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-objecter_bytes-0x55ddde3d81e0": { 2024-09-17T05:23:01.769 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-17T05:23:01.769 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 104857600, 2024-09-17T05:23:01.769 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-17T05:23:01.769 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 1, 2024-09-17T05:23:01.769 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2024-09-17T05:23:01.770 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-17T05:23:01.770 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 1, 2024-09-17T05:23:01.770 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-09-17T05:23:01.770 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-09-17T05:23:01.770 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 1, 2024-09-17T05:23:01.770 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 0, 2024-09-17T05:23:01.770 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-17T05:23:01.770 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.770 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.770 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.770 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-17T05:23:01.770 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.770 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-objecter_bytes-0x55ddde3d8f00": { 2024-09-17T05:23:01.771 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-17T05:23:01.771 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 104857600, 2024-09-17T05:23:01.771 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-17T05:23:01.771 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2024-09-17T05:23:01.771 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2024-09-17T05:23:01.771 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-17T05:23:01.771 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2024-09-17T05:23:01.771 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 3, 2024-09-17T05:23:01.771 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 410, 2024-09-17T05:23:01.771 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 3, 2024-09-17T05:23:01.771 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 410, 2024-09-17T05:23:01.771 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-17T05:23:01.771 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.772 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.772 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.772 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-17T05:23:01.772 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.772 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-objecter_bytes-0x55dddebfe140": { 2024-09-17T05:23:01.772 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-17T05:23:01.772 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 104857600, 2024-09-17T05:23:01.772 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-17T05:23:01.772 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2024-09-17T05:23:01.772 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2024-09-17T05:23:01.772 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-17T05:23:01.772 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2024-09-17T05:23:01.772 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-09-17T05:23:01.773 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-09-17T05:23:01.773 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 0, 2024-09-17T05:23:01.773 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 0, 2024-09-17T05:23:01.773 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-17T05:23:01.773 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.773 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.773 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.773 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-17T05:23:01.773 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.773 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-objecter_bytes-0x55dddebfe6e0": { 2024-09-17T05:23:01.773 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-17T05:23:01.773 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 104857600, 2024-09-17T05:23:01.773 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-17T05:23:01.774 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2024-09-17T05:23:01.774 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2024-09-17T05:23:01.774 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-17T05:23:01.774 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2024-09-17T05:23:01.774 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-09-17T05:23:01.774 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-09-17T05:23:01.774 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 0, 2024-09-17T05:23:01.774 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 0, 2024-09-17T05:23:01.774 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-17T05:23:01.774 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.774 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.774 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.774 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-17T05:23:01.775 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.775 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-objecter_ops": { 2024-09-17T05:23:01.775 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-17T05:23:01.775 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 1024, 2024-09-17T05:23:01.775 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-17T05:23:01.775 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2024-09-17T05:23:01.775 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2024-09-17T05:23:01.775 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-17T05:23:01.775 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2024-09-17T05:23:01.775 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-09-17T05:23:01.775 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-09-17T05:23:01.775 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 0, 2024-09-17T05:23:01.775 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 0, 2024-09-17T05:23:01.775 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-17T05:23:01.776 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.776 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.776 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.776 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-17T05:23:01.776 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.776 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-objecter_ops-0x55dddda6a500": { 2024-09-17T05:23:01.776 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-17T05:23:01.776 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 1024, 2024-09-17T05:23:01.776 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-17T05:23:01.776 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 98, 2024-09-17T05:23:01.776 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 98, 2024-09-17T05:23:01.776 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-17T05:23:01.777 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 98, 2024-09-17T05:23:01.777 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-09-17T05:23:01.777 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-09-17T05:23:01.777 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 98, 2024-09-17T05:23:01.777 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 98, 2024-09-17T05:23:01.777 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-17T05:23:01.777 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.777 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.777 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.777 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-17T05:23:01.778 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.778 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-objecter_ops-0x55dddda6a8c0": { 2024-09-17T05:23:01.778 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-17T05:23:01.778 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 1024, 2024-09-17T05:23:01.778 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-17T05:23:01.778 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2024-09-17T05:23:01.778 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2024-09-17T05:23:01.778 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-17T05:23:01.778 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2024-09-17T05:23:01.778 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-09-17T05:23:01.778 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-09-17T05:23:01.778 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 0, 2024-09-17T05:23:01.778 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 0, 2024-09-17T05:23:01.779 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-17T05:23:01.779 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.779 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.779 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.779 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-17T05:23:01.779 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.779 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-objecter_ops-0x55dddda6ab40": { 2024-09-17T05:23:01.779 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-17T05:23:01.779 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 1024, 2024-09-17T05:23:01.779 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-17T05:23:01.779 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2024-09-17T05:23:01.779 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2024-09-17T05:23:01.779 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-17T05:23:01.779 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2024-09-17T05:23:01.780 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-09-17T05:23:01.780 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-09-17T05:23:01.780 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 0, 2024-09-17T05:23:01.780 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 0, 2024-09-17T05:23:01.780 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-17T05:23:01.780 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.780 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.780 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.780 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-17T05:23:01.780 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.780 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-objecter_ops-0x55ddde3d8280": { 2024-09-17T05:23:01.780 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-17T05:23:01.781 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 1024, 2024-09-17T05:23:01.781 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-17T05:23:01.781 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 1, 2024-09-17T05:23:01.781 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 1, 2024-09-17T05:23:01.781 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-17T05:23:01.781 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 1, 2024-09-17T05:23:01.781 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-09-17T05:23:01.781 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-09-17T05:23:01.781 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 1, 2024-09-17T05:23:01.781 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 1, 2024-09-17T05:23:01.781 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-17T05:23:01.781 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.781 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.781 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.782 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-17T05:23:01.782 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.782 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-objecter_ops-0x55ddde3d9720": { 2024-09-17T05:23:01.782 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-17T05:23:01.782 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 1024, 2024-09-17T05:23:01.782 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-17T05:23:01.782 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2024-09-17T05:23:01.782 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2024-09-17T05:23:01.782 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-17T05:23:01.782 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2024-09-17T05:23:01.782 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 3, 2024-09-17T05:23:01.782 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 3, 2024-09-17T05:23:01.782 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 3, 2024-09-17T05:23:01.783 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 3, 2024-09-17T05:23:01.783 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-17T05:23:01.783 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.783 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.783 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.783 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-17T05:23:01.783 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.783 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-objecter_ops-0x55dddebfe1e0": { 2024-09-17T05:23:01.783 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-17T05:23:01.783 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 1024, 2024-09-17T05:23:01.783 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-17T05:23:01.783 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2024-09-17T05:23:01.783 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2024-09-17T05:23:01.783 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-17T05:23:01.784 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2024-09-17T05:23:01.784 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-09-17T05:23:01.784 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-09-17T05:23:01.784 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 0, 2024-09-17T05:23:01.784 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 0, 2024-09-17T05:23:01.784 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-17T05:23:01.784 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.784 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.784 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.784 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-17T05:23:01.784 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.784 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-objecter_ops-0x55dddebfe780": { 2024-09-17T05:23:01.784 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-17T05:23:01.785 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 1024, 2024-09-17T05:23:01.785 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-17T05:23:01.785 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2024-09-17T05:23:01.785 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2024-09-17T05:23:01.785 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-17T05:23:01.785 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2024-09-17T05:23:01.785 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-09-17T05:23:01.785 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-09-17T05:23:01.785 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 0, 2024-09-17T05:23:01.785 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 0, 2024-09-17T05:23:01.785 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-17T05:23:01.785 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-17T05:23:01.785 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-17T05:23:01.786 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-17T05:23:01.786 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-17T05:23:01.786 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T05:23:01.786 INFO:teuthology.orchestra.run.smithi167.stdout: "trackedop": { 2024-09-17T05:23:01.786 INFO:teuthology.orchestra.run.smithi167.stdout: "slow_ops_count": 0 2024-09-17T05:23:01.786 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-17T05:23:01.786 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-17T05:23:01.788 INFO:tasks.check_counter:Daemon mgr.x finisher-volumes.complete_latency.avgcount=9 2024-09-17T05:23:01.788 INFO:tasks.check_counter:Daemon mgr.x finisher-volumes.queue_len=0 2024-09-17T05:23:01.788 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-17T05:23:01.796 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-17T05:23:01.797 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T05:23:01.797 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:23:01.816 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18775 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:23:01.817 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T05:23:01.817 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:23:01.874 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18775 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:23:01.875 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-17T05:23:01.875 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:23:01.892 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056027,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16784 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:23:01.892 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-17T05:23:01.892 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:23:01.948 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056027,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16784 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:23:01.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:01.949 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list 2024-09-17T05:23:01.967 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T05:23:01.967 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T05:23:01.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:01.968 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:23:02.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:02.038 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:23:02.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:02.107 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link delete ceph-brx 2024-09-17T05:23:02.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:02.213 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list 2024-09-17T05:23:02.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:02.229 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link delete ceph-brx 2024-09-17T05:23:02.299 INFO:teuthology.orchestra.run.smithi098.stderr:Cannot find device "ceph-brx" 2024-09-17T05:23:02.301 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:23:02.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:02.304 DEBUG:teuthology.orchestra.run.smithi167:> ip netns list 2024-09-17T05:23:02.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-17T05:23:02.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T05:23:02.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:02.323 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:23:02.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:02.390 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:23:02.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:02.458 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link delete ceph-brx 2024-09-17T05:23:02.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:02.556 DEBUG:teuthology.orchestra.run.smithi167:> ip netns list 2024-09-17T05:23:02.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:02.572 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link delete ceph-brx 2024-09-17T05:23:02.641 INFO:teuthology.orchestra.run.smithi167.stderr:Cannot find device "ceph-brx" 2024-09-17T05:23:02.642 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:23:02.643 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-17T05:23:02.652 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T05:23:02.652 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:23:02.763 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:02.761+0000 7f82c6594640 1 -- 172.21.15.98:0/769414114 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82a8003c60 msgr2=0x7f82a8004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:02.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:02.761+0000 7f82c6594640 1 --2- 172.21.15.98:0/769414114 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82a8003c60 0x7f82a8004060 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f82b0001830 tx=0x7f82a8005830 comp rx=0 tx=0).stop 2024-09-17T05:23:02.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:02.761+0000 7f82c6594640 1 -- 172.21.15.98:0/769414114 shutdown_connections 2024-09-17T05:23:02.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:02.761+0000 7f82c6594640 1 --2- 172.21.15.98:0/769414114 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82a8003c60 0x7f82a8004060 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:02.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:02.761+0000 7f82c6594640 1 -- 172.21.15.98:0/769414114 >> 172.21.15.98:0/769414114 conn(0x7f82c00b1950 msgr2=0x7f82c00b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:02.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:02.762+0000 7f82c6594640 1 -- 172.21.15.98:0/769414114 shutdown_connections 2024-09-17T05:23:02.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:02.762+0000 7f82c6594640 1 -- 172.21.15.98:0/769414114 wait complete. 2024-09-17T05:23:02.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:02.763+0000 7f82c6594640 1 Processor -- start 2024-09-17T05:23:02.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:02.763+0000 7f82c6594640 1 -- start start 2024-09-17T05:23:02.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:02.764+0000 7f82c6594640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82a8003c60 0x7f82c00ad0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:02.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:02.764+0000 7f82c6594640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f82c0152720 0x7f82c0156c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:02.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:02.764+0000 7f82c6594640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82c0157170 0x7f82c01e70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:02.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:02.764+0000 7f82c6594640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f82c00b4950 con 0x7f82a8003c60 2024-09-17T05:23:02.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:02.764+0000 7f82c6594640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f82c00b47d0 con 0x7f82c0157170 2024-09-17T05:23:02.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:02.764+0000 7f82c6594640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f82c00b4ad0 con 0x7f82c0152720 2024-09-17T05:23:02.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:02.764+0000 7f82bffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82a8003c60 0x7f82c00ad0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:02.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:02.764+0000 7f82bffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82a8003c60 0x7f82c00ad0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48648/0 (socket says 172.21.15.98:48648) 2024-09-17T05:23:02.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:02.764+0000 7f82bffff640 1 -- 172.21.15.98:0/4245025625 learned_addr learned my addr 172.21.15.98:0/4245025625 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:23:02.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:02.764+0000 7f82c4b31640 1 --2- 172.21.15.98:0/4245025625 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82c0157170 0x7f82c01e70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:02.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:02.764+0000 7f82bf7fe640 1 --2- 172.21.15.98:0/4245025625 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f82c0152720 0x7f82c0156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:02.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:02.764+0000 7f82bffff640 1 -- 172.21.15.98:0/4245025625 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f82c0152720 msgr2=0x7f82c0156c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:02.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:02.764+0000 7f82bffff640 1 --2- 172.21.15.98:0/4245025625 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f82c0152720 0x7f82c0156c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:02.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:02.764+0000 7f82bffff640 1 -- 172.21.15.98:0/4245025625 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82c0157170 msgr2=0x7f82c01e70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:02.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:02.764+0000 7f82bffff640 1 --2- 172.21.15.98:0/4245025625 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82c0157170 0x7f82c01e70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:02.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:02.764+0000 7f82bffff640 1 -- 172.21.15.98:0/4245025625 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82c01f86f0 con 0x7f82a8003c60 2024-09-17T05:23:02.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:02.764+0000 7f82bffff640 1 --2- 172.21.15.98:0/4245025625 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82a8003c60 0x7f82c00ad0b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f82b0001830 tx=0x7f82b0006150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:02.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:02.764+0000 7f82bcff9640 1 -- 172.21.15.98:0/4245025625 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b0003a00 con 0x7f82a8003c60 2024-09-17T05:23:02.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:02.764+0000 7f82bcff9640 1 -- 172.21.15.98:0/4245025625 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f82b0003ba0 con 0x7f82a8003c60 2024-09-17T05:23:02.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:02.765+0000 7f82bcff9640 1 -- 172.21.15.98:0/4245025625 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b0033480 con 0x7f82a8003c60 2024-09-17T05:23:02.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:02.765+0000 7f82c6594640 1 -- 172.21.15.98:0/4245025625 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82c01f89d0 con 0x7f82a8003c60 2024-09-17T05:23:02.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:02.765+0000 7f82c6594640 1 -- 172.21.15.98:0/4245025625 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82c01f8f90 con 0x7f82a8003c60 2024-09-17T05:23:02.769 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:02.765+0000 7f82c6594640 1 -- 172.21.15.98:0/4245025625 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82c01f4d30 con 0x7f82a8003c60 2024-09-17T05:23:02.769 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:02.766+0000 7f82bcff9640 1 -- 172.21.15.98:0/4245025625 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 6) ==== 101594+0+0 (secure 0 0 0) 0x7f82b0045020 con 0x7f82a8003c60 2024-09-17T05:23:02.769 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:02.767+0000 7f82bcff9640 1 --2- 172.21.15.98:0/4245025625 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f82ac078d70 0x7f82ac07b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:02.769 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:02.767+0000 7f82bcff9640 1 -- 172.21.15.98:0/4245025625 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f82b00ba930 con 0x7f82a8003c60 2024-09-17T05:23:02.770 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:02.767+0000 7f82bf7fe640 1 --2- 172.21.15.98:0/4245025625 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f82ac078d70 0x7f82ac07b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:02.770 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:02.767+0000 7f82bf7fe640 1 --2- 172.21.15.98:0/4245025625 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f82ac078d70 0x7f82ac07b230 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f82c0155890 tx=0x7f82b4005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:02.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:02.772+0000 7f82bcff9640 1 -- 172.21.15.98:0/4245025625 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f82b00827b0 con 0x7f82a8003c60 2024-09-17T05:23:02.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:02.945+0000 7f82c6594640 1 -- 172.21.15.98:0/4245025625 --> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f82c00cc730 con 0x7f82ac078d70 2024-09-17T05:23:02.948 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:02.946+0000 7f82bcff9640 1 -- 172.21.15.98:0/4245025625 <== mgr.4103 v2:172.21.15.167:6800/610796449 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13425 (secure 0 0 0) 0x7f82c00cc730 con 0x7f82ac078d70 2024-09-17T05:23:02.948 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:23:02.949 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-17T05:23:02.951 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:02.949+0000 7f82c6594640 1 -- 172.21.15.98:0/4245025625 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f82ac078d70 msgr2=0x7f82ac07b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:02.951 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:02.949+0000 7f82c6594640 1 --2- 172.21.15.98:0/4245025625 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f82ac078d70 0x7f82ac07b230 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f82c0155890 tx=0x7f82b4005f90 comp rx=0 tx=0).stop 2024-09-17T05:23:02.951 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:02.949+0000 7f82c6594640 1 -- 172.21.15.98:0/4245025625 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82a8003c60 msgr2=0x7f82c00ad0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:02.951 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:02.949+0000 7f82c6594640 1 --2- 172.21.15.98:0/4245025625 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82a8003c60 0x7f82c00ad0b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f82b0001830 tx=0x7f82b0006150 comp rx=0 tx=0).stop 2024-09-17T05:23:02.951 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:02.949+0000 7f82c6594640 1 -- 172.21.15.98:0/4245025625 shutdown_connections 2024-09-17T05:23:02.951 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:02.949+0000 7f82c6594640 1 --2- 172.21.15.98:0/4245025625 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f82ac078d70 0x7f82ac07b230 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:02.951 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:02.949+0000 7f82c6594640 1 --2- 172.21.15.98:0/4245025625 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82c0157170 0x7f82c01e70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:02.951 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:02.949+0000 7f82c6594640 1 --2- 172.21.15.98:0/4245025625 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f82c0152720 0x7f82c0156c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:02.951 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:02.949+0000 7f82c6594640 1 --2- 172.21.15.98:0/4245025625 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82a8003c60 0x7f82c00ad0b0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:02.952 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:02.949+0000 7f82c6594640 1 -- 172.21.15.98:0/4245025625 >> 172.21.15.98:0/4245025625 conn(0x7f82c00b1950 msgr2=0x7f82c00b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:02.952 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:02.949+0000 7f82c6594640 1 -- 172.21.15.98:0/4245025625 shutdown_connections 2024-09-17T05:23:02.952 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:02.949+0000 7f82c6594640 1 -- 172.21.15.98:0/4245025625 wait complete. 2024-09-17T05:23:02.962 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2024-09-17T05:23:02.262634+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":181,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":224640,"kb_used_data":4256,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750080,"statfs":{"total":773094113280,"available":772864081920,"internally_reserved":0,"allocated":4358144,"data_stored":2482616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-135002,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-97,"num_write_kb":-173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.899471"},"pg_stats":[{"pgid":"1.0","version":"16'72","reported_seq":133,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T05:22:56.354867+0000","last_change":"2024-09-17T05:21:44.086098+0000","last_active":"2024-09-17T05:22:56.354867+0000","last_peered":"2024-09-17T05:22:56.354867+0000","last_clean":"2024-09-17T05:22:56.354867+0000","last_became_active":"2024-09-17T05:21:44.083477+0000","last_became_peered":"2024-09-17T05:21:44.083477+0000","last_unstale":"2024-09-17T05:22:56.354867+0000","last_undegraded":"2024-09-17T05:22:56.354867+0000","last_fullsized":"2024-09-17T05:22:56.354867+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:42.925756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:42.925756+0000","last_clean_scrub_stamp":"2024-09-17T05:21:42.925756+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:11.410250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509460,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":528384,"data_stored":282307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509460,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":148657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509460,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":974848,"data_stored":739025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542162,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":950272,"data_stored":727031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542162,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":372736,"data_stored":143270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542163,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":376832,"data_stored":144336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542163,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":376832,"data_stored":143768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31576,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":397312,"data_stored":154222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:23:02.963 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:23:03.064 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.062+0000 7f636282a640 1 -- 172.21.15.98:0/2210915699 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f635c074150 msgr2=0x7f635c072ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:03.064 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.062+0000 7f636282a640 1 --2- 172.21.15.98:0/2210915699 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f635c074150 0x7f635c072ba0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6350009900 tx=0x7f635002a460 comp rx=0 tx=0).stop 2024-09-17T05:23:03.064 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.062+0000 7f636282a640 1 -- 172.21.15.98:0/2210915699 shutdown_connections 2024-09-17T05:23:03.064 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.062+0000 7f636282a640 1 --2- 172.21.15.98:0/2210915699 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f635c0746a0 0x7f635c0730e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:03.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.062+0000 7f636282a640 1 --2- 172.21.15.98:0/2210915699 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f635c074150 0x7f635c072ba0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:03.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.062+0000 7f636282a640 1 -- 172.21.15.98:0/2210915699 >> 172.21.15.98:0/2210915699 conn(0x7f635c0b1950 msgr2=0x7f635c0b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:03.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.062+0000 7f636282a640 1 -- 172.21.15.98:0/2210915699 shutdown_connections 2024-09-17T05:23:03.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.062+0000 7f636282a640 1 -- 172.21.15.98:0/2210915699 wait complete. 2024-09-17T05:23:03.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.063+0000 7f636282a640 1 Processor -- start 2024-09-17T05:23:03.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.063+0000 7f636282a640 1 -- start start 2024-09-17T05:23:03.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.064+0000 7f636282a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f635c074150 0x7f635c1f5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:03.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.064+0000 7f636282a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f635c0746a0 0x7f635c1f7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:03.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.064+0000 7f636282a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f635c0b43f0 0x7f635c1f8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:03.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.064+0000 7f636282a640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f635c0cc820 con 0x7f635c0b43f0 2024-09-17T05:23:03.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.064+0000 7f636282a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f635c0cc6a0 con 0x7f635c0746a0 2024-09-17T05:23:03.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.064+0000 7f636282a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f635c0cc9a0 con 0x7f635c074150 2024-09-17T05:23:03.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.064+0000 7f635b7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f635c0746a0 0x7f635c1f7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:03.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.064+0000 7f635bfff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f635c074150 0x7f635c1f5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:03.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.064+0000 7f6360dc7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f635c0b43f0 0x7f635c1f8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:03.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.064+0000 7f635b7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f635c0746a0 0x7f635c1f7d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.98:43578/0 (socket says 172.21.15.98:43578) 2024-09-17T05:23:03.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.064+0000 7f635b7fe640 1 -- 172.21.15.98:0/811865655 learned_addr learned my addr 172.21.15.98:0/811865655 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:23:03.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.065+0000 7f635b7fe640 1 -- 172.21.15.98:0/811865655 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f635c074150 msgr2=0x7f635c1f5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:03.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.065+0000 7f635b7fe640 1 --2- 172.21.15.98:0/811865655 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f635c074150 0x7f635c1f5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:03.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.065+0000 7f635b7fe640 1 -- 172.21.15.98:0/811865655 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f635c0b43f0 msgr2=0x7f635c1f8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:03.070 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.065+0000 7f635b7fe640 1 --2- 172.21.15.98:0/811865655 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f635c0b43f0 0x7f635c1f8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:03.070 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.065+0000 7f635b7fe640 1 -- 172.21.15.98:0/811865655 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f635c0ae710 con 0x7f635c0746a0 2024-09-17T05:23:03.070 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.065+0000 7f6360dc7640 1 --2- 172.21.15.98:0/811865655 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f635c0b43f0 0x7f635c1f8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:23:03.070 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.065+0000 7f635b7fe640 1 --2- 172.21.15.98:0/811865655 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f635c0746a0 0x7f635c1f7d10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6350009230 tx=0x7f63500039e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:03.070 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.065+0000 7f6358ff9640 1 -- 172.21.15.98:0/811865655 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f635003f070 con 0x7f635c0746a0 2024-09-17T05:23:03.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.065+0000 7f6358ff9640 1 -- 172.21.15.98:0/811865655 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6350004890 con 0x7f635c0746a0 2024-09-17T05:23:03.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.065+0000 7f636282a640 1 -- 172.21.15.98:0/811865655 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f635c14f640 con 0x7f635c0746a0 2024-09-17T05:23:03.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.065+0000 7f6358ff9640 1 -- 172.21.15.98:0/811865655 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6350035030 con 0x7f635c0746a0 2024-09-17T05:23:03.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.065+0000 7f636282a640 1 -- 172.21.15.98:0/811865655 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f635c1f8950 con 0x7f635c0746a0 2024-09-17T05:23:03.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.066+0000 7f636282a640 1 -- 172.21.15.98:0/811865655 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f635c14f460 con 0x7f635c0746a0 2024-09-17T05:23:03.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.067+0000 7f6358ff9640 1 -- 172.21.15.98:0/811865655 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 6) ==== 101594+0+0 (secure 0 0 0) 0x7f6350042070 con 0x7f635c0746a0 2024-09-17T05:23:03.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.067+0000 7f6358ff9640 1 --2- 172.21.15.98:0/811865655 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f6348078d40 0x7f634807b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:03.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.067+0000 7f6358ff9640 1 -- 172.21.15.98:0/811865655 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f63500bbbf0 con 0x7f635c0746a0 2024-09-17T05:23:03.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.067+0000 7f635bfff640 1 --2- 172.21.15.98:0/811865655 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f6348078d40 0x7f634807b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:03.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.068+0000 7f635bfff640 1 --2- 172.21.15.98:0/811865655 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f6348078d40 0x7f634807b200 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f634c006fd0 tx=0x7f634c009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:03.074 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.072+0000 7f6358ff9640 1 -- 172.21.15.98:0/811865655 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f635c14f460 con 0x7f635c0746a0 2024-09-17T05:23:03.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.246+0000 7f636282a640 1 -- 172.21.15.98:0/811865655 --> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f635c0b3910 con 0x7f6348078d40 2024-09-17T05:23:03.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.247+0000 7f6358ff9640 1 -- 172.21.15.98:0/811865655 <== mgr.4103 v2:172.21.15.167:6800/610796449 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13425 (secure 0 0 0) 0x7f635c0b3910 con 0x7f6348078d40 2024-09-17T05:23:03.249 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:23:03.250 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-17T05:23:03.252 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.250+0000 7f636282a640 1 -- 172.21.15.98:0/811865655 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f6348078d40 msgr2=0x7f634807b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:03.252 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.250+0000 7f636282a640 1 --2- 172.21.15.98:0/811865655 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f6348078d40 0x7f634807b200 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f634c006fd0 tx=0x7f634c009060 comp rx=0 tx=0).stop 2024-09-17T05:23:03.252 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.250+0000 7f636282a640 1 -- 172.21.15.98:0/811865655 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f635c0746a0 msgr2=0x7f635c1f7d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:03.252 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.250+0000 7f636282a640 1 --2- 172.21.15.98:0/811865655 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f635c0746a0 0x7f635c1f7d10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6350009230 tx=0x7f63500039e0 comp rx=0 tx=0).stop 2024-09-17T05:23:03.252 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.250+0000 7f636282a640 1 -- 172.21.15.98:0/811865655 shutdown_connections 2024-09-17T05:23:03.252 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.250+0000 7f636282a640 1 --2- 172.21.15.98:0/811865655 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f6348078d40 0x7f634807b200 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:03.252 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.250+0000 7f636282a640 1 --2- 172.21.15.98:0/811865655 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f635c0b43f0 0x7f635c1f8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:03.252 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.250+0000 7f636282a640 1 --2- 172.21.15.98:0/811865655 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f635c0746a0 0x7f635c1f7d10 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:03.252 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.250+0000 7f636282a640 1 --2- 172.21.15.98:0/811865655 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f635c074150 0x7f635c1f5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:03.252 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.250+0000 7f636282a640 1 -- 172.21.15.98:0/811865655 >> 172.21.15.98:0/811865655 conn(0x7f635c0b1950 msgr2=0x7f635c072ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:03.253 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.250+0000 7f636282a640 1 -- 172.21.15.98:0/811865655 shutdown_connections 2024-09-17T05:23:03.253 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.250+0000 7f636282a640 1 -- 172.21.15.98:0/811865655 wait complete. 2024-09-17T05:23:03.262 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2024-09-17T05:23:02.262634+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":181,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":224640,"kb_used_data":4256,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750080,"statfs":{"total":773094113280,"available":772864081920,"internally_reserved":0,"allocated":4358144,"data_stored":2482616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-135002,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-97,"num_write_kb":-173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.899471"},"pg_stats":[{"pgid":"1.0","version":"16'72","reported_seq":133,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T05:22:56.354867+0000","last_change":"2024-09-17T05:21:44.086098+0000","last_active":"2024-09-17T05:22:56.354867+0000","last_peered":"2024-09-17T05:22:56.354867+0000","last_clean":"2024-09-17T05:22:56.354867+0000","last_became_active":"2024-09-17T05:21:44.083477+0000","last_became_peered":"2024-09-17T05:21:44.083477+0000","last_unstale":"2024-09-17T05:22:56.354867+0000","last_undegraded":"2024-09-17T05:22:56.354867+0000","last_fullsized":"2024-09-17T05:22:56.354867+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:42.925756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:42.925756+0000","last_clean_scrub_stamp":"2024-09-17T05:21:42.925756+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:11.410250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509460,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":528384,"data_stored":282307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509460,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":148657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509460,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":974848,"data_stored":739025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542162,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":950272,"data_stored":727031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542162,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":372736,"data_stored":143270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542163,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":376832,"data_stored":144336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542163,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":376832,"data_stored":143768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31576,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":397312,"data_stored":154222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:23:03.263 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T05:23:03.263 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:23:03.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.362+0000 7fd5e5d3d640 1 -- 172.21.15.98:0/3327175464 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5e0073bb0 msgr2=0x7fd5e006ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:03.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.362+0000 7fd5e5d3d640 1 --2- 172.21.15.98:0/3327175464 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5e0073bb0 0x7fd5e006ee70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8005fd0 tx=0x7fd5d802a4b0 comp rx=0 tx=0).stop 2024-09-17T05:23:03.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.362+0000 7fd5e5d3d640 1 -- 172.21.15.98:0/3327175464 shutdown_connections 2024-09-17T05:23:03.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.362+0000 7fd5e5d3d640 1 --2- 172.21.15.98:0/3327175464 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5e0073bb0 0x7fd5e006ee70 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:03.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.362+0000 7fd5e5d3d640 1 --2- 172.21.15.98:0/3327175464 >> v2:172.21.15.167:3300/0 conn(0x7fd5e00b43f0 0x7fd5e00b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:03.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.362+0000 7fd5e5d3d640 1 -- 172.21.15.98:0/3327175464 >> 172.21.15.98:0/3327175464 conn(0x7fd5e00b1950 msgr2=0x7fd5e00b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:03.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.362+0000 7fd5e5d3d640 1 -- 172.21.15.98:0/3327175464 shutdown_connections 2024-09-17T05:23:03.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.362+0000 7fd5e5d3d640 1 -- 172.21.15.98:0/3327175464 wait complete. 2024-09-17T05:23:03.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.363+0000 7fd5e5d3d640 1 Processor -- start 2024-09-17T05:23:03.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.364+0000 7fd5e5d3d640 1 -- start start 2024-09-17T05:23:03.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.364+0000 7fd5e5d3d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5e0073bb0 0x7fd5e0140790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:03.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.364+0000 7fd5e5d3d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5e0074150 0x7fd5e01f6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:03.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.364+0000 7fd5e5d3d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd5e00b43f0 0x7fd5e0159e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:03.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.364+0000 7fd5e5d3d640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e006f3b0 con 0x7fd5e00b43f0 2024-09-17T05:23:03.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.364+0000 7fd5e5d3d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e00704c0 con 0x7fd5e0073bb0 2024-09-17T05:23:03.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.364+0000 7fd5e5d3d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fd5e006f530 con 0x7fd5e0074150 2024-09-17T05:23:03.368 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.364+0000 7fd5dffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd5e00b43f0 0x7fd5e0159e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:03.368 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.365+0000 7fd5dffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd5e00b43f0 0x7fd5e0159e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48678/0 (socket says 172.21.15.98:48678) 2024-09-17T05:23:03.368 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.365+0000 7fd5dffff640 1 -- 172.21.15.98:0/450463347 learned_addr learned my addr 172.21.15.98:0/450463347 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:23:03.368 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.365+0000 7fd5df7fe640 1 --2- 172.21.15.98:0/450463347 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5e0073bb0 0x7fd5e0140790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:03.368 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.365+0000 7fd5deffd640 1 --2- 172.21.15.98:0/450463347 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5e0074150 0x7fd5e01f6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:03.368 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.365+0000 7fd5dffff640 1 -- 172.21.15.98:0/450463347 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5e0074150 msgr2=0x7fd5e01f6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:03.368 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.365+0000 7fd5dffff640 1 --2- 172.21.15.98:0/450463347 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5e0074150 0x7fd5e01f6d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:03.368 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.365+0000 7fd5dffff640 1 -- 172.21.15.98:0/450463347 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5e0073bb0 msgr2=0x7fd5e0140790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:03.368 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.365+0000 7fd5dffff640 1 --2- 172.21.15.98:0/450463347 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5e0073bb0 0x7fd5e0140790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:03.369 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.365+0000 7fd5dffff640 1 -- 172.21.15.98:0/450463347 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5e015a380 con 0x7fd5e00b43f0 2024-09-17T05:23:03.369 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.365+0000 7fd5dffff640 1 --2- 172.21.15.98:0/450463347 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd5e00b43f0 0x7fd5e0159e40 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8006010 tx=0x7fd5d8003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:03.369 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.365+0000 7fd5c7fff640 1 -- 172.21.15.98:0/450463347 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d803e030 con 0x7fd5e00b43f0 2024-09-17T05:23:03.369 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.365+0000 7fd5e5d3d640 1 -- 172.21.15.98:0/450463347 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5e01564c0 con 0x7fd5e00b43f0 2024-09-17T05:23:03.369 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.365+0000 7fd5c7fff640 1 -- 172.21.15.98:0/450463347 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd5d8003d10 con 0x7fd5e00b43f0 2024-09-17T05:23:03.369 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.365+0000 7fd5c7fff640 1 -- 172.21.15.98:0/450463347 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d8035040 con 0x7fd5e00b43f0 2024-09-17T05:23:03.369 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.365+0000 7fd5e5d3d640 1 -- 172.21.15.98:0/450463347 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5e0156a80 con 0x7fd5e00b43f0 2024-09-17T05:23:03.370 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.366+0000 7fd5e5d3d640 1 -- 172.21.15.98:0/450463347 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5e00760b0 con 0x7fd5e00b43f0 2024-09-17T05:23:03.370 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.367+0000 7fd5c7fff640 1 -- 172.21.15.98:0/450463347 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 6) ==== 101594+0+0 (secure 0 0 0) 0x7fd5d8041030 con 0x7fd5e00b43f0 2024-09-17T05:23:03.370 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.367+0000 7fd5c7fff640 1 --2- 172.21.15.98:0/450463347 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fd5cc078d40 0x7fd5cc07b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:03.370 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.368+0000 7fd5c7fff640 1 -- 172.21.15.98:0/450463347 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fd5d80bb310 con 0x7fd5e00b43f0 2024-09-17T05:23:03.370 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.368+0000 7fd5df7fe640 1 --2- 172.21.15.98:0/450463347 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fd5cc078d40 0x7fd5cc07b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:03.370 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.368+0000 7fd5df7fe640 1 --2- 172.21.15.98:0/450463347 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fd5cc078d40 0x7fd5cc07b200 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd5d0005fd0 tx=0x7fd5d0009500 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:03.373 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.372+0000 7fd5c7fff640 1 -- 172.21.15.98:0/450463347 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fd5d8083130 con 0x7fd5e00b43f0 2024-09-17T05:23:03.548 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.546+0000 7fd5e5d3d640 1 -- 172.21.15.98:0/450463347 --> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd5e01559f0 con 0x7fd5cc078d40 2024-09-17T05:23:03.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.547+0000 7fd5c7fff640 1 -- 172.21.15.98:0/450463347 <== mgr.4103 v2:172.21.15.167:6800/610796449 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13425 (secure 0 0 0) 0x7fd5e01559f0 con 0x7fd5cc078d40 2024-09-17T05:23:03.549 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:23:03.550 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-17T05:23:03.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.550+0000 7fd5e5d3d640 1 -- 172.21.15.98:0/450463347 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fd5cc078d40 msgr2=0x7fd5cc07b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:03.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.550+0000 7fd5e5d3d640 1 --2- 172.21.15.98:0/450463347 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fd5cc078d40 0x7fd5cc07b200 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd5d0005fd0 tx=0x7fd5d0009500 comp rx=0 tx=0).stop 2024-09-17T05:23:03.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.550+0000 7fd5e5d3d640 1 -- 172.21.15.98:0/450463347 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd5e00b43f0 msgr2=0x7fd5e0159e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:03.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.550+0000 7fd5e5d3d640 1 --2- 172.21.15.98:0/450463347 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd5e00b43f0 0x7fd5e0159e40 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8006010 tx=0x7fd5d8003820 comp rx=0 tx=0).stop 2024-09-17T05:23:03.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.550+0000 7fd5e5d3d640 1 -- 172.21.15.98:0/450463347 shutdown_connections 2024-09-17T05:23:03.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.550+0000 7fd5e5d3d640 1 --2- 172.21.15.98:0/450463347 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fd5cc078d40 0x7fd5cc07b200 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:03.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.550+0000 7fd5e5d3d640 1 --2- 172.21.15.98:0/450463347 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd5e00b43f0 0x7fd5e0159e40 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:03.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.550+0000 7fd5e5d3d640 1 --2- 172.21.15.98:0/450463347 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5e0074150 0x7fd5e01f6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:03.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.550+0000 7fd5e5d3d640 1 --2- 172.21.15.98:0/450463347 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5e0073bb0 0x7fd5e0140790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:03.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.550+0000 7fd5e5d3d640 1 -- 172.21.15.98:0/450463347 >> 172.21.15.98:0/450463347 conn(0x7fd5e00b1950 msgr2=0x7fd5e00af950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:03.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.550+0000 7fd5e5d3d640 1 -- 172.21.15.98:0/450463347 shutdown_connections 2024-09-17T05:23:03.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.550+0000 7fd5e5d3d640 1 -- 172.21.15.98:0/450463347 wait complete. 2024-09-17T05:23:03.562 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2024-09-17T05:23:02.262634+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":181,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":224640,"kb_used_data":4256,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750080,"statfs":{"total":773094113280,"available":772864081920,"internally_reserved":0,"allocated":4358144,"data_stored":2482616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-135002,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-97,"num_write_kb":-173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.899471"},"pg_stats":[{"pgid":"1.0","version":"16'72","reported_seq":133,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T05:22:56.354867+0000","last_change":"2024-09-17T05:21:44.086098+0000","last_active":"2024-09-17T05:22:56.354867+0000","last_peered":"2024-09-17T05:22:56.354867+0000","last_clean":"2024-09-17T05:22:56.354867+0000","last_became_active":"2024-09-17T05:21:44.083477+0000","last_became_peered":"2024-09-17T05:21:44.083477+0000","last_unstale":"2024-09-17T05:22:56.354867+0000","last_undegraded":"2024-09-17T05:22:56.354867+0000","last_fullsized":"2024-09-17T05:22:56.354867+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:42.925756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:42.925756+0000","last_clean_scrub_stamp":"2024-09-17T05:21:42.925756+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:11.410250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509460,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":528384,"data_stored":282307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509460,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":148657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509460,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":974848,"data_stored":739025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542162,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":950272,"data_stored":727031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542162,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":372736,"data_stored":143270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542163,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":376832,"data_stored":144336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542163,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":376832,"data_stored":143768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31576,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":397312,"data_stored":154222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:23:03.563 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:23:03.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.661+0000 7fc908e33640 1 -- 172.21.15.98:0/2039236379 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9040b43f0 msgr2=0x7fc9040b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:03.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.661+0000 7fc908e33640 1 --2- 172.21.15.98:0/2039236379 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9040b43f0 0x7fc9040b47d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc005fd0 tx=0x7fc8fc02a780 comp rx=0 tx=0).stop 2024-09-17T05:23:03.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.661+0000 7fc908e33640 1 -- 172.21.15.98:0/2039236379 shutdown_connections 2024-09-17T05:23:03.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.661+0000 7fc908e33640 1 --2- 172.21.15.98:0/2039236379 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9040b43f0 0x7fc9040b47d0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:03.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.661+0000 7fc908e33640 1 -- 172.21.15.98:0/2039236379 >> 172.21.15.98:0/2039236379 conn(0x7fc9040b1950 msgr2=0x7fc9040b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:03.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.661+0000 7fc908e33640 1 -- 172.21.15.98:0/2039236379 shutdown_connections 2024-09-17T05:23:03.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.661+0000 7fc908e33640 1 -- 172.21.15.98:0/2039236379 wait complete. 2024-09-17T05:23:03.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.662+0000 7fc908e33640 1 Processor -- start 2024-09-17T05:23:03.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.662+0000 7fc908e33640 1 -- start start 2024-09-17T05:23:03.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.663+0000 7fc908e33640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc904073bb0 0x7fc90409aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:03.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.663+0000 7fc908e33640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc904074150 0x7fc904152f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:03.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.663+0000 7fc908e33640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9040b43f0 0x7fc9041541f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:03.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.663+0000 7fc908e33640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc9040746a0 con 0x7fc904074150 2024-09-17T05:23:03.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.663+0000 7fc908e33640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc90415dd20 con 0x7fc9040b43f0 2024-09-17T05:23:03.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.663+0000 7fc908e33640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fc904074820 con 0x7fc904073bb0 2024-09-17T05:23:03.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.663+0000 7fc901d9b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc904074150 0x7fc904152f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:03.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.663+0000 7fc901d9b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc904074150 0x7fc904152f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48708/0 (socket says 172.21.15.98:48708) 2024-09-17T05:23:03.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.663+0000 7fc901d9b640 1 -- 172.21.15.98:0/4073541633 learned_addr learned my addr 172.21.15.98:0/4073541633 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:23:03.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.663+0000 7fc902d9d640 1 --2- 172.21.15.98:0/4073541633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9040b43f0 0x7fc9041541f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:03.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.663+0000 7fc90259c640 1 --2- 172.21.15.98:0/4073541633 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc904073bb0 0x7fc90409aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:03.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.663+0000 7fc901d9b640 1 -- 172.21.15.98:0/4073541633 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc904073bb0 msgr2=0x7fc90409aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:03.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.663+0000 7fc901d9b640 1 --2- 172.21.15.98:0/4073541633 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc904073bb0 0x7fc90409aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:03.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.663+0000 7fc901d9b640 1 -- 172.21.15.98:0/4073541633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9040b43f0 msgr2=0x7fc9041541f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:03.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.663+0000 7fc901d9b640 1 --2- 172.21.15.98:0/4073541633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9040b43f0 0x7fc9041541f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:03.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.664+0000 7fc901d9b640 1 -- 172.21.15.98:0/4073541633 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc90415a4a0 con 0x7fc904074150 2024-09-17T05:23:03.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.664+0000 7fc902d9d640 1 --2- 172.21.15.98:0/4073541633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9040b43f0 0x7fc9041541f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:23:03.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.664+0000 7fc901d9b640 1 --2- 172.21.15.98:0/4073541633 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc904074150 0x7fc904152f90 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec00c3d0 tx=0x7fc8ec00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:03.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.664+0000 7fc8faffd640 1 -- 172.21.15.98:0/4073541633 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec011790 con 0x7fc904074150 2024-09-17T05:23:03.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.664+0000 7fc8faffd640 1 -- 172.21.15.98:0/4073541633 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc8ec017070 con 0x7fc904074150 2024-09-17T05:23:03.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.664+0000 7fc908e33640 1 -- 172.21.15.98:0/4073541633 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc90415a780 con 0x7fc904074150 2024-09-17T05:23:03.668 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.664+0000 7fc8faffd640 1 -- 172.21.15.98:0/4073541633 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec011cc0 con 0x7fc904074150 2024-09-17T05:23:03.668 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.664+0000 7fc908e33640 1 -- 172.21.15.98:0/4073541633 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc904158a10 con 0x7fc904074150 2024-09-17T05:23:03.668 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.665+0000 7fc908e33640 1 -- 172.21.15.98:0/4073541633 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9040b47d0 con 0x7fc904074150 2024-09-17T05:23:03.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.665+0000 7fc8faffd640 1 -- 172.21.15.98:0/4073541633 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 6) ==== 101594+0+0 (secure 0 0 0) 0x7fc8ec01c460 con 0x7fc904074150 2024-09-17T05:23:03.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.666+0000 7fc8faffd640 1 --2- 172.21.15.98:0/4073541633 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fc8e4078d40 0x7fc8e407b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:03.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.666+0000 7fc8faffd640 1 -- 172.21.15.98:0/4073541633 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fc8ec09ab30 con 0x7fc904074150 2024-09-17T05:23:03.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.666+0000 7fc90259c640 1 --2- 172.21.15.98:0/4073541633 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fc8e4078d40 0x7fc8e407b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:03.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.667+0000 7fc90259c640 1 --2- 172.21.15.98:0/4073541633 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fc8e4078d40 0x7fc8e407b200 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc033000 tx=0x7fc8fc004ab0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:03.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.670+0000 7fc8faffd640 1 -- 172.21.15.98:0/4073541633 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fc9040cf9d0 con 0x7fc904074150 2024-09-17T05:23:03.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.846+0000 7fc908e33640 1 -- 172.21.15.98:0/4073541633 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc9041580d0 con 0x7fc904074150 2024-09-17T05:23:03.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.846+0000 7fc8faffd640 1 -- 172.21.15.98:0/4073541633 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+13022 (secure 0 0 0) 0x7fc8ec063000 con 0x7fc904074150 2024-09-17T05:23:03.848 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:23:03.848 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":35,"fsid":"fcbf5a43-b3d8-497c-b15d-3cc022477cf0","created":"2024-09-17T05:21:29.852143+0000","modified":"2024-09-17T05:22:58.370617+0000","last_up_change":"2024-09-17T05:21:42.925756+0000","last_in_change":"2024-09-17T05:21:32.893880+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:21:42.263011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ad711a-df74-438b-b0dc-1499d685c958","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6825","nonce":3644101529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6827","nonce":3644101529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6831","nonce":3644101529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":3644101529},{"type":"v1","addr":"172.21.15.98:6829","nonce":3644101529}]},"public_addr":"172.21.15.98:6825/3644101529","cluster_addr":"172.21.15.98:6827/3644101529","heartbeat_back_addr":"172.21.15.98:6831/3644101529","heartbeat_front_addr":"172.21.15.98:6829/3644101529","state":["exists","up"]},{"osd":1,"uuid":"f0ccb08d-4d8d-47b8-9320-8c372a6605b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6817","nonce":3902180920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6819","nonce":3902180920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6823","nonce":3902180920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3902180920},{"type":"v1","addr":"172.21.15.98:6821","nonce":3902180920}]},"public_addr":"172.21.15.98:6817/3902180920","cluster_addr":"172.21.15.98:6819/3902180920","heartbeat_back_addr":"172.21.15.98:6823/3902180920","heartbeat_front_addr":"172.21.15.98:6821/3902180920","state":["exists","up"]},{"osd":2,"uuid":"a0985398-5e5f-494f-8abf-f785f19e94ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6801","nonce":1518887101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6803","nonce":1518887101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6807","nonce":1518887101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1518887101},{"type":"v1","addr":"172.21.15.98:6805","nonce":1518887101}]},"public_addr":"172.21.15.98:6801/1518887101","cluster_addr":"172.21.15.98:6803/1518887101","heartbeat_back_addr":"172.21.15.98:6807/1518887101","heartbeat_front_addr":"172.21.15.98:6805/1518887101","state":["exists","up"]},{"osd":3,"uuid":"e960be2e-0c3a-426e-9507-d3be5895f9e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6809","nonce":4125246091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6811","nonce":4125246091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6815","nonce":4125246091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":4125246091},{"type":"v1","addr":"172.21.15.98:6813","nonce":4125246091}]},"public_addr":"172.21.15.98:6809/4125246091","cluster_addr":"172.21.15.98:6811/4125246091","heartbeat_back_addr":"172.21.15.98:6815/4125246091","heartbeat_front_addr":"172.21.15.98:6813/4125246091","state":["exists","up"]},{"osd":4,"uuid":"49118c00-3dc1-43ef-8ed4-aca61e56a507","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6811","nonce":765789888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6813","nonce":765789888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6817","nonce":765789888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":765789888},{"type":"v1","addr":"172.21.15.167:6815","nonce":765789888}]},"public_addr":"172.21.15.167:6811/765789888","cluster_addr":"172.21.15.167:6813/765789888","heartbeat_back_addr":"172.21.15.167:6817/765789888","heartbeat_front_addr":"172.21.15.167:6815/765789888","state":["exists","up"]},{"osd":5,"uuid":"9f4e0143-2b3d-40e4-bfb5-043d9a9f4ba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6803","nonce":2567019914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6805","nonce":2567019914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6809","nonce":2567019914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2567019914},{"type":"v1","addr":"172.21.15.167:6807","nonce":2567019914}]},"public_addr":"172.21.15.167:6803/2567019914","cluster_addr":"172.21.15.167:6805/2567019914","heartbeat_back_addr":"172.21.15.167:6809/2567019914","heartbeat_front_addr":"172.21.15.167:6807/2567019914","state":["exists","up"]},{"osd":6,"uuid":"28720514-e627-4dea-8f4d-bd311ec31361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6819","nonce":96262631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6821","nonce":96262631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6825","nonce":96262631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":96262631},{"type":"v1","addr":"172.21.15.167:6823","nonce":96262631}]},"public_addr":"172.21.15.167:6819/96262631","cluster_addr":"172.21.15.167:6821/96262631","heartbeat_back_addr":"172.21.15.167:6825/96262631","heartbeat_front_addr":"172.21.15.167:6823/96262631","state":["exists","up"]},{"osd":7,"uuid":"01edaf9c-3898-406e-85b0-774cfda60adf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6827","nonce":4169560909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6829","nonce":4169560909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6833","nonce":4169560909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":4169560909},{"type":"v1","addr":"172.21.15.167:6831","nonce":4169560909}]},"public_addr":"172.21.15.167:6827/4169560909","cluster_addr":"172.21.15.167:6829/4169560909","heartbeat_back_addr":"172.21.15.167:6833/4169560909","heartbeat_front_addr":"172.21.15.167:6831/4169560909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:40.054920+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.177110+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.749278+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.400155+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.503576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.196417+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.371063+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:21:39.212852+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.167:6837/3889162905":"2024-09-18T05:22:55.361131+0000","172.21.15.167:6835/3889162905":"2024-09-18T05:22:55.361131+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:23:03.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.848+0000 7fc908e33640 1 -- 172.21.15.98:0/4073541633 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fc8e4078d40 msgr2=0x7fc8e407b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:03.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.848+0000 7fc908e33640 1 --2- 172.21.15.98:0/4073541633 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fc8e4078d40 0x7fc8e407b200 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc033000 tx=0x7fc8fc004ab0 comp rx=0 tx=0).stop 2024-09-17T05:23:03.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.848+0000 7fc908e33640 1 -- 172.21.15.98:0/4073541633 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc904074150 msgr2=0x7fc904152f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:03.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.848+0000 7fc908e33640 1 --2- 172.21.15.98:0/4073541633 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc904074150 0x7fc904152f90 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec00c3d0 tx=0x7fc8ec00c890 comp rx=0 tx=0).stop 2024-09-17T05:23:03.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.848+0000 7fc908e33640 1 -- 172.21.15.98:0/4073541633 shutdown_connections 2024-09-17T05:23:03.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.848+0000 7fc908e33640 1 --2- 172.21.15.98:0/4073541633 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fc8e4078d40 0x7fc8e407b200 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:03.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.848+0000 7fc908e33640 1 --2- 172.21.15.98:0/4073541633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9040b43f0 0x7fc9041541f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:03.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.848+0000 7fc908e33640 1 --2- 172.21.15.98:0/4073541633 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc904074150 0x7fc904152f90 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:03.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.848+0000 7fc908e33640 1 --2- 172.21.15.98:0/4073541633 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc904073bb0 0x7fc90409aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:03.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.848+0000 7fc908e33640 1 -- 172.21.15.98:0/4073541633 >> 172.21.15.98:0/4073541633 conn(0x7fc9040b1950 msgr2=0x7fc9040afe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:03.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.848+0000 7fc908e33640 1 -- 172.21.15.98:0/4073541633 shutdown_connections 2024-09-17T05:23:03.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:03.848+0000 7fc908e33640 1 -- 172.21.15.98:0/4073541633 wait complete. 2024-09-17T05:23:04.862 INFO:tasks.ceph:Scrubbing osd.0 2024-09-17T05:23:04.862 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-17T05:23:04.980 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:04.979+0000 7f9282847640 1 -- 172.21.15.98:0/287087957 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f927c073b40 msgr2=0x7f927c0cb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:04.980 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:04.979+0000 7f9282847640 1 --2- 172.21.15.98:0/287087957 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f927c073b40 0x7f927c0cb040 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f9270009830 tx=0x7f927002c6b0 comp rx=0 tx=0).stop 2024-09-17T05:23:04.980 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:04.979+0000 7f9282847640 1 -- 172.21.15.98:0/287087957 shutdown_connections 2024-09-17T05:23:04.980 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:04.979+0000 7f9282847640 1 --2- 172.21.15.98:0/287087957 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f927c073b40 0x7f927c0cb040 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:04.981 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:04.979+0000 7f9282847640 1 -- 172.21.15.98:0/287087957 >> 172.21.15.98:0/287087957 conn(0x7f927c0cffe0 msgr2=0x7f927c0d03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:04.981 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:04.979+0000 7f9282847640 1 -- 172.21.15.98:0/287087957 shutdown_connections 2024-09-17T05:23:04.981 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:04.979+0000 7f9282847640 1 -- 172.21.15.98:0/287087957 wait complete. 2024-09-17T05:23:04.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:04.980+0000 7f9282847640 1 Processor -- start 2024-09-17T05:23:04.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:04.980+0000 7f9282847640 1 -- start start 2024-09-17T05:23:04.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:04.981+0000 7f9282847640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f927c072ee0 0x7f927c15a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:04.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:04.981+0000 7f9282847640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f927c073b40 0x7f927c0a0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:04.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:04.981+0000 7f9282847640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f927c15e300 0x7f927c0a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:04.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:04.981+0000 7f9282847640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f927c0cbc90 con 0x7f927c15e300 2024-09-17T05:23:04.985 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:04.981+0000 7f9282847640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f927c0af870 con 0x7f927c072ee0 2024-09-17T05:23:04.985 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:04.981+0000 7f9282847640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f927c0cbe10 con 0x7f927c073b40 2024-09-17T05:23:04.985 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:04.981+0000 7f9280de4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f927c15e300 0x7f927c0a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:04.985 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:04.981+0000 7f9280de4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f927c15e300 0x7f927c0a0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48728/0 (socket says 172.21.15.98:48728) 2024-09-17T05:23:04.985 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:04.981+0000 7f9280de4640 1 -- 172.21.15.98:0/1436289322 learned_addr learned my addr 172.21.15.98:0/1436289322 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:23:04.985 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:04.981+0000 7f927bfff640 1 --2- 172.21.15.98:0/1436289322 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f927c072ee0 0x7f927c15a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:04.985 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:04.981+0000 7f927b7fe640 1 --2- 172.21.15.98:0/1436289322 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f927c073b40 0x7f927c0a0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:04.985 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:04.981+0000 7f9280de4640 1 -- 172.21.15.98:0/1436289322 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f927c073b40 msgr2=0x7f927c0a0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:04.985 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:04.981+0000 7f9280de4640 1 --2- 172.21.15.98:0/1436289322 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f927c073b40 0x7f927c0a0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:04.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:04.981+0000 7f9280de4640 1 -- 172.21.15.98:0/1436289322 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f927c072ee0 msgr2=0x7f927c15a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:04.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:04.981+0000 7f9280de4640 1 --2- 172.21.15.98:0/1436289322 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f927c072ee0 0x7f927c15a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:04.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:04.981+0000 7f9280de4640 1 -- 172.21.15.98:0/1436289322 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f927c0c9700 con 0x7f927c15e300 2024-09-17T05:23:04.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:04.981+0000 7f9280de4640 1 --2- 172.21.15.98:0/1436289322 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f927c15e300 0x7f927c0a0ab0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f927400cb30 tx=0x7f927400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:04.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:04.982+0000 7f9278ff9640 1 -- 172.21.15.98:0/1436289322 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9274016020 con 0x7f927c15e300 2024-09-17T05:23:04.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:04.982+0000 7f9278ff9640 1 -- 172.21.15.98:0/1436289322 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f927400ad90 con 0x7f927c15e300 2024-09-17T05:23:04.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:04.982+0000 7f9282847640 1 -- 172.21.15.98:0/1436289322 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f927c0c99e0 con 0x7f927c15e300 2024-09-17T05:23:04.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:04.982+0000 7f9278ff9640 1 -- 172.21.15.98:0/1436289322 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9274012680 con 0x7f927c15e300 2024-09-17T05:23:04.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:04.982+0000 7f9282847640 1 -- 172.21.15.98:0/1436289322 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f927c0c9fa0 con 0x7f927c15e300 2024-09-17T05:23:04.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:04.982+0000 7f9282847640 1 -- 172.21.15.98:0/1436289322 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f927c073430 con 0x7f927c15e300 2024-09-17T05:23:04.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:04.983+0000 7f9278ff9640 1 -- 172.21.15.98:0/1436289322 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 6) ==== 101594+0+0 (secure 0 0 0) 0x7f9274019020 con 0x7f927c15e300 2024-09-17T05:23:04.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:04.984+0000 7f9278ff9640 1 --2- 172.21.15.98:0/1436289322 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f9268078d40 0x7f926807b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:04.988 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:04.984+0000 7f9278ff9640 1 -- 172.21.15.98:0/1436289322 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f927409b380 con 0x7f927c15e300 2024-09-17T05:23:04.988 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:04.984+0000 7f9278ff9640 1 --2- 172.21.15.98:0/1436289322 >> [v2:172.21.15.98:6824/3644101529,v1:172.21.15.98:6825/3644101529] conn(0x7f926807ec00 0x7f9268081020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:04.988 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:04.984+0000 7f9278ff9640 1 -- 172.21.15.98:0/1436289322 --> [v2:172.21.15.98:6824/3644101529,v1:172.21.15.98:6825/3644101529] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f927401fe70 con 0x7f926807ec00 2024-09-17T05:23:04.988 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:04.984+0000 7f9278ff9640 1 -- 172.21.15.98:0/1436289322 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f92740a2050 con 0x7f927c15e300 2024-09-17T05:23:04.988 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:04.984+0000 7f927bfff640 1 --2- 172.21.15.98:0/1436289322 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f9268078d40 0x7f926807b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:04.988 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:04.984+0000 7f927b7fe640 1 --2- 172.21.15.98:0/1436289322 >> [v2:172.21.15.98:6824/3644101529,v1:172.21.15.98:6825/3644101529] conn(0x7f926807ec00 0x7f9268081020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:04.988 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:04.984+0000 7f927b7fe640 1 --2- 172.21.15.98:0/1436289322 >> [v2:172.21.15.98:6824/3644101529,v1:172.21.15.98:6825/3644101529] conn(0x7f926807ec00 0x7f9268081020 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:04.988 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:04.985+0000 7f927bfff640 1 --2- 172.21.15.98:0/1436289322 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f9268078d40 0x7f926807b200 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f926c000c00 tx=0x7f926c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:04.988 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:04.985+0000 7f9278ff9640 1 -- 172.21.15.98:0/1436289322 <== osd.0 v2:172.21.15.98:6824/3644101529 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f927401fe70 con 0x7f926807ec00 2024-09-17T05:23:04.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:04.997+0000 7f9282847640 1 -- 172.21.15.98:0/1436289322 --> [v2:172.21.15.98:6824/3644101529,v1:172.21.15.98:6825/3644101529] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f927c0ceeb0 con 0x7f926807ec00 2024-09-17T05:23:04.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:04.998+0000 7f9278ff9640 1 -- 172.21.15.98:0/1436289322 <== osd.0 v2:172.21.15.98:6824/3644101529 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f927c0ceeb0 con 0x7f926807ec00 2024-09-17T05:23:04.999 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T05:23:04.999 INFO:teuthology.orchestra.run.smithi098.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T05:23:04.999 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T05:23:05.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:04.998+0000 7f9282847640 1 -- 172.21.15.98:0/1436289322 >> [v2:172.21.15.98:6824/3644101529,v1:172.21.15.98:6825/3644101529] conn(0x7f926807ec00 msgr2=0x7f9268081020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:05.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:04.998+0000 7f9282847640 1 --2- 172.21.15.98:0/1436289322 >> [v2:172.21.15.98:6824/3644101529,v1:172.21.15.98:6825/3644101529] conn(0x7f926807ec00 0x7f9268081020 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:05.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:04.998+0000 7f9282847640 1 -- 172.21.15.98:0/1436289322 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f9268078d40 msgr2=0x7f926807b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:05.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:04.998+0000 7f9282847640 1 --2- 172.21.15.98:0/1436289322 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f9268078d40 0x7f926807b200 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f926c000c00 tx=0x7f926c009040 comp rx=0 tx=0).stop 2024-09-17T05:23:05.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:04.998+0000 7f9282847640 1 -- 172.21.15.98:0/1436289322 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f927c15e300 msgr2=0x7f927c0a0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:05.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:04.998+0000 7f9282847640 1 --2- 172.21.15.98:0/1436289322 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f927c15e300 0x7f927c0a0ab0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f927400cb30 tx=0x7f927400a060 comp rx=0 tx=0).stop 2024-09-17T05:23:05.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:04.998+0000 7f9280de4640 1 -- 172.21.15.98:0/1436289322 reap_dead start 2024-09-17T05:23:05.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:04.998+0000 7f9282847640 1 -- 172.21.15.98:0/1436289322 shutdown_connections 2024-09-17T05:23:05.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:04.998+0000 7f9282847640 1 -- 172.21.15.98:0/1436289322 >> 172.21.15.98:0/1436289322 conn(0x7f927c0cffe0 msgr2=0x7f927c15b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:05.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:04.998+0000 7f9282847640 1 -- 172.21.15.98:0/1436289322 shutdown_connections 2024-09-17T05:23:05.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:04.998+0000 7f9282847640 1 -- 172.21.15.98:0/1436289322 wait complete. 2024-09-17T05:23:05.010 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-17T05:23:05.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.112+0000 7f241b07f640 1 -- 172.21.15.98:0/433703401 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23fc0052e0 msgr2=0x7f23fc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:05.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.112+0000 7f241b07f640 1 --2- 172.21.15.98:0/433703401 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23fc0052e0 0x7f23fc00b9c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f240c005fd0 tx=0x7f23fc005830 comp rx=0 tx=0).stop 2024-09-17T05:23:05.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.112+0000 7f241b07f640 1 -- 172.21.15.98:0/433703401 shutdown_connections 2024-09-17T05:23:05.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.112+0000 7f241b07f640 1 --2- 172.21.15.98:0/433703401 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23fc0052e0 0x7f23fc00b9c0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:05.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.112+0000 7f241b07f640 1 -- 172.21.15.98:0/433703401 >> 172.21.15.98:0/433703401 conn(0x7f24140b1950 msgr2=0x7f24140b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:05.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.112+0000 7f241b07f640 1 -- 172.21.15.98:0/433703401 shutdown_connections 2024-09-17T05:23:05.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.112+0000 7f241b07f640 1 -- 172.21.15.98:0/433703401 wait complete. 2024-09-17T05:23:05.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.113+0000 7f241b07f640 1 Processor -- start 2024-09-17T05:23:05.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.113+0000 7f241b07f640 1 -- start start 2024-09-17T05:23:05.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.114+0000 7f241b07f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23fc0052e0 0x7f24140cf9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:05.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.114+0000 7f241b07f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f241414c7e0 0x7f24140b0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:05.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.114+0000 7f241b07f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f24140b1190 0x7f2414152200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:05.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.114+0000 7f241b07f640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f24140ad0c0 con 0x7f24140b1190 2024-09-17T05:23:05.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.114+0000 7f241b07f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f24140acf40 con 0x7f241414c7e0 2024-09-17T05:23:05.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.114+0000 7f241b07f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f24140ad240 con 0x7f23fc0052e0 2024-09-17T05:23:05.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.114+0000 7f241961c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f24140b1190 0x7f2414152200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:05.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.114+0000 7f241961c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f24140b1190 0x7f2414152200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48748/0 (socket says 172.21.15.98:48748) 2024-09-17T05:23:05.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.114+0000 7f241961c640 1 -- 172.21.15.98:0/307511163 learned_addr learned my addr 172.21.15.98:0/307511163 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:23:05.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.114+0000 7f2413fff640 1 --2- 172.21.15.98:0/307511163 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f241414c7e0 0x7f24140b0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:05.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.114+0000 7f2418e1b640 1 --2- 172.21.15.98:0/307511163 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23fc0052e0 0x7f24140cf9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:05.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.114+0000 7f241961c640 1 -- 172.21.15.98:0/307511163 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23fc0052e0 msgr2=0x7f24140cf9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:05.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.114+0000 7f241961c640 1 --2- 172.21.15.98:0/307511163 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23fc0052e0 0x7f24140cf9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:05.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.114+0000 7f241961c640 1 -- 172.21.15.98:0/307511163 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f241414c7e0 msgr2=0x7f24140b0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:05.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.114+0000 7f241961c640 1 --2- 172.21.15.98:0/307511163 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f241414c7e0 0x7f24140b0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:05.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.114+0000 7f241961c640 1 -- 172.21.15.98:0/307511163 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24141509e0 con 0x7f24140b1190 2024-09-17T05:23:05.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.114+0000 7f2418e1b640 1 --2- 172.21.15.98:0/307511163 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23fc0052e0 0x7f24140cf9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:23:05.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.114+0000 7f2413fff640 1 --2- 172.21.15.98:0/307511163 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f241414c7e0 0x7f24140b0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:23:05.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.114+0000 7f241961c640 1 --2- 172.21.15.98:0/307511163 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f24140b1190 0x7f2414152200 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f240c009e20 tx=0x7f240c004250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:05.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.115+0000 7f24117fa640 1 -- 172.21.15.98:0/307511163 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f240c009200 con 0x7f24140b1190 2024-09-17T05:23:05.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.115+0000 7f24117fa640 1 -- 172.21.15.98:0/307511163 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f240c043070 con 0x7f24140b1190 2024-09-17T05:23:05.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.115+0000 7f24117fa640 1 -- 172.21.15.98:0/307511163 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f240c009ad0 con 0x7f24140b1190 2024-09-17T05:23:05.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.115+0000 7f241b07f640 1 -- 172.21.15.98:0/307511163 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2414150cc0 con 0x7f24140b1190 2024-09-17T05:23:05.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.115+0000 7f241b07f640 1 -- 172.21.15.98:0/307511163 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2414151280 con 0x7f24140b1190 2024-09-17T05:23:05.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.116+0000 7f241b07f640 1 -- 172.21.15.98:0/307511163 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2414073fb0 con 0x7f24140b1190 2024-09-17T05:23:05.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.116+0000 7f24117fa640 1 -- 172.21.15.98:0/307511163 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 6) ==== 101594+0+0 (secure 0 0 0) 0x7f240c048460 con 0x7f24140b1190 2024-09-17T05:23:05.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.117+0000 7f24117fa640 1 --2- 172.21.15.98:0/307511163 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f2400078d70 0x7f240007b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:05.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.117+0000 7f24117fa640 1 -- 172.21.15.98:0/307511163 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f240c0bbda0 con 0x7f24140b1190 2024-09-17T05:23:05.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.117+0000 7f2418e1b640 1 --2- 172.21.15.98:0/307511163 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f2400078d70 0x7f240007b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:05.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.117+0000 7f2418e1b640 1 --2- 172.21.15.98:0/307511163 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f2400078d70 0x7f240007b230 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2404000fb0 tx=0x7f24040067a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:05.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.121+0000 7f24117fa640 1 -- 172.21.15.98:0/307511163 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f240c084270 con 0x7f24140b1190 2024-09-17T05:23:05.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.296+0000 7f241b07f640 1 -- 172.21.15.98:0/307511163 --> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f241409d850 con 0x7f2400078d70 2024-09-17T05:23:05.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.297+0000 7f24117fa640 1 -- 172.21.15.98:0/307511163 <== mgr.4103 v2:172.21.15.167:6800/610796449 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f241409d850 con 0x7f2400078d70 2024-09-17T05:23:05.298 INFO:teuthology.orchestra.run.smithi098.stderr:instructed osd(s) 0 to deep-scrub 2024-09-17T05:23:05.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.299+0000 7f241b07f640 1 -- 172.21.15.98:0/307511163 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f2400078d70 msgr2=0x7f240007b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:05.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.299+0000 7f241b07f640 1 --2- 172.21.15.98:0/307511163 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f2400078d70 0x7f240007b230 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2404000fb0 tx=0x7f24040067a0 comp rx=0 tx=0).stop 2024-09-17T05:23:05.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.299+0000 7f241b07f640 1 -- 172.21.15.98:0/307511163 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f24140b1190 msgr2=0x7f2414152200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:05.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.299+0000 7f241b07f640 1 --2- 172.21.15.98:0/307511163 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f24140b1190 0x7f2414152200 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f240c009e20 tx=0x7f240c004250 comp rx=0 tx=0).stop 2024-09-17T05:23:05.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.299+0000 7f241b07f640 1 -- 172.21.15.98:0/307511163 shutdown_connections 2024-09-17T05:23:05.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.299+0000 7f241b07f640 1 --2- 172.21.15.98:0/307511163 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f2400078d70 0x7f240007b230 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:05.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.299+0000 7f241b07f640 1 --2- 172.21.15.98:0/307511163 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f24140b1190 0x7f2414152200 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:05.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.299+0000 7f241b07f640 1 --2- 172.21.15.98:0/307511163 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f241414c7e0 0x7f24140b0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:05.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.299+0000 7f241b07f640 1 --2- 172.21.15.98:0/307511163 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23fc0052e0 0x7f24140cf9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:05.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.299+0000 7f241b07f640 1 -- 172.21.15.98:0/307511163 >> 172.21.15.98:0/307511163 conn(0x7f24140b1950 msgr2=0x7f241409d140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:05.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.299+0000 7f241b07f640 1 -- 172.21.15.98:0/307511163 shutdown_connections 2024-09-17T05:23:05.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.299+0000 7f241b07f640 1 -- 172.21.15.98:0/307511163 wait complete. 2024-09-17T05:23:05.311 INFO:tasks.ceph:Scrubbing osd.1 2024-09-17T05:23:05.311 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-17T05:23:05.416 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.415+0000 7fd307be8640 1 -- 172.21.15.98:0/2896800798 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd30015e340 msgr2=0x7fd3000d0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:05.417 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.415+0000 7fd307be8640 1 --2- 172.21.15.98:0/2896800798 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd30015e340 0x7fd3000d0800 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0005fd0 tx=0x7fd2f002aa00 comp rx=0 tx=0).stop 2024-09-17T05:23:05.417 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.415+0000 7fd307be8640 1 -- 172.21.15.98:0/2896800798 shutdown_connections 2024-09-17T05:23:05.417 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.415+0000 7fd307be8640 1 --2- 172.21.15.98:0/2896800798 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3000b8900 0x7fd3000d0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:05.417 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.415+0000 7fd307be8640 1 --2- 172.21.15.98:0/2896800798 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd30015e340 0x7fd3000d0800 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:05.417 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.415+0000 7fd307be8640 1 -- 172.21.15.98:0/2896800798 >> 172.21.15.98:0/2896800798 conn(0x7fd3000d4050 msgr2=0x7fd3000d4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:05.417 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.416+0000 7fd307be8640 1 -- 172.21.15.98:0/2896800798 shutdown_connections 2024-09-17T05:23:05.417 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.416+0000 7fd307be8640 1 -- 172.21.15.98:0/2896800798 wait complete. 2024-09-17T05:23:05.418 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.417+0000 7fd307be8640 1 Processor -- start 2024-09-17T05:23:05.418 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.417+0000 7fd307be8640 1 -- start start 2024-09-17T05:23:05.420 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.417+0000 7fd307be8640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3000b8900 0x7fd300160e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:05.420 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.417+0000 7fd307be8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd30015e340 0x7fd3001f7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:05.420 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.417+0000 7fd307be8640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd30015e820 0x7fd3001f8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:05.420 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.417+0000 7fd307be8640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd3000d2590 con 0x7fd30015e820 2024-09-17T05:23:05.420 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.417+0000 7fd307be8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd3000d2410 con 0x7fd30015e340 2024-09-17T05:23:05.420 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.417+0000 7fd307be8640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fd3000d2710 con 0x7fd3000b8900 2024-09-17T05:23:05.420 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.418+0000 7fd306185640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd30015e820 0x7fd3001f8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:05.420 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.418+0000 7fd306185640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd30015e820 0x7fd3001f8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48770/0 (socket says 172.21.15.98:48770) 2024-09-17T05:23:05.420 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.418+0000 7fd306185640 1 -- 172.21.15.98:0/1710274709 learned_addr learned my addr 172.21.15.98:0/1710274709 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:23:05.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.418+0000 7fd305183640 1 --2- 172.21.15.98:0/1710274709 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd30015e340 0x7fd3001f7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:05.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.418+0000 7fd306185640 1 -- 172.21.15.98:0/1710274709 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3000b8900 msgr2=0x7fd300160e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:05.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.418+0000 7fd306185640 1 --2- 172.21.15.98:0/1710274709 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3000b8900 0x7fd300160e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:05.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.418+0000 7fd306185640 1 -- 172.21.15.98:0/1710274709 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd30015e340 msgr2=0x7fd3001f7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:05.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.418+0000 7fd306185640 1 --2- 172.21.15.98:0/1710274709 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd30015e340 0x7fd3001f7f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:05.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.418+0000 7fd306185640 1 -- 172.21.15.98:0/1710274709 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd30015f830 con 0x7fd30015e820 2024-09-17T05:23:05.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.418+0000 7fd306185640 1 --2- 172.21.15.98:0/1710274709 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd30015e820 0x7fd3001f8470 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fd2f800c9a0 tx=0x7fd2f800ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:05.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.418+0000 7fd2fe7fc640 1 -- 172.21.15.98:0/1710274709 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f8007bb0 con 0x7fd30015e820 2024-09-17T05:23:05.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.418+0000 7fd2fe7fc640 1 -- 172.21.15.98:0/1710274709 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd2f8007e40 con 0x7fd30015e820 2024-09-17T05:23:05.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.418+0000 7fd2fe7fc640 1 -- 172.21.15.98:0/1710274709 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f8005280 con 0x7fd30015e820 2024-09-17T05:23:05.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.418+0000 7fd307be8640 1 -- 172.21.15.98:0/1710274709 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd30015ecb0 con 0x7fd30015e820 2024-09-17T05:23:05.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.418+0000 7fd307be8640 1 -- 172.21.15.98:0/1710274709 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd30015f270 con 0x7fd30015e820 2024-09-17T05:23:05.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.419+0000 7fd307be8640 1 -- 172.21.15.98:0/1710274709 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd3000d3220 con 0x7fd30015e820 2024-09-17T05:23:05.423 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.420+0000 7fd2fe7fc640 1 -- 172.21.15.98:0/1710274709 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 6) ==== 101594+0+0 (secure 0 0 0) 0x7fd2f8005420 con 0x7fd30015e820 2024-09-17T05:23:05.423 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.420+0000 7fd2fe7fc640 1 --2- 172.21.15.98:0/1710274709 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fd2ec078d40 0x7fd2ec07b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:05.423 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.420+0000 7fd2fe7fc640 1 -- 172.21.15.98:0/1710274709 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fd2f809b810 con 0x7fd30015e820 2024-09-17T05:23:05.423 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.421+0000 7fd2fe7fc640 1 --2- 172.21.15.98:0/1710274709 >> [v2:172.21.15.98:6816/3902180920,v1:172.21.15.98:6817/3902180920] conn(0x7fd2ec07ec00 0x7fd2ec081020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:05.423 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.421+0000 7fd2fe7fc640 1 -- 172.21.15.98:0/1710274709 --> [v2:172.21.15.98:6816/3902180920,v1:172.21.15.98:6817/3902180920] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd2f8017e70 con 0x7fd2ec07ec00 2024-09-17T05:23:05.423 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.421+0000 7fd2fe7fc640 1 -- 172.21.15.98:0/1710274709 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fd2f809bca0 con 0x7fd30015e820 2024-09-17T05:23:05.423 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.421+0000 7fd305984640 1 --2- 172.21.15.98:0/1710274709 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fd2ec078d40 0x7fd2ec07b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:05.423 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.421+0000 7fd305183640 1 --2- 172.21.15.98:0/1710274709 >> [v2:172.21.15.98:6816/3902180920,v1:172.21.15.98:6817/3902180920] conn(0x7fd2ec07ec00 0x7fd2ec081020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:05.423 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.421+0000 7fd305183640 1 --2- 172.21.15.98:0/1710274709 >> [v2:172.21.15.98:6816/3902180920,v1:172.21.15.98:6817/3902180920] conn(0x7fd2ec07ec00 0x7fd2ec081020 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:05.423 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.421+0000 7fd305984640 1 --2- 172.21.15.98:0/1710274709 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fd2ec078d40 0x7fd2ec07b200 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0035000 tx=0x7fd2f0004a40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:05.423 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.422+0000 7fd2fe7fc640 1 -- 172.21.15.98:0/1710274709 <== osd.1 v2:172.21.15.98:6816/3902180920 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd2f8017e70 con 0x7fd2ec07ec00 2024-09-17T05:23:05.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.434+0000 7fd307be8640 1 -- 172.21.15.98:0/1710274709 --> [v2:172.21.15.98:6816/3902180920,v1:172.21.15.98:6817/3902180920] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd3000d2ca0 con 0x7fd2ec07ec00 2024-09-17T05:23:05.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.434+0000 7fd2fe7fc640 1 -- 172.21.15.98:0/1710274709 <== osd.1 v2:172.21.15.98:6816/3902180920 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd3000d2ca0 con 0x7fd2ec07ec00 2024-09-17T05:23:05.435 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T05:23:05.435 INFO:teuthology.orchestra.run.smithi098.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T05:23:05.435 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T05:23:05.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.434+0000 7fd307be8640 1 -- 172.21.15.98:0/1710274709 >> [v2:172.21.15.98:6816/3902180920,v1:172.21.15.98:6817/3902180920] conn(0x7fd2ec07ec00 msgr2=0x7fd2ec081020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:05.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.434+0000 7fd307be8640 1 --2- 172.21.15.98:0/1710274709 >> [v2:172.21.15.98:6816/3902180920,v1:172.21.15.98:6817/3902180920] conn(0x7fd2ec07ec00 0x7fd2ec081020 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:05.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.434+0000 7fd307be8640 1 -- 172.21.15.98:0/1710274709 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fd2ec078d40 msgr2=0x7fd2ec07b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:05.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.434+0000 7fd307be8640 1 --2- 172.21.15.98:0/1710274709 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fd2ec078d40 0x7fd2ec07b200 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0035000 tx=0x7fd2f0004a40 comp rx=0 tx=0).stop 2024-09-17T05:23:05.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.434+0000 7fd307be8640 1 -- 172.21.15.98:0/1710274709 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd30015e820 msgr2=0x7fd3001f8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:05.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.434+0000 7fd307be8640 1 --2- 172.21.15.98:0/1710274709 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd30015e820 0x7fd3001f8470 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fd2f800c9a0 tx=0x7fd2f800ce60 comp rx=0 tx=0).stop 2024-09-17T05:23:05.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.434+0000 7fd306185640 1 -- 172.21.15.98:0/1710274709 reap_dead start 2024-09-17T05:23:05.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.434+0000 7fd307be8640 1 -- 172.21.15.98:0/1710274709 shutdown_connections 2024-09-17T05:23:05.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.434+0000 7fd307be8640 1 -- 172.21.15.98:0/1710274709 >> 172.21.15.98:0/1710274709 conn(0x7fd3000d4050 msgr2=0x7fd30006dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:05.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.434+0000 7fd307be8640 1 -- 172.21.15.98:0/1710274709 shutdown_connections 2024-09-17T05:23:05.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.434+0000 7fd307be8640 1 -- 172.21.15.98:0/1710274709 wait complete. 2024-09-17T05:23:05.447 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-17T05:23:05.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.548+0000 7f454d9f8640 1 -- 172.21.15.98:0/3659163154 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45480d2050 msgr2=0x7f45480d10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:05.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.548+0000 7f454d9f8640 1 --2- 172.21.15.98:0/3659163154 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45480d2050 0x7f45480d10d0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f45480d1df0 tx=0x7f453002a530 comp rx=0 tx=0).stop 2024-09-17T05:23:05.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.548+0000 7f454d9f8640 1 -- 172.21.15.98:0/3659163154 shutdown_connections 2024-09-17T05:23:05.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.548+0000 7f454d9f8640 1 --2- 172.21.15.98:0/3659163154 >> v2:172.21.15.167:3300/0 conn(0x7f45480d1610 0x7f45480cecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:05.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.548+0000 7f454d9f8640 1 --2- 172.21.15.98:0/3659163154 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45480d2050 0x7f45480d10d0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:05.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.548+0000 7f454d9f8640 1 -- 172.21.15.98:0/3659163154 >> 172.21.15.98:0/3659163154 conn(0x7f45480d3fe0 msgr2=0x7f45480d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:05.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.548+0000 7f454d9f8640 1 -- 172.21.15.98:0/3659163154 shutdown_connections 2024-09-17T05:23:05.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.548+0000 7f454d9f8640 1 -- 172.21.15.98:0/3659163154 wait complete. 2024-09-17T05:23:05.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.549+0000 7f454d9f8640 1 Processor -- start 2024-09-17T05:23:05.551 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.550+0000 7f454d9f8640 1 -- start start 2024-09-17T05:23:05.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.550+0000 7f454d9f8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45480d1610 0x7f45480c9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:05.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.550+0000 7f454d9f8640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45480d2050 0x7f45480b9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:05.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.550+0000 7f454d9f8640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f454815e0d0 0x7f45480b9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:05.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.550+0000 7f454d9f8640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f45480cf610 con 0x7f45480d2050 2024-09-17T05:23:05.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.550+0000 7f454d9f8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f45480cf490 con 0x7f45480d1610 2024-09-17T05:23:05.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.550+0000 7f454d9f8640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f45480cf790 con 0x7f454815e0d0 2024-09-17T05:23:05.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.551+0000 7f45467fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45480d2050 0x7f45480b9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:05.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.551+0000 7f45467fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45480d2050 0x7f45480b9420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48792/0 (socket says 172.21.15.98:48792) 2024-09-17T05:23:05.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.551+0000 7f45467fc640 1 -- 172.21.15.98:0/925894762 learned_addr learned my addr 172.21.15.98:0/925894762 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:23:05.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.551+0000 7f4546ffd640 1 --2- 172.21.15.98:0/925894762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45480d1610 0x7f45480c9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:05.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.551+0000 7f45477fe640 1 --2- 172.21.15.98:0/925894762 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f454815e0d0 0x7f45480b9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:05.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.551+0000 7f45467fc640 1 -- 172.21.15.98:0/925894762 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f454815e0d0 msgr2=0x7f45480b9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:05.554 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.551+0000 7f45467fc640 1 --2- 172.21.15.98:0/925894762 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f454815e0d0 0x7f45480b9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:05.554 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.551+0000 7f45467fc640 1 -- 172.21.15.98:0/925894762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45480d1610 msgr2=0x7f45480c9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:05.554 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.551+0000 7f45467fc640 1 --2- 172.21.15.98:0/925894762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45480d1610 0x7f45480c9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:05.554 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.551+0000 7f45467fc640 1 -- 172.21.15.98:0/925894762 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45480c9720 con 0x7f45480d2050 2024-09-17T05:23:05.554 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.551+0000 7f45477fe640 1 --2- 172.21.15.98:0/925894762 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f454815e0d0 0x7f45480b9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:23:05.554 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.551+0000 7f45467fc640 1 --2- 172.21.15.98:0/925894762 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45480d2050 0x7f45480b9420 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f453002ab20 tx=0x7f4530032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:05.554 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.551+0000 7f453ffff640 1 -- 172.21.15.98:0/925894762 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4530040070 con 0x7f45480d2050 2024-09-17T05:23:05.554 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.551+0000 7f453ffff640 1 -- 172.21.15.98:0/925894762 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4530005310 con 0x7f45480d2050 2024-09-17T05:23:05.554 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.551+0000 7f453ffff640 1 -- 172.21.15.98:0/925894762 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45300047a0 con 0x7f45480d2050 2024-09-17T05:23:05.554 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.551+0000 7f454d9f8640 1 -- 172.21.15.98:0/925894762 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4548149ec0 con 0x7f45480d2050 2024-09-17T05:23:05.554 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.551+0000 7f454d9f8640 1 -- 172.21.15.98:0/925894762 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45480cb430 con 0x7f45480d2050 2024-09-17T05:23:05.554 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.552+0000 7f454d9f8640 1 -- 172.21.15.98:0/925894762 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45480cfcb0 con 0x7f45480d2050 2024-09-17T05:23:05.555 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.553+0000 7f453ffff640 1 -- 172.21.15.98:0/925894762 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 6) ==== 101594+0+0 (secure 0 0 0) 0x7f4530039040 con 0x7f45480d2050 2024-09-17T05:23:05.555 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.553+0000 7f453ffff640 1 --2- 172.21.15.98:0/925894762 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f4528078d40 0x7f452807b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:05.555 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.554+0000 7f453ffff640 1 -- 172.21.15.98:0/925894762 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f45300bc250 con 0x7f45480d2050 2024-09-17T05:23:05.555 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.554+0000 7f4546ffd640 1 --2- 172.21.15.98:0/925894762 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f4528078d40 0x7f452807b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:05.556 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.554+0000 7f4546ffd640 1 --2- 172.21.15.98:0/925894762 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f4528078d40 0x7f452807b200 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f45380012e0 tx=0x7f4538009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:05.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.558+0000 7f453ffff640 1 -- 172.21.15.98:0/925894762 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f4530084690 con 0x7f45480d2050 2024-09-17T05:23:05.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.732+0000 7f454d9f8640 1 -- 172.21.15.98:0/925894762 --> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f45480d47d0 con 0x7f4528078d40 2024-09-17T05:23:05.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.732+0000 7f453ffff640 1 -- 172.21.15.98:0/925894762 <== mgr.4103 v2:172.21.15.167:6800/610796449 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f45480d47d0 con 0x7f4528078d40 2024-09-17T05:23:05.733 INFO:teuthology.orchestra.run.smithi098.stderr:instructed osd(s) 1 to deep-scrub 2024-09-17T05:23:05.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.735+0000 7f454d9f8640 1 -- 172.21.15.98:0/925894762 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f4528078d40 msgr2=0x7f452807b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:05.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.735+0000 7f454d9f8640 1 --2- 172.21.15.98:0/925894762 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f4528078d40 0x7f452807b200 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f45380012e0 tx=0x7f4538009040 comp rx=0 tx=0).stop 2024-09-17T05:23:05.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.735+0000 7f454d9f8640 1 -- 172.21.15.98:0/925894762 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45480d2050 msgr2=0x7f45480b9420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:05.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.735+0000 7f454d9f8640 1 --2- 172.21.15.98:0/925894762 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45480d2050 0x7f45480b9420 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f453002ab20 tx=0x7f4530032c10 comp rx=0 tx=0).stop 2024-09-17T05:23:05.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.735+0000 7f454d9f8640 1 -- 172.21.15.98:0/925894762 shutdown_connections 2024-09-17T05:23:05.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.735+0000 7f454d9f8640 1 --2- 172.21.15.98:0/925894762 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f4528078d40 0x7f452807b200 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:05.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.735+0000 7f454d9f8640 1 --2- 172.21.15.98:0/925894762 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f454815e0d0 0x7f45480b9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:05.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.735+0000 7f454d9f8640 1 --2- 172.21.15.98:0/925894762 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45480d2050 0x7f45480b9420 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:05.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.735+0000 7f454d9f8640 1 --2- 172.21.15.98:0/925894762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45480d1610 0x7f45480c9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:05.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.735+0000 7f454d9f8640 1 -- 172.21.15.98:0/925894762 >> 172.21.15.98:0/925894762 conn(0x7f45480d3fe0 msgr2=0x7f454815f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:05.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.735+0000 7f454d9f8640 1 -- 172.21.15.98:0/925894762 shutdown_connections 2024-09-17T05:23:05.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.735+0000 7f454d9f8640 1 -- 172.21.15.98:0/925894762 wait complete. 2024-09-17T05:23:05.747 INFO:tasks.ceph:Scrubbing osd.2 2024-09-17T05:23:05.747 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-17T05:23:05.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.851+0000 7fe153c85640 1 -- 172.21.15.98:0/3058278644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe14c15e340 msgr2=0x7fe14c0d0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:05.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.851+0000 7fe153c85640 1 --2- 172.21.15.98:0/3058278644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe14c15e340 0x7fe14c0d0800 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe13c009830 tx=0x7fe13c02a5a0 comp rx=0 tx=0).stop 2024-09-17T05:23:05.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.852+0000 7fe153c85640 1 -- 172.21.15.98:0/3058278644 shutdown_connections 2024-09-17T05:23:05.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.852+0000 7fe153c85640 1 --2- 172.21.15.98:0/3058278644 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe14c0cf670 0x7fe14c0d0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:05.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.852+0000 7fe153c85640 1 --2- 172.21.15.98:0/3058278644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe14c15e340 0x7fe14c0d0800 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:05.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.852+0000 7fe153c85640 1 -- 172.21.15.98:0/3058278644 >> 172.21.15.98:0/3058278644 conn(0x7fe14c0d4050 msgr2=0x7fe14c0d4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:05.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.852+0000 7fe153c85640 1 -- 172.21.15.98:0/3058278644 shutdown_connections 2024-09-17T05:23:05.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.852+0000 7fe153c85640 1 -- 172.21.15.98:0/3058278644 wait complete. 2024-09-17T05:23:05.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.853+0000 7fe153c85640 1 Processor -- start 2024-09-17T05:23:05.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.853+0000 7fe153c85640 1 -- start start 2024-09-17T05:23:05.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.854+0000 7fe153c85640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe14c0d4b70 0x7fe14c1f4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:05.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.854+0000 7fe153c85640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe14c15e340 0x7fe14c15b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:05.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.854+0000 7fe153c85640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe14c09deb0 0x7fe14c0cd480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:05.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.854+0000 7fe153c85640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe14c0d2590 con 0x7fe14c0d4b70 2024-09-17T05:23:05.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.854+0000 7fe153c85640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe14c0d2410 con 0x7fe14c15e340 2024-09-17T05:23:05.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.854+0000 7fe153c85640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fe14c0d2710 con 0x7fe14c09deb0 2024-09-17T05:23:05.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.854+0000 7fe151a21640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe14c0d4b70 0x7fe14c1f4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:05.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.854+0000 7fe151a21640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe14c0d4b70 0x7fe14c1f4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48794/0 (socket says 172.21.15.98:48794) 2024-09-17T05:23:05.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.854+0000 7fe151a21640 1 -- 172.21.15.98:0/1620548566 learned_addr learned my addr 172.21.15.98:0/1620548566 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:23:05.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.854+0000 7fe152222640 1 --2- 172.21.15.98:0/1620548566 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe14c09deb0 0x7fe14c0cd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:05.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.854+0000 7fe151220640 1 --2- 172.21.15.98:0/1620548566 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe14c15e340 0x7fe14c15b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:05.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.854+0000 7fe151a21640 1 -- 172.21.15.98:0/1620548566 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe14c09deb0 msgr2=0x7fe14c0cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:05.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.854+0000 7fe151a21640 1 --2- 172.21.15.98:0/1620548566 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe14c09deb0 0x7fe14c0cd480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:05.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.854+0000 7fe151a21640 1 -- 172.21.15.98:0/1620548566 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe14c15e340 msgr2=0x7fe14c15b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:05.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.854+0000 7fe151a21640 1 --2- 172.21.15.98:0/1620548566 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe14c15e340 0x7fe14c15b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:05.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.854+0000 7fe151a21640 1 -- 172.21.15.98:0/1620548566 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe14c15a570 con 0x7fe14c0d4b70 2024-09-17T05:23:05.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.854+0000 7fe151a21640 1 --2- 172.21.15.98:0/1620548566 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe14c0d4b70 0x7fe14c1f4510 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fe13c009950 tx=0x7fe13c033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:05.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.854+0000 7fe14a7fc640 1 -- 172.21.15.98:0/1620548566 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe13c031d60 con 0x7fe14c0d4b70 2024-09-17T05:23:05.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.854+0000 7fe14a7fc640 1 -- 172.21.15.98:0/1620548566 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe13c033e10 con 0x7fe14c0d4b70 2024-09-17T05:23:05.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.854+0000 7fe153c85640 1 -- 172.21.15.98:0/1620548566 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe14c15a850 con 0x7fe14c0d4b70 2024-09-17T05:23:05.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.854+0000 7fe14a7fc640 1 -- 172.21.15.98:0/1620548566 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe13c005260 con 0x7fe14c0d4b70 2024-09-17T05:23:05.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.855+0000 7fe153c85640 1 -- 172.21.15.98:0/1620548566 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe14c0cde40 con 0x7fe14c0d4b70 2024-09-17T05:23:05.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.855+0000 7fe153c85640 1 -- 172.21.15.98:0/1620548566 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe14c0cf3b0 con 0x7fe14c0d4b70 2024-09-17T05:23:05.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.856+0000 7fe14a7fc640 1 -- 172.21.15.98:0/1620548566 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 6) ==== 101594+0+0 (secure 0 0 0) 0x7fe13c005400 con 0x7fe14c0d4b70 2024-09-17T05:23:05.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.857+0000 7fe14a7fc640 1 --2- 172.21.15.98:0/1620548566 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fe138078d40 0x7fe13807b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:05.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.857+0000 7fe14a7fc640 1 -- 172.21.15.98:0/1620548566 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fe13c0bc0c0 con 0x7fe14c0d4b70 2024-09-17T05:23:05.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.857+0000 7fe14a7fc640 1 --2- 172.21.15.98:0/1620548566 >> [v2:172.21.15.98:6800/1518887101,v1:172.21.15.98:6801/1518887101] conn(0x7fe13807ec00 0x7fe138081020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:05.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.857+0000 7fe14a7fc640 1 -- 172.21.15.98:0/1620548566 --> [v2:172.21.15.98:6800/1518887101,v1:172.21.15.98:6801/1518887101] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe13c02eec0 con 0x7fe13807ec00 2024-09-17T05:23:05.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.857+0000 7fe14a7fc640 1 -- 172.21.15.98:0/1620548566 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fe13c0bc550 con 0x7fe14c0d4b70 2024-09-17T05:23:05.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.857+0000 7fe151220640 1 --2- 172.21.15.98:0/1620548566 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fe138078d40 0x7fe13807b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:05.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.857+0000 7fe152222640 1 --2- 172.21.15.98:0/1620548566 >> [v2:172.21.15.98:6800/1518887101,v1:172.21.15.98:6801/1518887101] conn(0x7fe13807ec00 0x7fe138081020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:05.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.857+0000 7fe152222640 1 --2- 172.21.15.98:0/1620548566 >> [v2:172.21.15.98:6800/1518887101,v1:172.21.15.98:6801/1518887101] conn(0x7fe13807ec00 0x7fe138081020 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:05.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.857+0000 7fe151220640 1 --2- 172.21.15.98:0/1620548566 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fe138078d40 0x7fe13807b200 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe14c0a1de0 tx=0x7fe140009260 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:05.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.858+0000 7fe14a7fc640 1 -- 172.21.15.98:0/1620548566 <== osd.2 v2:172.21.15.98:6800/1518887101 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe13c02eec0 con 0x7fe13807ec00 2024-09-17T05:23:05.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.870+0000 7fe153c85640 1 -- 172.21.15.98:0/1620548566 --> [v2:172.21.15.98:6800/1518887101,v1:172.21.15.98:6801/1518887101] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe14c0d3220 con 0x7fe13807ec00 2024-09-17T05:23:05.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.870+0000 7fe14a7fc640 1 -- 172.21.15.98:0/1620548566 <== osd.2 v2:172.21.15.98:6800/1518887101 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe14c0d3220 con 0x7fe13807ec00 2024-09-17T05:23:05.871 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T05:23:05.871 INFO:teuthology.orchestra.run.smithi098.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T05:23:05.872 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T05:23:05.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.871+0000 7fe153c85640 1 -- 172.21.15.98:0/1620548566 >> [v2:172.21.15.98:6800/1518887101,v1:172.21.15.98:6801/1518887101] conn(0x7fe13807ec00 msgr2=0x7fe138081020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:05.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.871+0000 7fe153c85640 1 --2- 172.21.15.98:0/1620548566 >> [v2:172.21.15.98:6800/1518887101,v1:172.21.15.98:6801/1518887101] conn(0x7fe13807ec00 0x7fe138081020 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:05.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.871+0000 7fe153c85640 1 -- 172.21.15.98:0/1620548566 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fe138078d40 msgr2=0x7fe13807b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:05.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.871+0000 7fe153c85640 1 --2- 172.21.15.98:0/1620548566 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fe138078d40 0x7fe13807b200 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe14c0a1de0 tx=0x7fe140009260 comp rx=0 tx=0).stop 2024-09-17T05:23:05.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.871+0000 7fe153c85640 1 -- 172.21.15.98:0/1620548566 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe14c0d4b70 msgr2=0x7fe14c1f4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:05.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.871+0000 7fe153c85640 1 --2- 172.21.15.98:0/1620548566 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe14c0d4b70 0x7fe14c1f4510 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fe13c009950 tx=0x7fe13c033c20 comp rx=0 tx=0).stop 2024-09-17T05:23:05.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.871+0000 7fe152222640 1 -- 172.21.15.98:0/1620548566 reap_dead start 2024-09-17T05:23:05.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.871+0000 7fe153c85640 1 -- 172.21.15.98:0/1620548566 shutdown_connections 2024-09-17T05:23:05.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.871+0000 7fe153c85640 1 -- 172.21.15.98:0/1620548566 >> 172.21.15.98:0/1620548566 conn(0x7fe14c0d4050 msgr2=0x7fe14c06d560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:05.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.871+0000 7fe153c85640 1 -- 172.21.15.98:0/1620548566 shutdown_connections 2024-09-17T05:23:05.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.871+0000 7fe153c85640 1 -- 172.21.15.98:0/1620548566 wait complete. 2024-09-17T05:23:05.882 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-17T05:23:05.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.984+0000 7f71df96b640 1 -- 172.21.15.98:0/3169464264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71c4003a50 msgr2=0x7f71c4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:05.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.984+0000 7f71df96b640 1 --2- 172.21.15.98:0/3169464264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71c4003a50 0x7f71c4003e70 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f71cc0016c0 tx=0x7f71c4005830 comp rx=0 tx=0).stop 2024-09-17T05:23:05.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.984+0000 7f71df96b640 1 -- 172.21.15.98:0/3169464264 shutdown_connections 2024-09-17T05:23:05.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.984+0000 7f71df96b640 1 --2- 172.21.15.98:0/3169464264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71c4003a50 0x7f71c4003e70 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:05.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.984+0000 7f71df96b640 1 -- 172.21.15.98:0/3169464264 >> 172.21.15.98:0/3169464264 conn(0x7f71d80b1950 msgr2=0x7f71d80b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:05.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.984+0000 7f71df96b640 1 -- 172.21.15.98:0/3169464264 shutdown_connections 2024-09-17T05:23:05.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.984+0000 7f71df96b640 1 -- 172.21.15.98:0/3169464264 wait complete. 2024-09-17T05:23:05.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.985+0000 7f71df96b640 1 Processor -- start 2024-09-17T05:23:05.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.985+0000 7f71df96b640 1 -- start start 2024-09-17T05:23:05.989 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.986+0000 7f71df96b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71c4003a50 0x7f71d815c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:05.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.986+0000 7f71df96b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71d8157f30 0x7f71d81f5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:05.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.986+0000 7f71df96b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71d81f6420 0x7f71d81f5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:05.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.986+0000 7f71df96b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f71d80b4950 con 0x7f71d8157f30 2024-09-17T05:23:05.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.986+0000 7f71df96b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f71d80b47d0 con 0x7f71d81f6420 2024-09-17T05:23:05.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.986+0000 7f71df96b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f71d80b4ad0 con 0x7f71c4003a50 2024-09-17T05:23:05.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.986+0000 7f71dcf06640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71d8157f30 0x7f71d81f5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:05.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.986+0000 7f71dcf06640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71d8157f30 0x7f71d81f5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48814/0 (socket says 172.21.15.98:48814) 2024-09-17T05:23:05.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.986+0000 7f71dcf06640 1 -- 172.21.15.98:0/1319988059 learned_addr learned my addr 172.21.15.98:0/1319988059 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:23:05.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.986+0000 7f71dd707640 1 --2- 172.21.15.98:0/1319988059 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71c4003a50 0x7f71d815c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:05.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.986+0000 7f71ddf08640 1 --2- 172.21.15.98:0/1319988059 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71d81f6420 0x7f71d81f5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:05.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.986+0000 7f71dcf06640 1 -- 172.21.15.98:0/1319988059 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71c4003a50 msgr2=0x7f71d815c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:05.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.986+0000 7f71dcf06640 1 --2- 172.21.15.98:0/1319988059 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71c4003a50 0x7f71d815c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:05.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.986+0000 7f71dcf06640 1 -- 172.21.15.98:0/1319988059 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71d81f6420 msgr2=0x7f71d81f5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:05.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.986+0000 7f71dcf06640 1 --2- 172.21.15.98:0/1319988059 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71d81f6420 0x7f71d81f5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:05.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.986+0000 7f71dcf06640 1 -- 172.21.15.98:0/1319988059 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71d8152930 con 0x7f71d8157f30 2024-09-17T05:23:05.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.986+0000 7f71dd707640 1 --2- 172.21.15.98:0/1319988059 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71c4003a50 0x7f71d815c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:23:05.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.986+0000 7f71ddf08640 1 --2- 172.21.15.98:0/1319988059 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71d81f6420 0x7f71d81f5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:23:05.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.986+0000 7f71dcf06640 1 --2- 172.21.15.98:0/1319988059 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71d8157f30 0x7f71d81f5ee0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f71d400e5c0 tx=0x7f71d400ea80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:05.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.987+0000 7f71c9ffb640 1 -- 172.21.15.98:0/1319988059 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d4015070 con 0x7f71d8157f30 2024-09-17T05:23:05.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.987+0000 7f71c9ffb640 1 -- 172.21.15.98:0/1319988059 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f71d400c9e0 con 0x7f71d8157f30 2024-09-17T05:23:05.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.987+0000 7f71c9ffb640 1 -- 172.21.15.98:0/1319988059 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d400cdf0 con 0x7f71d8157f30 2024-09-17T05:23:05.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.987+0000 7f71df96b640 1 -- 172.21.15.98:0/1319988059 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71d8152bf0 con 0x7f71d8157f30 2024-09-17T05:23:05.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.987+0000 7f71df96b640 1 -- 172.21.15.98:0/1319988059 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71d81531b0 con 0x7f71d8157f30 2024-09-17T05:23:05.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.988+0000 7f71df96b640 1 -- 172.21.15.98:0/1319988059 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71d80b3910 con 0x7f71d8157f30 2024-09-17T05:23:05.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.988+0000 7f71c9ffb640 1 -- 172.21.15.98:0/1319988059 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 6) ==== 101594+0+0 (secure 0 0 0) 0x7f71d4018070 con 0x7f71d8157f30 2024-09-17T05:23:05.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.989+0000 7f71c9ffb640 1 --2- 172.21.15.98:0/1319988059 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f71bc078d70 0x7f71bc07b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:05.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.989+0000 7f71c9ffb640 1 -- 172.21.15.98:0/1319988059 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f71d409b170 con 0x7f71d8157f30 2024-09-17T05:23:05.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.989+0000 7f71dd707640 1 --2- 172.21.15.98:0/1319988059 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f71bc078d70 0x7f71bc07b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:05.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.989+0000 7f71dd707640 1 --2- 172.21.15.98:0/1319988059 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f71bc078d70 0x7f71bc07b230 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f71cc032000 tx=0x7f71cc001190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:05.993 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:05.993+0000 7f71c9ffb640 1 -- 172.21.15.98:0/1319988059 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f71d80b3910 con 0x7f71d8157f30 2024-09-17T05:23:06.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.169+0000 7f71df96b640 1 -- 172.21.15.98:0/1319988059 --> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f71d80ad2f0 con 0x7f71bc078d70 2024-09-17T05:23:06.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.170+0000 7f71c9ffb640 1 -- 172.21.15.98:0/1319988059 <== mgr.4103 v2:172.21.15.167:6800/610796449 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f71d80ad2f0 con 0x7f71bc078d70 2024-09-17T05:23:06.171 INFO:teuthology.orchestra.run.smithi098.stderr:instructed osd(s) 2 to deep-scrub 2024-09-17T05:23:06.173 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.172+0000 7f71df96b640 1 -- 172.21.15.98:0/1319988059 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f71bc078d70 msgr2=0x7f71bc07b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:06.173 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.172+0000 7f71df96b640 1 --2- 172.21.15.98:0/1319988059 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f71bc078d70 0x7f71bc07b230 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f71cc032000 tx=0x7f71cc001190 comp rx=0 tx=0).stop 2024-09-17T05:23:06.174 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.172+0000 7f71df96b640 1 -- 172.21.15.98:0/1319988059 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71d8157f30 msgr2=0x7f71d81f5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:06.174 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.172+0000 7f71df96b640 1 --2- 172.21.15.98:0/1319988059 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71d8157f30 0x7f71d81f5ee0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f71d400e5c0 tx=0x7f71d400ea80 comp rx=0 tx=0).stop 2024-09-17T05:23:06.174 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.172+0000 7f71df96b640 1 -- 172.21.15.98:0/1319988059 shutdown_connections 2024-09-17T05:23:06.174 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.172+0000 7f71df96b640 1 --2- 172.21.15.98:0/1319988059 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f71bc078d70 0x7f71bc07b230 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:06.174 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.172+0000 7f71df96b640 1 --2- 172.21.15.98:0/1319988059 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71d81f6420 0x7f71d81f5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:06.174 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.172+0000 7f71df96b640 1 --2- 172.21.15.98:0/1319988059 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71d8157f30 0x7f71d81f5ee0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:06.174 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.172+0000 7f71df96b640 1 --2- 172.21.15.98:0/1319988059 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71c4003a50 0x7f71d815c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:06.174 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.172+0000 7f71df96b640 1 -- 172.21.15.98:0/1319988059 >> 172.21.15.98:0/1319988059 conn(0x7f71d80b1950 msgr2=0x7f71d80adaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:06.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.172+0000 7f71df96b640 1 -- 172.21.15.98:0/1319988059 shutdown_connections 2024-09-17T05:23:06.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.172+0000 7f71df96b640 1 -- 172.21.15.98:0/1319988059 wait complete. 2024-09-17T05:23:06.184 INFO:tasks.ceph:Scrubbing osd.3 2024-09-17T05:23:06.184 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-17T05:23:06.290 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.288+0000 7fecf829b640 1 -- 172.21.15.98:0/293778735 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fecf00703b0 msgr2=0x7fecf00d03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:06.290 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.288+0000 7fecf829b640 1 --2- 172.21.15.98:0/293778735 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fecf00703b0 0x7fecf00d03b0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fecf00ce300 tx=0x7fecec02a560 comp rx=0 tx=0).stop 2024-09-17T05:23:06.290 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.289+0000 7fecf829b640 1 -- 172.21.15.98:0/293778735 shutdown_connections 2024-09-17T05:23:06.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.289+0000 7fecf829b640 1 --2- 172.21.15.98:0/293778735 >> v2:172.21.15.167:3300/0 conn(0x7fecf0070790 0x7fecf006f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:06.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.289+0000 7fecf829b640 1 --2- 172.21.15.98:0/293778735 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fecf0160300 0x7fecf015cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:06.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.289+0000 7fecf829b640 1 --2- 172.21.15.98:0/293778735 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fecf00703b0 0x7fecf00d03b0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:06.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.289+0000 7fecf829b640 1 -- 172.21.15.98:0/293778735 >> 172.21.15.98:0/293778735 conn(0x7fecf006cb70 msgr2=0x7fecf006cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:06.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.289+0000 7fecf829b640 1 -- 172.21.15.98:0/293778735 shutdown_connections 2024-09-17T05:23:06.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.289+0000 7fecf829b640 1 -- 172.21.15.98:0/293778735 wait complete. 2024-09-17T05:23:06.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.290+0000 7fecf829b640 1 Processor -- start 2024-09-17T05:23:06.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.290+0000 7fecf829b640 1 -- start start 2024-09-17T05:23:06.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.290+0000 7fecf829b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fecf00703b0 0x7fecf0141ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:06.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.290+0000 7fecf829b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fecf0070790 0x7fecf00a9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:06.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.290+0000 7fecf829b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecf0160300 0x7fecf015d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:06.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.290+0000 7fecf829b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fecf0070d30 con 0x7fecf00703b0 2024-09-17T05:23:06.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.290+0000 7fecf829b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fecf0156790 con 0x7fecf0160300 2024-09-17T05:23:06.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.290+0000 7fecf829b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fecf006f5d0 con 0x7fecf0070790 2024-09-17T05:23:06.299 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.291+0000 7fecf6037640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fecf00703b0 0x7fecf0141ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:06.299 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.291+0000 7fecf6037640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fecf00703b0 0x7fecf0141ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45276/0 (socket says 172.21.15.98:45276) 2024-09-17T05:23:06.299 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.291+0000 7fecf6037640 1 -- 172.21.15.98:0/3345316800 learned_addr learned my addr 172.21.15.98:0/3345316800 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:23:06.299 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.291+0000 7fecf5836640 1 --2- 172.21.15.98:0/3345316800 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fecf0070790 0x7fecf00a9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:06.299 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.291+0000 7fecf6838640 1 --2- 172.21.15.98:0/3345316800 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecf0160300 0x7fecf015d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:06.299 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.291+0000 7fecf6037640 1 -- 172.21.15.98:0/3345316800 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fecf0070790 msgr2=0x7fecf00a9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:06.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.291+0000 7fecf6037640 1 --2- 172.21.15.98:0/3345316800 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fecf0070790 0x7fecf00a9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:06.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.291+0000 7fecf6037640 1 -- 172.21.15.98:0/3345316800 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecf0160300 msgr2=0x7fecf015d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:06.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.291+0000 7fecf6037640 1 --2- 172.21.15.98:0/3345316800 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecf0160300 0x7fecf015d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:06.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.291+0000 7fecf6037640 1 -- 172.21.15.98:0/3345316800 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecf01f3c50 con 0x7fecf00703b0 2024-09-17T05:23:06.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.291+0000 7fecf5836640 1 --2- 172.21.15.98:0/3345316800 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fecf0070790 0x7fecf00a9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:23:06.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.291+0000 7fecf6838640 1 --2- 172.21.15.98:0/3345316800 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecf0160300 0x7fecf015d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:23:06.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.291+0000 7fecf6037640 1 --2- 172.21.15.98:0/3345316800 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fecf00703b0 0x7fecf0141ff0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fecec009850 tx=0x7fecec0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:06.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.291+0000 7fece6ffd640 1 -- 172.21.15.98:0/3345316800 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecec03f070 con 0x7fecf00703b0 2024-09-17T05:23:06.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.291+0000 7fece6ffd640 1 -- 172.21.15.98:0/3345316800 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fecec004890 con 0x7fecf00703b0 2024-09-17T05:23:06.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.291+0000 7fecf829b640 1 -- 172.21.15.98:0/3345316800 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecf01f3f30 con 0x7fecf00703b0 2024-09-17T05:23:06.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.291+0000 7fece6ffd640 1 -- 172.21.15.98:0/3345316800 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecec035030 con 0x7fecf00703b0 2024-09-17T05:23:06.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.291+0000 7fecf829b640 1 -- 172.21.15.98:0/3345316800 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecf01f44f0 con 0x7fecf00703b0 2024-09-17T05:23:06.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.292+0000 7fecf829b640 1 -- 172.21.15.98:0/3345316800 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fecf01f48c0 con 0x7fecf00703b0 2024-09-17T05:23:06.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.293+0000 7fece6ffd640 1 -- 172.21.15.98:0/3345316800 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 6) ==== 101594+0+0 (secure 0 0 0) 0x7fecec042070 con 0x7fecf00703b0 2024-09-17T05:23:06.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.293+0000 7fece6ffd640 1 --2- 172.21.15.98:0/3345316800 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fecd4078d40 0x7fecd407b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:06.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.293+0000 7fece6ffd640 1 -- 172.21.15.98:0/3345316800 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fecec0bc320 con 0x7fecf00703b0 2024-09-17T05:23:06.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.293+0000 7fecf5836640 1 --2- 172.21.15.98:0/3345316800 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fecd4078d40 0x7fecd407b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:06.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.293+0000 7fece6ffd640 1 --2- 172.21.15.98:0/3345316800 >> [v2:172.21.15.98:6808/4125246091,v1:172.21.15.98:6809/4125246091] conn(0x7fecd407ec00 0x7fecd4081020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:06.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.293+0000 7fece6ffd640 1 -- 172.21.15.98:0/3345316800 --> [v2:172.21.15.98:6808/4125246091,v1:172.21.15.98:6809/4125246091] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fecd40816d0 con 0x7fecd407ec00 2024-09-17T05:23:06.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.293+0000 7fece6ffd640 1 -- 172.21.15.98:0/3345316800 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fecec0bc7b0 con 0x7fecf00703b0 2024-09-17T05:23:06.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.294+0000 7fecf6838640 1 --2- 172.21.15.98:0/3345316800 >> [v2:172.21.15.98:6808/4125246091,v1:172.21.15.98:6809/4125246091] conn(0x7fecd407ec00 0x7fecd4081020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:06.303 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.294+0000 7fecf6838640 1 --2- 172.21.15.98:0/3345316800 >> [v2:172.21.15.98:6808/4125246091,v1:172.21.15.98:6809/4125246091] conn(0x7fecd407ec00 0x7fecd4081020 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:06.303 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.294+0000 7fecf5836640 1 --2- 172.21.15.98:0/3345316800 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fecd4078d40 0x7fecd407b200 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fecf015e890 tx=0x7fece0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:06.303 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.294+0000 7fece6ffd640 1 -- 172.21.15.98:0/3345316800 <== osd.3 v2:172.21.15.98:6808/4125246091 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fecd40816d0 con 0x7fecd407ec00 2024-09-17T05:23:06.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.307+0000 7fecf829b640 1 -- 172.21.15.98:0/3345316800 --> [v2:172.21.15.98:6808/4125246091,v1:172.21.15.98:6809/4125246091] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fecf006fac0 con 0x7fecd407ec00 2024-09-17T05:23:06.308 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.307+0000 7fece6ffd640 1 -- 172.21.15.98:0/3345316800 <== osd.3 v2:172.21.15.98:6808/4125246091 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fecf006fac0 con 0x7fecd407ec00 2024-09-17T05:23:06.308 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T05:23:06.308 INFO:teuthology.orchestra.run.smithi098.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T05:23:06.308 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T05:23:06.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.307+0000 7fecf829b640 1 -- 172.21.15.98:0/3345316800 >> [v2:172.21.15.98:6808/4125246091,v1:172.21.15.98:6809/4125246091] conn(0x7fecd407ec00 msgr2=0x7fecd4081020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:06.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.307+0000 7fecf829b640 1 --2- 172.21.15.98:0/3345316800 >> [v2:172.21.15.98:6808/4125246091,v1:172.21.15.98:6809/4125246091] conn(0x7fecd407ec00 0x7fecd4081020 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:06.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.307+0000 7fecf829b640 1 -- 172.21.15.98:0/3345316800 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fecd4078d40 msgr2=0x7fecd407b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:06.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.307+0000 7fecf829b640 1 --2- 172.21.15.98:0/3345316800 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fecd4078d40 0x7fecd407b200 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fecf015e890 tx=0x7fece0008040 comp rx=0 tx=0).stop 2024-09-17T05:23:06.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.307+0000 7fecf829b640 1 -- 172.21.15.98:0/3345316800 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fecf00703b0 msgr2=0x7fecf0141ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:06.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.307+0000 7fecf829b640 1 --2- 172.21.15.98:0/3345316800 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fecf00703b0 0x7fecf0141ff0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fecec009850 tx=0x7fecec0039e0 comp rx=0 tx=0).stop 2024-09-17T05:23:06.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.307+0000 7fecf6838640 1 -- 172.21.15.98:0/3345316800 reap_dead start 2024-09-17T05:23:06.310 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.307+0000 7fecf829b640 1 -- 172.21.15.98:0/3345316800 shutdown_connections 2024-09-17T05:23:06.310 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.307+0000 7fecf829b640 1 -- 172.21.15.98:0/3345316800 >> 172.21.15.98:0/3345316800 conn(0x7fecf006cb70 msgr2=0x7fecf015a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:06.310 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.307+0000 7fecf829b640 1 -- 172.21.15.98:0/3345316800 shutdown_connections 2024-09-17T05:23:06.310 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.307+0000 7fecf829b640 1 -- 172.21.15.98:0/3345316800 wait complete. 2024-09-17T05:23:06.318 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-17T05:23:06.422 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.420+0000 7f5ad17a0640 1 -- 172.21.15.98:0/2212279890 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5acc0d2050 msgr2=0x7f5acc0d0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:06.422 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.420+0000 7f5ad17a0640 1 --2- 172.21.15.98:0/2212279890 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5acc0d2050 0x7f5acc0d0f00 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f5acc08e550 tx=0x7f5ab402a560 comp rx=0 tx=0).stop 2024-09-17T05:23:06.423 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.420+0000 7f5ad17a0640 1 -- 172.21.15.98:0/2212279890 shutdown_connections 2024-09-17T05:23:06.423 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.420+0000 7f5ad17a0640 1 --2- 172.21.15.98:0/2212279890 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5acc0d1440 0x7f5acc15e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:06.423 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.420+0000 7f5ad17a0640 1 --2- 172.21.15.98:0/2212279890 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5acc0d2050 0x7f5acc0d0f00 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:06.423 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.420+0000 7f5ad17a0640 1 --2- 172.21.15.98:0/2212279890 >> v2:172.21.15.167:3300/0 conn(0x7f5acc15e0d0 0x7f5acc0d09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:06.423 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.420+0000 7f5ad17a0640 1 -- 172.21.15.98:0/2212279890 >> 172.21.15.98:0/2212279890 conn(0x7f5acc0d3fe0 msgr2=0x7f5acc0d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:06.423 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.421+0000 7f5ad17a0640 1 -- 172.21.15.98:0/2212279890 shutdown_connections 2024-09-17T05:23:06.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.421+0000 7f5ad17a0640 1 -- 172.21.15.98:0/2212279890 wait complete. 2024-09-17T05:23:06.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.422+0000 7f5ad17a0640 1 Processor -- start 2024-09-17T05:23:06.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.422+0000 7f5ad17a0640 1 -- start start 2024-09-17T05:23:06.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.423+0000 7f5ad17a0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5acc0d1440 0x7f5acc1f4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:06.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.423+0000 7f5ad17a0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5acc0d2050 0x7f5acc15a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:06.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.423+0000 7f5ad17a0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5acc15e0d0 0x7f5acc0b92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:06.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.423+0000 7f5ad17a0640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5acc15ed80 con 0x7f5acc0d2050 2024-09-17T05:23:06.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.423+0000 7f5ad17a0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5acc15ec00 con 0x7f5acc0d1440 2024-09-17T05:23:06.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.423+0000 7f5ad17a0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f5acc15ef00 con 0x7f5acc15e0d0 2024-09-17T05:23:06.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.423+0000 7f5ac27fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5acc0d2050 0x7f5acc15a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:06.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.423+0000 7f5ac27fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5acc0d2050 0x7f5acc15a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45304/0 (socket says 172.21.15.98:45304) 2024-09-17T05:23:06.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.423+0000 7f5ac27fc640 1 -- 172.21.15.98:0/1722768734 learned_addr learned my addr 172.21.15.98:0/1722768734 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:23:06.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.423+0000 7f5acaffd640 1 --2- 172.21.15.98:0/1722768734 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5acc0d1440 0x7f5acc1f4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:06.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.423+0000 7f5acb7fe640 1 --2- 172.21.15.98:0/1722768734 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5acc15e0d0 0x7f5acc0b92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:06.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.423+0000 7f5ac27fc640 1 -- 172.21.15.98:0/1722768734 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5acc15e0d0 msgr2=0x7f5acc0b92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:06.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.423+0000 7f5ac27fc640 1 --2- 172.21.15.98:0/1722768734 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5acc15e0d0 0x7f5acc0b92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:06.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.423+0000 7f5ac27fc640 1 -- 172.21.15.98:0/1722768734 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5acc0d1440 msgr2=0x7f5acc1f4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:06.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.423+0000 7f5ac27fc640 1 --2- 172.21.15.98:0/1722768734 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5acc0d1440 0x7f5acc1f4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:06.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.423+0000 7f5ac27fc640 1 -- 172.21.15.98:0/1722768734 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5acc0d05c0 con 0x7f5acc0d2050 2024-09-17T05:23:06.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.423+0000 7f5acaffd640 1 --2- 172.21.15.98:0/1722768734 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5acc0d1440 0x7f5acc1f4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:23:06.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.423+0000 7f5ac27fc640 1 --2- 172.21.15.98:0/1722768734 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5acc0d2050 0x7f5acc15a4e0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f5ab40099c0 tx=0x7f5ab40039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:06.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.423+0000 7f5ac3fff640 1 -- 172.21.15.98:0/1722768734 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab403f070 con 0x7f5acc0d2050 2024-09-17T05:23:06.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.423+0000 7f5ac3fff640 1 -- 172.21.15.98:0/1722768734 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5ab4004890 con 0x7f5acc0d2050 2024-09-17T05:23:06.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.423+0000 7f5ad17a0640 1 -- 172.21.15.98:0/1722768734 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5acc0b1fd0 con 0x7f5acc0d2050 2024-09-17T05:23:06.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.423+0000 7f5ac3fff640 1 -- 172.21.15.98:0/1722768734 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab4035030 con 0x7f5acc0d2050 2024-09-17T05:23:06.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.423+0000 7f5ad17a0640 1 -- 172.21.15.98:0/1722768734 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5acc0b2590 con 0x7f5acc0d2050 2024-09-17T05:23:06.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.424+0000 7f5ad17a0640 1 -- 172.21.15.98:0/1722768734 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5acc0b2d60 con 0x7f5acc0d2050 2024-09-17T05:23:06.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.425+0000 7f5ac3fff640 1 -- 172.21.15.98:0/1722768734 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 6) ==== 101594+0+0 (secure 0 0 0) 0x7f5ab4042070 con 0x7f5acc0d2050 2024-09-17T05:23:06.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.426+0000 7f5ac3fff640 1 --2- 172.21.15.98:0/1722768734 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f5aac078d40 0x7f5aac07b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:06.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.426+0000 7f5ac3fff640 1 -- 172.21.15.98:0/1722768734 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f5ab40bbd80 con 0x7f5acc0d2050 2024-09-17T05:23:06.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.426+0000 7f5acaffd640 1 --2- 172.21.15.98:0/1722768734 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f5aac078d40 0x7f5aac07b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:06.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.426+0000 7f5acaffd640 1 --2- 172.21.15.98:0/1722768734 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f5aac078d40 0x7f5aac07b200 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5abc009890 tx=0x7f5abc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:06.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.430+0000 7f5ac3fff640 1 -- 172.21.15.98:0/1722768734 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f5ab40841c0 con 0x7f5acc0d2050 2024-09-17T05:23:06.606 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.605+0000 7f5ad17a0640 1 -- 172.21.15.98:0/1722768734 --> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f5acc15f3d0 con 0x7f5aac078d40 2024-09-17T05:23:06.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.606+0000 7f5ac3fff640 1 -- 172.21.15.98:0/1722768734 <== mgr.4103 v2:172.21.15.167:6800/610796449 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5acc15f3d0 con 0x7f5aac078d40 2024-09-17T05:23:06.607 INFO:teuthology.orchestra.run.smithi098.stderr:instructed osd(s) 3 to deep-scrub 2024-09-17T05:23:06.609 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.608+0000 7f5ad17a0640 1 -- 172.21.15.98:0/1722768734 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f5aac078d40 msgr2=0x7f5aac07b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:06.609 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.608+0000 7f5ad17a0640 1 --2- 172.21.15.98:0/1722768734 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f5aac078d40 0x7f5aac07b200 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5abc009890 tx=0x7f5abc008040 comp rx=0 tx=0).stop 2024-09-17T05:23:06.609 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.608+0000 7f5ad17a0640 1 -- 172.21.15.98:0/1722768734 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5acc0d2050 msgr2=0x7f5acc15a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:06.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.608+0000 7f5ad17a0640 1 --2- 172.21.15.98:0/1722768734 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5acc0d2050 0x7f5acc15a4e0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f5ab40099c0 tx=0x7f5ab40039e0 comp rx=0 tx=0).stop 2024-09-17T05:23:06.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.608+0000 7f5ad17a0640 1 -- 172.21.15.98:0/1722768734 shutdown_connections 2024-09-17T05:23:06.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.608+0000 7f5ad17a0640 1 --2- 172.21.15.98:0/1722768734 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f5aac078d40 0x7f5aac07b200 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:06.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.608+0000 7f5ad17a0640 1 --2- 172.21.15.98:0/1722768734 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5acc15e0d0 0x7f5acc0b92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:06.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.608+0000 7f5ad17a0640 1 --2- 172.21.15.98:0/1722768734 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5acc0d2050 0x7f5acc15a4e0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:06.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.608+0000 7f5ad17a0640 1 --2- 172.21.15.98:0/1722768734 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5acc0d1440 0x7f5acc1f4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:06.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.608+0000 7f5ad17a0640 1 -- 172.21.15.98:0/1722768734 >> 172.21.15.98:0/1722768734 conn(0x7f5acc0d3fe0 msgr2=0x7f5acc160ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:06.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.608+0000 7f5ad17a0640 1 -- 172.21.15.98:0/1722768734 shutdown_connections 2024-09-17T05:23:06.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.608+0000 7f5ad17a0640 1 -- 172.21.15.98:0/1722768734 wait complete. 2024-09-17T05:23:06.620 INFO:tasks.ceph:Scrubbing osd.4 2024-09-17T05:23:06.620 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-17T05:23:06.725 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.724+0000 7fcf42a72640 1 -- 172.21.15.98:0/447595850 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf3c0b4ab0 msgr2=0x7fcf3c0acd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:06.725 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.724+0000 7fcf42a72640 1 --2- 172.21.15.98:0/447595850 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf3c0b4ab0 0x7fcf3c0acd30 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fcf30009830 tx=0x7fcf3002a510 comp rx=0 tx=0).stop 2024-09-17T05:23:06.725 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.724+0000 7fcf42a72640 1 -- 172.21.15.98:0/447595850 shutdown_connections 2024-09-17T05:23:06.726 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.724+0000 7fcf42a72640 1 --2- 172.21.15.98:0/447595850 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf3c0b4ab0 0x7fcf3c0acd30 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:06.726 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.724+0000 7fcf42a72640 1 -- 172.21.15.98:0/447595850 >> 172.21.15.98:0/447595850 conn(0x7fcf3c0b18e0 msgr2=0x7fcf3c0b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:06.726 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.724+0000 7fcf42a72640 1 -- 172.21.15.98:0/447595850 shutdown_connections 2024-09-17T05:23:06.726 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.724+0000 7fcf42a72640 1 -- 172.21.15.98:0/447595850 wait complete. 2024-09-17T05:23:06.726 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.725+0000 7fcf42a72640 1 Processor -- start 2024-09-17T05:23:06.726 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.725+0000 7fcf42a72640 1 -- start start 2024-09-17T05:23:06.728 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.726+0000 7fcf42a72640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf3c0b2be0 0x7fcf3c138040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:06.728 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.726+0000 7fcf42a72640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf3c0b4ab0 0x7fcf3c0732f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:06.728 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.726+0000 7fcf42a72640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcf3c15a660 0x7fcf3c1592d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:06.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.726+0000 7fcf42a72640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fcf3c0cf000 con 0x7fcf3c0b4ab0 2024-09-17T05:23:06.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.726+0000 7fcf42a72640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fcf3c06f910 con 0x7fcf3c0b2be0 2024-09-17T05:23:06.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.726+0000 7fcf42a72640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fcf3c0cf180 con 0x7fcf3c15a660 2024-09-17T05:23:06.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.726+0000 7fcf3bfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf3c0b4ab0 0x7fcf3c0732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:06.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.726+0000 7fcf3bfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf3c0b4ab0 0x7fcf3c0732f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45330/0 (socket says 172.21.15.98:45330) 2024-09-17T05:23:06.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.726+0000 7fcf3bfff640 1 -- 172.21.15.98:0/350410298 learned_addr learned my addr 172.21.15.98:0/350410298 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:23:06.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.726+0000 7fcf4100f640 1 --2- 172.21.15.98:0/350410298 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcf3c15a660 0x7fcf3c1592d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:06.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.726+0000 7fcf4080e640 1 --2- 172.21.15.98:0/350410298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf3c0b2be0 0x7fcf3c138040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:06.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.727+0000 7fcf3bfff640 1 -- 172.21.15.98:0/350410298 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcf3c15a660 msgr2=0x7fcf3c1592d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:06.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.727+0000 7fcf3bfff640 1 --2- 172.21.15.98:0/350410298 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcf3c15a660 0x7fcf3c1592d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:06.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.727+0000 7fcf3bfff640 1 -- 172.21.15.98:0/350410298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf3c0b2be0 msgr2=0x7fcf3c138040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:06.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.727+0000 7fcf3bfff640 1 --2- 172.21.15.98:0/350410298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf3c0b2be0 0x7fcf3c138040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:06.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.727+0000 7fcf3bfff640 1 -- 172.21.15.98:0/350410298 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf3c073830 con 0x7fcf3c0b4ab0 2024-09-17T05:23:06.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.727+0000 7fcf3bfff640 1 --2- 172.21.15.98:0/350410298 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf3c0b4ab0 0x7fcf3c0732f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fcf30000c00 tx=0x7fcf30032d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:06.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.727+0000 7fcf397fa640 1 -- 172.21.15.98:0/350410298 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf30040070 con 0x7fcf3c0b4ab0 2024-09-17T05:23:06.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.727+0000 7fcf397fa640 1 -- 172.21.15.98:0/350410298 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcf30003af0 con 0x7fcf3c0b4ab0 2024-09-17T05:23:06.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.727+0000 7fcf397fa640 1 -- 172.21.15.98:0/350410298 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf30045460 con 0x7fcf3c0b4ab0 2024-09-17T05:23:06.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.727+0000 7fcf42a72640 1 -- 172.21.15.98:0/350410298 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf3c159810 con 0x7fcf3c0b4ab0 2024-09-17T05:23:06.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.727+0000 7fcf42a72640 1 -- 172.21.15.98:0/350410298 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf3c1389b0 con 0x7fcf3c0b4ab0 2024-09-17T05:23:06.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.728+0000 7fcf42a72640 1 -- 172.21.15.98:0/350410298 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcf3c139350 con 0x7fcf3c0b4ab0 2024-09-17T05:23:06.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.729+0000 7fcf397fa640 1 -- 172.21.15.98:0/350410298 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 6) ==== 101594+0+0 (secure 0 0 0) 0x7fcf30039040 con 0x7fcf3c0b4ab0 2024-09-17T05:23:06.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.729+0000 7fcf397fa640 1 --2- 172.21.15.98:0/350410298 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fcf28078d40 0x7fcf2807b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:06.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.729+0000 7fcf397fa640 1 -- 172.21.15.98:0/350410298 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fcf300bc270 con 0x7fcf3c0b4ab0 2024-09-17T05:23:06.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.729+0000 7fcf397fa640 1 --2- 172.21.15.98:0/350410298 >> [v2:172.21.15.167:6810/765789888,v1:172.21.15.167:6811/765789888] conn(0x7fcf2807ec00 0x7fcf28081020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:06.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.729+0000 7fcf397fa640 1 -- 172.21.15.98:0/350410298 --> [v2:172.21.15.167:6810/765789888,v1:172.21.15.167:6811/765789888] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcf30048e50 con 0x7fcf2807ec00 2024-09-17T05:23:06.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.729+0000 7fcf397fa640 1 -- 172.21.15.98:0/350410298 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fcf300c3050 con 0x7fcf3c0b4ab0 2024-09-17T05:23:06.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.729+0000 7fcf4080e640 1 --2- 172.21.15.98:0/350410298 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fcf28078d40 0x7fcf2807b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:06.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.730+0000 7fcf4100f640 1 --2- 172.21.15.98:0/350410298 >> [v2:172.21.15.167:6810/765789888,v1:172.21.15.167:6811/765789888] conn(0x7fcf2807ec00 0x7fcf28081020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:06.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.730+0000 7fcf4080e640 1 --2- 172.21.15.98:0/350410298 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fcf28078d40 0x7fcf2807b200 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c001720 tx=0x7fcf2c007e90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:06.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.730+0000 7fcf4100f640 1 --2- 172.21.15.98:0/350410298 >> [v2:172.21.15.167:6810/765789888,v1:172.21.15.167:6811/765789888] conn(0x7fcf2807ec00 0x7fcf28081020 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:06.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.731+0000 7fcf397fa640 1 -- 172.21.15.98:0/350410298 <== osd.4 v2:172.21.15.167:6810/765789888 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcf30048e50 con 0x7fcf2807ec00 2024-09-17T05:23:06.744 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.743+0000 7fcf42a72640 1 -- 172.21.15.98:0/350410298 --> [v2:172.21.15.167:6810/765789888,v1:172.21.15.167:6811/765789888] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fcf3c0acd30 con 0x7fcf2807ec00 2024-09-17T05:23:06.745 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.744+0000 7fcf397fa640 1 -- 172.21.15.98:0/350410298 <== osd.4 v2:172.21.15.167:6810/765789888 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fcf3c0acd30 con 0x7fcf2807ec00 2024-09-17T05:23:06.745 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T05:23:06.745 INFO:teuthology.orchestra.run.smithi098.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T05:23:06.745 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T05:23:06.746 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.744+0000 7fcf42a72640 1 -- 172.21.15.98:0/350410298 >> [v2:172.21.15.167:6810/765789888,v1:172.21.15.167:6811/765789888] conn(0x7fcf2807ec00 msgr2=0x7fcf28081020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:06.747 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.744+0000 7fcf42a72640 1 --2- 172.21.15.98:0/350410298 >> [v2:172.21.15.167:6810/765789888,v1:172.21.15.167:6811/765789888] conn(0x7fcf2807ec00 0x7fcf28081020 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:06.747 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.744+0000 7fcf42a72640 1 -- 172.21.15.98:0/350410298 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fcf28078d40 msgr2=0x7fcf2807b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:06.747 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.744+0000 7fcf42a72640 1 --2- 172.21.15.98:0/350410298 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fcf28078d40 0x7fcf2807b200 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c001720 tx=0x7fcf2c007e90 comp rx=0 tx=0).stop 2024-09-17T05:23:06.747 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.744+0000 7fcf42a72640 1 -- 172.21.15.98:0/350410298 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf3c0b4ab0 msgr2=0x7fcf3c0732f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:06.747 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.744+0000 7fcf42a72640 1 --2- 172.21.15.98:0/350410298 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf3c0b4ab0 0x7fcf3c0732f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fcf30000c00 tx=0x7fcf30032d50 comp rx=0 tx=0).stop 2024-09-17T05:23:06.747 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.744+0000 7fcf4100f640 1 -- 172.21.15.98:0/350410298 reap_dead start 2024-09-17T05:23:06.747 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.744+0000 7fcf42a72640 1 -- 172.21.15.98:0/350410298 shutdown_connections 2024-09-17T05:23:06.747 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.744+0000 7fcf42a72640 1 -- 172.21.15.98:0/350410298 >> 172.21.15.98:0/350410298 conn(0x7fcf3c0b18e0 msgr2=0x7fcf3c0b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:06.747 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.744+0000 7fcf42a72640 1 -- 172.21.15.98:0/350410298 shutdown_connections 2024-09-17T05:23:06.747 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.744+0000 7fcf42a72640 1 -- 172.21.15.98:0/350410298 wait complete. 2024-09-17T05:23:06.756 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-17T05:23:06.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.857+0000 7f6c674f6640 1 -- 172.21.15.98:0/863812831 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c600b43f0 msgr2=0x7f6c600b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:06.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.857+0000 7f6c674f6640 1 --2- 172.21.15.98:0/863812831 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c600b43f0 0x7f6c600b47d0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c005fd0 tx=0x7f6c5c02a4b0 comp rx=0 tx=0).stop 2024-09-17T05:23:06.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.857+0000 7f6c674f6640 1 -- 172.21.15.98:0/863812831 shutdown_connections 2024-09-17T05:23:06.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.857+0000 7f6c674f6640 1 --2- 172.21.15.98:0/863812831 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c60073bb0 0x7f6c6006ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:06.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.857+0000 7f6c674f6640 1 --2- 172.21.15.98:0/863812831 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c600b43f0 0x7f6c600b47d0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:06.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.857+0000 7f6c674f6640 1 -- 172.21.15.98:0/863812831 >> 172.21.15.98:0/863812831 conn(0x7f6c600b1950 msgr2=0x7f6c600b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:06.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.857+0000 7f6c674f6640 1 -- 172.21.15.98:0/863812831 shutdown_connections 2024-09-17T05:23:06.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.857+0000 7f6c674f6640 1 -- 172.21.15.98:0/863812831 wait complete. 2024-09-17T05:23:06.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.858+0000 7f6c674f6640 1 Processor -- start 2024-09-17T05:23:06.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.858+0000 7f6c674f6640 1 -- start start 2024-09-17T05:23:06.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.859+0000 7f6c674f6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c60073bb0 0x7f6c60154e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:06.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.859+0000 7f6c674f6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c60074150 0x7f6c6014e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:06.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.859+0000 7f6c674f6640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c600b43f0 0x7f6c6009b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:06.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.859+0000 7f6c674f6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6c6006f3b0 con 0x7f6c60074150 2024-09-17T05:23:06.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.859+0000 7f6c674f6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6c600704c0 con 0x7f6c60073bb0 2024-09-17T05:23:06.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.859+0000 7f6c674f6640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f6c6006f530 con 0x7f6c600b43f0 2024-09-17T05:23:06.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.859+0000 7f6c64a91640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c60074150 0x7f6c6014e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:06.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.859+0000 7f6c64a91640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c60074150 0x7f6c6014e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45356/0 (socket says 172.21.15.98:45356) 2024-09-17T05:23:06.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.859+0000 7f6c64a91640 1 -- 172.21.15.98:0/2040811386 learned_addr learned my addr 172.21.15.98:0/2040811386 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:23:06.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.859+0000 7f6c65292640 1 --2- 172.21.15.98:0/2040811386 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c60073bb0 0x7f6c60154e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:06.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.859+0000 7f6c65a93640 1 --2- 172.21.15.98:0/2040811386 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c600b43f0 0x7f6c6009b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:06.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.859+0000 7f6c64a91640 1 -- 172.21.15.98:0/2040811386 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c600b43f0 msgr2=0x7f6c6009b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:06.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.859+0000 7f6c64a91640 1 --2- 172.21.15.98:0/2040811386 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c600b43f0 0x7f6c6009b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:06.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.859+0000 7f6c64a91640 1 -- 172.21.15.98:0/2040811386 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c60073bb0 msgr2=0x7f6c60154e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:06.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.859+0000 7f6c64a91640 1 --2- 172.21.15.98:0/2040811386 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c60073bb0 0x7f6c60154e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:06.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.859+0000 7f6c64a91640 1 -- 172.21.15.98:0/2040811386 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c6009d7b0 con 0x7f6c60074150 2024-09-17T05:23:06.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.859+0000 7f6c64a91640 1 --2- 172.21.15.98:0/2040811386 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c60074150 0x7f6c6014e7e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f6c5000c730 tx=0x7f6c5000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:06.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.859+0000 7f6c55ffb640 1 -- 172.21.15.98:0/2040811386 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c50017070 con 0x7f6c60074150 2024-09-17T05:23:06.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.860+0000 7f6c55ffb640 1 -- 172.21.15.98:0/2040811386 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6c50005180 con 0x7f6c60074150 2024-09-17T05:23:06.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.860+0000 7f6c674f6640 1 -- 172.21.15.98:0/2040811386 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c6009ab30 con 0x7f6c60074150 2024-09-17T05:23:06.863 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.860+0000 7f6c55ffb640 1 -- 172.21.15.98:0/2040811386 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c5000a640 con 0x7f6c60074150 2024-09-17T05:23:06.863 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.860+0000 7f6c674f6640 1 -- 172.21.15.98:0/2040811386 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c60152840 con 0x7f6c60074150 2024-09-17T05:23:06.864 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.861+0000 7f6c674f6640 1 -- 172.21.15.98:0/2040811386 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c600760b0 con 0x7f6c60074150 2024-09-17T05:23:06.864 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.862+0000 7f6c55ffb640 1 -- 172.21.15.98:0/2040811386 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 6) ==== 101594+0+0 (secure 0 0 0) 0x7f6c5001a070 con 0x7f6c60074150 2024-09-17T05:23:06.864 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.862+0000 7f6c55ffb640 1 --2- 172.21.15.98:0/2040811386 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f6c44078d40 0x7f6c4407b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:06.864 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.862+0000 7f6c55ffb640 1 -- 172.21.15.98:0/2040811386 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f6c5009a160 con 0x7f6c60074150 2024-09-17T05:23:06.864 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.862+0000 7f6c65292640 1 --2- 172.21.15.98:0/2040811386 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f6c44078d40 0x7f6c4407b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:06.864 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.863+0000 7f6c65292640 1 --2- 172.21.15.98:0/2040811386 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f6c44078d40 0x7f6c4407b200 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c033000 tx=0x7f6c5c004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:06.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:06.866+0000 7f6c55ffb640 1 -- 172.21.15.98:0/2040811386 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f6c600cf9d0 con 0x7f6c60074150 2024-09-17T05:23:07.041 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.040+0000 7f6c674f6640 1 -- 172.21.15.98:0/2040811386 --> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f6c600749b0 con 0x7f6c44078d40 2024-09-17T05:23:07.042 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.041+0000 7f6c55ffb640 1 -- 172.21.15.98:0/2040811386 <== mgr.4103 v2:172.21.15.167:6800/610796449 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6c600749b0 con 0x7f6c44078d40 2024-09-17T05:23:07.042 INFO:teuthology.orchestra.run.smithi098.stderr:instructed osd(s) 4 to deep-scrub 2024-09-17T05:23:07.044 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.043+0000 7f6c674f6640 1 -- 172.21.15.98:0/2040811386 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f6c44078d40 msgr2=0x7f6c4407b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:07.044 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.043+0000 7f6c674f6640 1 --2- 172.21.15.98:0/2040811386 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f6c44078d40 0x7f6c4407b200 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c033000 tx=0x7f6c5c004730 comp rx=0 tx=0).stop 2024-09-17T05:23:07.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.043+0000 7f6c674f6640 1 -- 172.21.15.98:0/2040811386 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c60074150 msgr2=0x7f6c6014e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:07.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.043+0000 7f6c674f6640 1 --2- 172.21.15.98:0/2040811386 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c60074150 0x7f6c6014e7e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f6c5000c730 tx=0x7f6c5000cbf0 comp rx=0 tx=0).stop 2024-09-17T05:23:07.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.043+0000 7f6c674f6640 1 -- 172.21.15.98:0/2040811386 shutdown_connections 2024-09-17T05:23:07.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.043+0000 7f6c674f6640 1 --2- 172.21.15.98:0/2040811386 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f6c44078d40 0x7f6c4407b200 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:07.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.043+0000 7f6c674f6640 1 --2- 172.21.15.98:0/2040811386 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c600b43f0 0x7f6c6009b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:07.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.043+0000 7f6c674f6640 1 --2- 172.21.15.98:0/2040811386 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c60074150 0x7f6c6014e7e0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:07.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.043+0000 7f6c674f6640 1 --2- 172.21.15.98:0/2040811386 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c60073bb0 0x7f6c60154e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:07.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.043+0000 7f6c674f6640 1 -- 172.21.15.98:0/2040811386 >> 172.21.15.98:0/2040811386 conn(0x7f6c600b1950 msgr2=0x7f6c600cdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:07.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.043+0000 7f6c674f6640 1 -- 172.21.15.98:0/2040811386 shutdown_connections 2024-09-17T05:23:07.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.043+0000 7f6c674f6640 1 -- 172.21.15.98:0/2040811386 wait complete. 2024-09-17T05:23:07.055 INFO:tasks.ceph:Scrubbing osd.5 2024-09-17T05:23:07.055 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-17T05:23:07.161 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.160+0000 7f91f0ce2640 1 -- 172.21.15.98:0/3363216836 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91d80062d0 msgr2=0x7f91d800cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:07.161 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.160+0000 7f91f0ce2640 1 --2- 172.21.15.98:0/3363216836 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91d80062d0 0x7f91d800cad0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f91e40016c0 tx=0x7f91d8006940 comp rx=0 tx=0).stop 2024-09-17T05:23:07.161 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.160+0000 7f91f0ce2640 1 -- 172.21.15.98:0/3363216836 shutdown_connections 2024-09-17T05:23:07.161 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.160+0000 7f91f0ce2640 1 --2- 172.21.15.98:0/3363216836 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91d80062d0 0x7f91d800cad0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:07.161 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.160+0000 7f91f0ce2640 1 -- 172.21.15.98:0/3363216836 >> 172.21.15.98:0/3363216836 conn(0x7f91ec0b18e0 msgr2=0x7f91ec0b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:07.161 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.160+0000 7f91f0ce2640 1 -- 172.21.15.98:0/3363216836 shutdown_connections 2024-09-17T05:23:07.161 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.160+0000 7f91f0ce2640 1 -- 172.21.15.98:0/3363216836 wait complete. 2024-09-17T05:23:07.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.161+0000 7f91f0ce2640 1 Processor -- start 2024-09-17T05:23:07.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.161+0000 7f91f0ce2640 1 -- start start 2024-09-17T05:23:07.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.162+0000 7f91f0ce2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91d80062d0 0x7f91ec1502a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:07.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.162+0000 7f91f0ce2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91ec15d550 0x7f91ec1f3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:07.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.162+0000 7f91f0ce2640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f91ec0ae7b0 0x7f91ec1f4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:07.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.162+0000 7f91f0ce2640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f91ec0ad110 con 0x7f91ec15d550 2024-09-17T05:23:07.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.162+0000 7f91f0ce2640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f91ec0acf90 con 0x7f91d80062d0 2024-09-17T05:23:07.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.162+0000 7f91f0ce2640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f91ec0b43a0 con 0x7f91ec0ae7b0 2024-09-17T05:23:07.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.162+0000 7f91e9d9b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91ec15d550 0x7f91ec1f3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:07.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.162+0000 7f91e9d9b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91ec15d550 0x7f91ec1f3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45380/0 (socket says 172.21.15.98:45380) 2024-09-17T05:23:07.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.162+0000 7f91e9d9b640 1 -- 172.21.15.98:0/3148918799 learned_addr learned my addr 172.21.15.98:0/3148918799 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:23:07.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.162+0000 7f91ea59c640 1 --2- 172.21.15.98:0/3148918799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91d80062d0 0x7f91ec1502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:07.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.162+0000 7f91ead9d640 1 --2- 172.21.15.98:0/3148918799 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f91ec0ae7b0 0x7f91ec1f4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:07.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.162+0000 7f91e9d9b640 1 -- 172.21.15.98:0/3148918799 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f91ec0ae7b0 msgr2=0x7f91ec1f4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:07.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.162+0000 7f91e9d9b640 1 --2- 172.21.15.98:0/3148918799 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f91ec0ae7b0 0x7f91ec1f4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:07.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.162+0000 7f91e9d9b640 1 -- 172.21.15.98:0/3148918799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91d80062d0 msgr2=0x7f91ec1502a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:07.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.162+0000 7f91e9d9b640 1 --2- 172.21.15.98:0/3148918799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91d80062d0 0x7f91ec1502a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:07.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.162+0000 7f91e9d9b640 1 -- 172.21.15.98:0/3148918799 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91ec1507e0 con 0x7f91ec15d550 2024-09-17T05:23:07.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.163+0000 7f91e9d9b640 1 --2- 172.21.15.98:0/3148918799 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91ec15d550 0x7f91ec1f3f20 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f91d400e710 tx=0x7f91d400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:07.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.163+0000 7f91e2ffd640 1 -- 172.21.15.98:0/3148918799 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d400a9d0 con 0x7f91ec15d550 2024-09-17T05:23:07.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.163+0000 7f91e2ffd640 1 -- 172.21.15.98:0/3148918799 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f91d400ab70 con 0x7f91ec15d550 2024-09-17T05:23:07.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.163+0000 7f91f0ce2640 1 -- 172.21.15.98:0/3148918799 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91ec15b640 con 0x7f91ec15d550 2024-09-17T05:23:07.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.163+0000 7f91e2ffd640 1 -- 172.21.15.98:0/3148918799 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d4018420 con 0x7f91ec15d550 2024-09-17T05:23:07.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.163+0000 7f91f0ce2640 1 -- 172.21.15.98:0/3148918799 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91ec15bc00 con 0x7f91ec15d550 2024-09-17T05:23:07.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.163+0000 7f91f0ce2640 1 -- 172.21.15.98:0/3148918799 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f91ec0b48a0 con 0x7f91ec15d550 2024-09-17T05:23:07.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.164+0000 7f91e2ffd640 1 -- 172.21.15.98:0/3148918799 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 6) ==== 101594+0+0 (secure 0 0 0) 0x7f91d40185c0 con 0x7f91ec15d550 2024-09-17T05:23:07.168 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.165+0000 7f91e2ffd640 1 --2- 172.21.15.98:0/3148918799 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f91cc078d70 0x7f91cc07b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:07.168 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.165+0000 7f91e2ffd640 1 -- 172.21.15.98:0/3148918799 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f91d409c910 con 0x7f91ec15d550 2024-09-17T05:23:07.168 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.165+0000 7f91e2ffd640 1 --2- 172.21.15.98:0/3148918799 >> [v2:172.21.15.167:6802/2567019914,v1:172.21.15.167:6803/2567019914] conn(0x7f91cc07ec30 0x7f91cc081050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:07.168 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.165+0000 7f91e2ffd640 1 -- 172.21.15.98:0/3148918799 --> [v2:172.21.15.167:6802/2567019914,v1:172.21.15.167:6803/2567019914] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f91cc081700 con 0x7f91cc07ec30 2024-09-17T05:23:07.168 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.165+0000 7f91e2ffd640 1 -- 172.21.15.98:0/3148918799 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f91d40a12a0 con 0x7f91ec15d550 2024-09-17T05:23:07.168 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.165+0000 7f91ea59c640 1 --2- 172.21.15.98:0/3148918799 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f91cc078d70 0x7f91cc07b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:07.168 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.165+0000 7f91ead9d640 1 --2- 172.21.15.98:0/3148918799 >> [v2:172.21.15.167:6802/2567019914,v1:172.21.15.167:6803/2567019914] conn(0x7f91cc07ec30 0x7f91cc081050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:07.168 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.165+0000 7f91ea59c640 1 --2- 172.21.15.98:0/3148918799 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f91cc078d70 0x7f91cc07b230 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f91dc005fd0 tx=0x7f91dc009500 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:07.168 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.166+0000 7f91ead9d640 1 --2- 172.21.15.98:0/3148918799 >> [v2:172.21.15.167:6802/2567019914,v1:172.21.15.167:6803/2567019914] conn(0x7f91cc07ec30 0x7f91cc081050 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:07.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.166+0000 7f91e2ffd640 1 -- 172.21.15.98:0/3148918799 <== osd.5 v2:172.21.15.167:6802/2567019914 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f91cc081700 con 0x7f91cc07ec30 2024-09-17T05:23:07.179 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.178+0000 7f91f0ce2640 1 -- 172.21.15.98:0/3148918799 --> [v2:172.21.15.167:6802/2567019914,v1:172.21.15.167:6803/2567019914] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f91ec155650 con 0x7f91cc07ec30 2024-09-17T05:23:07.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.179+0000 7f91e2ffd640 1 -- 172.21.15.98:0/3148918799 <== osd.5 v2:172.21.15.167:6802/2567019914 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f91e402e040 con 0x7f91cc07ec30 2024-09-17T05:23:07.180 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T05:23:07.180 INFO:teuthology.orchestra.run.smithi098.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T05:23:07.180 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T05:23:07.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.180+0000 7f91f0ce2640 1 -- 172.21.15.98:0/3148918799 >> [v2:172.21.15.167:6802/2567019914,v1:172.21.15.167:6803/2567019914] conn(0x7f91cc07ec30 msgr2=0x7f91cc081050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:07.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.180+0000 7f91f0ce2640 1 --2- 172.21.15.98:0/3148918799 >> [v2:172.21.15.167:6802/2567019914,v1:172.21.15.167:6803/2567019914] conn(0x7f91cc07ec30 0x7f91cc081050 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:07.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.180+0000 7f91f0ce2640 1 -- 172.21.15.98:0/3148918799 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f91cc078d70 msgr2=0x7f91cc07b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:07.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.180+0000 7f91f0ce2640 1 --2- 172.21.15.98:0/3148918799 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f91cc078d70 0x7f91cc07b230 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f91dc005fd0 tx=0x7f91dc009500 comp rx=0 tx=0).stop 2024-09-17T05:23:07.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.180+0000 7f91f0ce2640 1 -- 172.21.15.98:0/3148918799 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91ec15d550 msgr2=0x7f91ec1f3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:07.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.180+0000 7f91f0ce2640 1 --2- 172.21.15.98:0/3148918799 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91ec15d550 0x7f91ec1f3f20 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f91d400e710 tx=0x7f91d400ebd0 comp rx=0 tx=0).stop 2024-09-17T05:23:07.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.180+0000 7f91ead9d640 1 -- 172.21.15.98:0/3148918799 reap_dead start 2024-09-17T05:23:07.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.180+0000 7f91f0ce2640 1 -- 172.21.15.98:0/3148918799 shutdown_connections 2024-09-17T05:23:07.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.180+0000 7f91f0ce2640 1 -- 172.21.15.98:0/3148918799 >> 172.21.15.98:0/3148918799 conn(0x7f91ec0b18e0 msgr2=0x7f91ec0b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:07.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.180+0000 7f91f0ce2640 1 -- 172.21.15.98:0/3148918799 shutdown_connections 2024-09-17T05:23:07.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.180+0000 7f91f0ce2640 1 -- 172.21.15.98:0/3148918799 wait complete. 2024-09-17T05:23:07.191 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-17T05:23:07.293 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.292+0000 7f24469da640 1 -- 172.21.15.98:0/1514872280 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f24400b43f0 msgr2=0x7f24400b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:07.293 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.292+0000 7f24469da640 1 --2- 172.21.15.98:0/1514872280 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f24400b43f0 0x7f24400b47d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f24400af840 tx=0x7f243002a4d0 comp rx=0 tx=0).stop 2024-09-17T05:23:07.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.292+0000 7f24469da640 1 -- 172.21.15.98:0/1514872280 shutdown_connections 2024-09-17T05:23:07.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.292+0000 7f24469da640 1 --2- 172.21.15.98:0/1514872280 >> v2:172.21.15.167:3300/0 conn(0x7f2440074150 0x7f244006e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:07.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.292+0000 7f24469da640 1 --2- 172.21.15.98:0/1514872280 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f24400b43f0 0x7f24400b47d0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:07.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.292+0000 7f24469da640 1 -- 172.21.15.98:0/1514872280 >> 172.21.15.98:0/1514872280 conn(0x7f24400b1950 msgr2=0x7f24400b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:07.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.292+0000 7f24469da640 1 -- 172.21.15.98:0/1514872280 shutdown_connections 2024-09-17T05:23:07.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.292+0000 7f24469da640 1 -- 172.21.15.98:0/1514872280 wait complete. 2024-09-17T05:23:07.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.293+0000 7f24469da640 1 Processor -- start 2024-09-17T05:23:07.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.294+0000 7f24469da640 1 -- start start 2024-09-17T05:23:07.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.294+0000 7f24469da640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2440074150 0x7f2440150320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:07.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.294+0000 7f24469da640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24400746a0 0x7f24401f5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:07.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.294+0000 7f24469da640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24400b43f0 0x7f24401f5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:07.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.294+0000 7f24469da640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f244006f3b0 con 0x7f2440074150 2024-09-17T05:23:07.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.294+0000 7f24469da640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f244015dd20 con 0x7f24400746a0 2024-09-17T05:23:07.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.294+0000 7f24469da640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f244006f530 con 0x7f24400b43f0 2024-09-17T05:23:07.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.294+0000 7f243ffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2440074150 0x7f2440150320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:07.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.294+0000 7f243ffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2440074150 0x7f2440150320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45402/0 (socket says 172.21.15.98:45402) 2024-09-17T05:23:07.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.294+0000 7f243ffff640 1 -- 172.21.15.98:0/4132805082 learned_addr learned my addr 172.21.15.98:0/4132805082 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:23:07.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.294+0000 7f243f7fe640 1 --2- 172.21.15.98:0/4132805082 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24400746a0 0x7f24401f5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:07.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.294+0000 7f2444f77640 1 --2- 172.21.15.98:0/4132805082 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24400b43f0 0x7f24401f5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:07.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.295+0000 7f243ffff640 1 -- 172.21.15.98:0/4132805082 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24400b43f0 msgr2=0x7f24401f5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:07.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.295+0000 7f243ffff640 1 --2- 172.21.15.98:0/4132805082 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24400b43f0 0x7f24401f5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:07.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.295+0000 7f243ffff640 1 -- 172.21.15.98:0/4132805082 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24400746a0 msgr2=0x7f24401f5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:07.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.295+0000 7f243ffff640 1 --2- 172.21.15.98:0/4132805082 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24400746a0 0x7f24401f5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:07.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.295+0000 7f243ffff640 1 -- 172.21.15.98:0/4132805082 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24401f1c40 con 0x7f2440074150 2024-09-17T05:23:07.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.295+0000 7f243ffff640 1 --2- 172.21.15.98:0/4132805082 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2440074150 0x7f2440150320 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2430034040 tx=0x7f2430003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:07.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.295+0000 7f243cff9640 1 -- 172.21.15.98:0/4132805082 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243003e030 con 0x7f2440074150 2024-09-17T05:23:07.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.295+0000 7f243cff9640 1 -- 172.21.15.98:0/4132805082 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2430003d10 con 0x7f2440074150 2024-09-17T05:23:07.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.295+0000 7f24469da640 1 -- 172.21.15.98:0/4132805082 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24401f1ee0 con 0x7f2440074150 2024-09-17T05:23:07.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.295+0000 7f243cff9640 1 -- 172.21.15.98:0/4132805082 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2430035040 con 0x7f2440074150 2024-09-17T05:23:07.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.295+0000 7f24469da640 1 -- 172.21.15.98:0/4132805082 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24401f24a0 con 0x7f2440074150 2024-09-17T05:23:07.299 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.296+0000 7f24469da640 1 -- 172.21.15.98:0/4132805082 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2440073d70 con 0x7f2440074150 2024-09-17T05:23:07.299 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.297+0000 7f243cff9640 1 -- 172.21.15.98:0/4132805082 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 6) ==== 101594+0+0 (secure 0 0 0) 0x7f2430041030 con 0x7f2440074150 2024-09-17T05:23:07.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.297+0000 7f243cff9640 1 --2- 172.21.15.98:0/4132805082 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f242c078d70 0x7f242c07b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:07.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.297+0000 7f243cff9640 1 -- 172.21.15.98:0/4132805082 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f24300bb2b0 con 0x7f2440074150 2024-09-17T05:23:07.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.298+0000 7f243f7fe640 1 --2- 172.21.15.98:0/4132805082 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f242c078d70 0x7f242c07b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:07.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.298+0000 7f243f7fe640 1 --2- 172.21.15.98:0/4132805082 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f242c078d70 0x7f242c07b230 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f244009bd00 tx=0x7f2434005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:07.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.301+0000 7f243cff9640 1 -- 172.21.15.98:0/4132805082 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f2430083140 con 0x7f2440074150 2024-09-17T05:23:07.479 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.479+0000 7f24469da640 1 -- 172.21.15.98:0/4132805082 --> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f244015a500 con 0x7f242c078d70 2024-09-17T05:23:07.770 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.479+0000 7f243cff9640 1 -- 172.21.15.98:0/4132805082 <== mgr.4103 v2:172.21.15.167:6800/610796449 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f244015a500 con 0x7f242c078d70 2024-09-17T05:23:07.771 INFO:teuthology.orchestra.run.smithi098.stderr:instructed osd(s) 5 to deep-scrub 2024-09-17T05:23:07.771 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.482+0000 7f24469da640 1 -- 172.21.15.98:0/4132805082 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f242c078d70 msgr2=0x7f242c07b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:07.771 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.482+0000 7f24469da640 1 --2- 172.21.15.98:0/4132805082 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f242c078d70 0x7f242c07b230 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f244009bd00 tx=0x7f2434005f90 comp rx=0 tx=0).stop 2024-09-17T05:23:07.771 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.482+0000 7f24469da640 1 -- 172.21.15.98:0/4132805082 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2440074150 msgr2=0x7f2440150320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:07.771 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.482+0000 7f24469da640 1 --2- 172.21.15.98:0/4132805082 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2440074150 0x7f2440150320 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2430034040 tx=0x7f2430003820 comp rx=0 tx=0).stop 2024-09-17T05:23:07.771 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.482+0000 7f24469da640 1 -- 172.21.15.98:0/4132805082 shutdown_connections 2024-09-17T05:23:07.771 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.482+0000 7f24469da640 1 --2- 172.21.15.98:0/4132805082 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f242c078d70 0x7f242c07b230 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:07.771 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.482+0000 7f24469da640 1 --2- 172.21.15.98:0/4132805082 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24400b43f0 0x7f24401f5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:07.771 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.482+0000 7f24469da640 1 --2- 172.21.15.98:0/4132805082 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24400746a0 0x7f24401f5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:07.771 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.482+0000 7f24469da640 1 --2- 172.21.15.98:0/4132805082 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2440074150 0x7f2440150320 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:07.771 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.482+0000 7f24469da640 1 -- 172.21.15.98:0/4132805082 >> 172.21.15.98:0/4132805082 conn(0x7f24400b1950 msgr2=0x7f24400ccdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:07.771 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.482+0000 7f24469da640 1 -- 172.21.15.98:0/4132805082 shutdown_connections 2024-09-17T05:23:07.771 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.482+0000 7f24469da640 1 -- 172.21.15.98:0/4132805082 wait complete. 2024-09-17T05:23:07.772 INFO:tasks.ceph:Scrubbing osd.6 2024-09-17T05:23:07.772 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-17T05:23:07.879 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.878+0000 7f1b4bb10640 1 -- 172.21.15.98:0/1309952570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b440cf670 msgr2=0x7f1b440d0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:07.879 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.878+0000 7f1b4bb10640 1 --2- 172.21.15.98:0/1309952570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b440cf670 0x7f1b440d0d40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1b34009830 tx=0x7f1b3402a5a0 comp rx=0 tx=0).stop 2024-09-17T05:23:07.879 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.878+0000 7f1b4bb10640 1 -- 172.21.15.98:0/1309952570 shutdown_connections 2024-09-17T05:23:07.879 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.878+0000 7f1b4bb10640 1 --2- 172.21.15.98:0/1309952570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b440cf670 0x7f1b440d0d40 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:07.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.878+0000 7f1b4bb10640 1 --2- 172.21.15.98:0/1309952570 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1b4415e340 0x7f1b440d0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:07.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.878+0000 7f1b4bb10640 1 -- 172.21.15.98:0/1309952570 >> 172.21.15.98:0/1309952570 conn(0x7f1b440d4050 msgr2=0x7f1b440d4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:07.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.878+0000 7f1b4bb10640 1 -- 172.21.15.98:0/1309952570 shutdown_connections 2024-09-17T05:23:07.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.878+0000 7f1b4bb10640 1 -- 172.21.15.98:0/1309952570 wait complete. 2024-09-17T05:23:07.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.879+0000 7f1b4bb10640 1 Processor -- start 2024-09-17T05:23:07.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.879+0000 7f1b4bb10640 1 -- start start 2024-09-17T05:23:07.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.880+0000 7f1b4bb10640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b440d4b70 0x7f1b440cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:07.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.880+0000 7f1b4bb10640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1b4415e340 0x7f1b440ce060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:07.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.880+0000 7f1b4bb10640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b4415b550 0x7f1b441f4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:07.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.880+0000 7f1b4bb10640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1b440d2590 con 0x7f1b440d4b70 2024-09-17T05:23:07.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.880+0000 7f1b4bb10640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1b440d2410 con 0x7f1b4415b550 2024-09-17T05:23:07.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.880+0000 7f1b4bb10640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f1b440d2710 con 0x7f1b4415e340 2024-09-17T05:23:07.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.880+0000 7f1b498ac640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b440d4b70 0x7f1b440cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:07.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.880+0000 7f1b498ac640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b440d4b70 0x7f1b440cdb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45412/0 (socket says 172.21.15.98:45412) 2024-09-17T05:23:07.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.880+0000 7f1b498ac640 1 -- 172.21.15.98:0/866301939 learned_addr learned my addr 172.21.15.98:0/866301939 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:23:07.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.880+0000 7f1b490ab640 1 --2- 172.21.15.98:0/866301939 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1b4415e340 0x7f1b440ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:07.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.880+0000 7f1b4a0ad640 1 --2- 172.21.15.98:0/866301939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b4415b550 0x7f1b441f4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:07.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.880+0000 7f1b498ac640 1 -- 172.21.15.98:0/866301939 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1b4415e340 msgr2=0x7f1b440ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:07.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.880+0000 7f1b498ac640 1 --2- 172.21.15.98:0/866301939 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1b4415e340 0x7f1b440ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:07.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.880+0000 7f1b498ac640 1 -- 172.21.15.98:0/866301939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b4415b550 msgr2=0x7f1b441f4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:07.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.880+0000 7f1b498ac640 1 --2- 172.21.15.98:0/866301939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b4415b550 0x7f1b441f4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:07.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.880+0000 7f1b498ac640 1 -- 172.21.15.98:0/866301939 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b44159e20 con 0x7f1b440d4b70 2024-09-17T05:23:07.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.880+0000 7f1b498ac640 1 --2- 172.21.15.98:0/866301939 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b440d4b70 0x7f1b440cdb20 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f1b4000e7c0 tx=0x7f1b4000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:07.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.880+0000 7f1b3a7fc640 1 -- 172.21.15.98:0/866301939 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b4000ccc0 con 0x7f1b440d4b70 2024-09-17T05:23:07.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.880+0000 7f1b3a7fc640 1 -- 172.21.15.98:0/866301939 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1b40010430 con 0x7f1b440d4b70 2024-09-17T05:23:07.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.880+0000 7f1b3a7fc640 1 -- 172.21.15.98:0/866301939 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b40010860 con 0x7f1b440d4b70 2024-09-17T05:23:07.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.880+0000 7f1b4bb10640 1 -- 172.21.15.98:0/866301939 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b4415a100 con 0x7f1b440d4b70 2024-09-17T05:23:07.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.881+0000 7f1b4bb10640 1 -- 172.21.15.98:0/866301939 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b4415a6c0 con 0x7f1b440d4b70 2024-09-17T05:23:07.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.881+0000 7f1b4bb10640 1 -- 172.21.15.98:0/866301939 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1b440d2ca0 con 0x7f1b440d4b70 2024-09-17T05:23:07.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.882+0000 7f1b3a7fc640 1 -- 172.21.15.98:0/866301939 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 6) ==== 101594+0+0 (secure 0 0 0) 0x7f1b40010a00 con 0x7f1b440d4b70 2024-09-17T05:23:07.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.882+0000 7f1b3a7fc640 1 --2- 172.21.15.98:0/866301939 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f1b28078d40 0x7f1b2807b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:07.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.883+0000 7f1b3a7fc640 1 -- 172.21.15.98:0/866301939 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f1b4009b5f0 con 0x7f1b440d4b70 2024-09-17T05:23:07.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.883+0000 7f1b3a7fc640 1 --2- 172.21.15.98:0/866301939 >> [v2:172.21.15.167:6818/96262631,v1:172.21.15.167:6819/96262631] conn(0x7f1b2807ec00 0x7f1b28081020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:07.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.883+0000 7f1b3a7fc640 1 -- 172.21.15.98:0/866301939 --> [v2:172.21.15.167:6818/96262631,v1:172.21.15.167:6819/96262631] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1b40023e50 con 0x7f1b2807ec00 2024-09-17T05:23:07.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.883+0000 7f1b3a7fc640 1 -- 172.21.15.98:0/866301939 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f1b400a2050 con 0x7f1b440d4b70 2024-09-17T05:23:07.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.883+0000 7f1b490ab640 1 --2- 172.21.15.98:0/866301939 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f1b28078d40 0x7f1b2807b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:07.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.883+0000 7f1b4a0ad640 1 --2- 172.21.15.98:0/866301939 >> [v2:172.21.15.167:6818/96262631,v1:172.21.15.167:6819/96262631] conn(0x7f1b2807ec00 0x7f1b28081020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:07.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.883+0000 7f1b490ab640 1 --2- 172.21.15.98:0/866301939 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f1b28078d40 0x7f1b2807b200 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1b34034000 tx=0x7f1b34004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:07.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.883+0000 7f1b4a0ad640 1 --2- 172.21.15.98:0/866301939 >> [v2:172.21.15.167:6818/96262631,v1:172.21.15.167:6819/96262631] conn(0x7f1b2807ec00 0x7f1b28081020 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:07.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.884+0000 7f1b3a7fc640 1 -- 172.21.15.98:0/866301939 <== osd.6 v2:172.21.15.167:6818/96262631 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1b40023e50 con 0x7f1b2807ec00 2024-09-17T05:23:07.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.896+0000 7f1b4bb10640 1 -- 172.21.15.98:0/866301939 --> [v2:172.21.15.167:6818/96262631,v1:172.21.15.167:6819/96262631] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1b440b5e10 con 0x7f1b2807ec00 2024-09-17T05:23:07.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.897+0000 7f1b3a7fc640 1 -- 172.21.15.98:0/866301939 <== osd.6 v2:172.21.15.167:6818/96262631 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f1b440b5e10 con 0x7f1b2807ec00 2024-09-17T05:23:07.898 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T05:23:07.898 INFO:teuthology.orchestra.run.smithi098.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T05:23:07.898 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T05:23:07.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.897+0000 7f1b4bb10640 1 -- 172.21.15.98:0/866301939 >> [v2:172.21.15.167:6818/96262631,v1:172.21.15.167:6819/96262631] conn(0x7f1b2807ec00 msgr2=0x7f1b28081020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:07.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.897+0000 7f1b4bb10640 1 --2- 172.21.15.98:0/866301939 >> [v2:172.21.15.167:6818/96262631,v1:172.21.15.167:6819/96262631] conn(0x7f1b2807ec00 0x7f1b28081020 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:07.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.897+0000 7f1b4bb10640 1 -- 172.21.15.98:0/866301939 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f1b28078d40 msgr2=0x7f1b2807b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:07.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.897+0000 7f1b4bb10640 1 --2- 172.21.15.98:0/866301939 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f1b28078d40 0x7f1b2807b200 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1b34034000 tx=0x7f1b34004730 comp rx=0 tx=0).stop 2024-09-17T05:23:07.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.897+0000 7f1b4bb10640 1 -- 172.21.15.98:0/866301939 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b440d4b70 msgr2=0x7f1b440cdb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:07.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.897+0000 7f1b4bb10640 1 --2- 172.21.15.98:0/866301939 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b440d4b70 0x7f1b440cdb20 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f1b4000e7c0 tx=0x7f1b4000ec80 comp rx=0 tx=0).stop 2024-09-17T05:23:07.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.897+0000 7f1b4a0ad640 1 -- 172.21.15.98:0/866301939 reap_dead start 2024-09-17T05:23:07.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.897+0000 7f1b4bb10640 1 -- 172.21.15.98:0/866301939 shutdown_connections 2024-09-17T05:23:07.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.897+0000 7f1b4bb10640 1 -- 172.21.15.98:0/866301939 >> 172.21.15.98:0/866301939 conn(0x7f1b440d4050 msgr2=0x7f1b440d05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:07.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.897+0000 7f1b4bb10640 1 -- 172.21.15.98:0/866301939 shutdown_connections 2024-09-17T05:23:07.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:07.897+0000 7f1b4bb10640 1 -- 172.21.15.98:0/866301939 wait complete. 2024-09-17T05:23:07.908 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-17T05:23:08.012 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.011+0000 7f6869d24640 1 -- 172.21.15.98:0/188515449 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f686406d000 msgr2=0x7f68640cf670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:08.012 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.011+0000 7f6869d24640 1 --2- 172.21.15.98:0/188515449 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f686406d000 0x7f68640cf670 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f685c005fd0 tx=0x7f685c02a940 comp rx=0 tx=0).stop 2024-09-17T05:23:08.012 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.011+0000 7f6869d24640 1 -- 172.21.15.98:0/188515449 shutdown_connections 2024-09-17T05:23:08.012 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.011+0000 7f6869d24640 1 --2- 172.21.15.98:0/188515449 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f686406d000 0x7f68640cf670 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:08.012 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.011+0000 7f6869d24640 1 -- 172.21.15.98:0/188515449 >> 172.21.15.98:0/188515449 conn(0x7f68640b2230 msgr2=0x7f68640b2610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:08.012 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.011+0000 7f6869d24640 1 -- 172.21.15.98:0/188515449 shutdown_connections 2024-09-17T05:23:08.012 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.011+0000 7f6869d24640 1 -- 172.21.15.98:0/188515449 wait complete. 2024-09-17T05:23:08.015 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.012+0000 7f6869d24640 1 Processor -- start 2024-09-17T05:23:08.015 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.012+0000 7f6869d24640 1 -- start start 2024-09-17T05:23:08.015 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.013+0000 7f6869d24640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f686406cb70 0x7f686413dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:08.015 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.013+0000 7f6869d24640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f686406d000 0x7f68640a9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:08.015 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.013+0000 7f6869d24640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f686413efa0 0x7f68640b11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:08.015 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.013+0000 7f6869d24640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6864068c10 con 0x7f686406d000 2024-09-17T05:23:08.015 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.013+0000 7f6869d24640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f68640cfbb0 con 0x7f686413efa0 2024-09-17T05:23:08.015 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.013+0000 7f6869d24640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f68641f26e0 con 0x7f686406cb70 2024-09-17T05:23:08.015 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.013+0000 7f685bfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f686406d000 0x7f68640a9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:08.015 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.013+0000 7f685bfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f686406d000 0x7f68640a9460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45430/0 (socket says 172.21.15.98:45430) 2024-09-17T05:23:08.015 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.013+0000 7f685bfff640 1 -- 172.21.15.98:0/2530464900 learned_addr learned my addr 172.21.15.98:0/2530464900 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:23:08.016 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.013+0000 7f68637fe640 1 --2- 172.21.15.98:0/2530464900 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f686406cb70 0x7f686413dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:08.016 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.013+0000 7f6863fff640 1 --2- 172.21.15.98:0/2530464900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f686413efa0 0x7f68640b11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:08.016 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.013+0000 7f685bfff640 1 -- 172.21.15.98:0/2530464900 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f686406cb70 msgr2=0x7f686413dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:08.016 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.013+0000 7f685bfff640 1 --2- 172.21.15.98:0/2530464900 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f686406cb70 0x7f686413dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:08.016 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.013+0000 7f685bfff640 1 -- 172.21.15.98:0/2530464900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f686413efa0 msgr2=0x7f68640b11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:08.016 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.013+0000 7f685bfff640 1 --2- 172.21.15.98:0/2530464900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f686413efa0 0x7f68640b11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:08.016 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.013+0000 7f685bfff640 1 -- 172.21.15.98:0/2530464900 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68640aa4c0 con 0x7f686406d000 2024-09-17T05:23:08.016 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.013+0000 7f68637fe640 1 --2- 172.21.15.98:0/2530464900 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f686406cb70 0x7f686413dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:23:08.016 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.013+0000 7f685bfff640 1 --2- 172.21.15.98:0/2530464900 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f686406d000 0x7f68640a9460 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f684c00c490 tx=0x7f684c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:08.016 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.013+0000 7f6860ff9640 1 -- 172.21.15.98:0/2530464900 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f684c016020 con 0x7f686406d000 2024-09-17T05:23:08.016 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.013+0000 7f6860ff9640 1 -- 172.21.15.98:0/2530464900 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f684c012940 con 0x7f686406d000 2024-09-17T05:23:08.016 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.013+0000 7f6869d24640 1 -- 172.21.15.98:0/2530464900 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f686413dff0 con 0x7f686406d000 2024-09-17T05:23:08.016 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.013+0000 7f6860ff9640 1 -- 172.21.15.98:0/2530464900 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f684c012d90 con 0x7f686406d000 2024-09-17T05:23:08.016 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.013+0000 7f6869d24640 1 -- 172.21.15.98:0/2530464900 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68640aa1e0 con 0x7f686406d000 2024-09-17T05:23:08.017 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.015+0000 7f6869d24640 1 -- 172.21.15.98:0/2530464900 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68640d0060 con 0x7f686406d000 2024-09-17T05:23:08.017 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.015+0000 7f6860ff9640 1 -- 172.21.15.98:0/2530464900 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 6) ==== 101594+0+0 (secure 0 0 0) 0x7f684c019020 con 0x7f686406d000 2024-09-17T05:23:08.017 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.016+0000 7f6860ff9640 1 --2- 172.21.15.98:0/2530464900 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f6844078d40 0x7f684407b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:08.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.016+0000 7f6860ff9640 1 -- 172.21.15.98:0/2530464900 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f684c09a7e0 con 0x7f686406d000 2024-09-17T05:23:08.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.016+0000 7f68637fe640 1 --2- 172.21.15.98:0/2530464900 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f6844078d40 0x7f684407b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:08.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.016+0000 7f68637fe640 1 --2- 172.21.15.98:0/2530464900 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f6844078d40 0x7f684407b200 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6854007fd0 tx=0x7f6854009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:08.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.020+0000 7f6860ff9640 1 -- 172.21.15.98:0/2530464900 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f684c020070 con 0x7f686406d000 2024-09-17T05:23:08.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.195+0000 7f6869d24640 1 -- 172.21.15.98:0/2530464900 --> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f686413f470 con 0x7f6844078d40 2024-09-17T05:23:08.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.196+0000 7f6860ff9640 1 -- 172.21.15.98:0/2530464900 <== mgr.4103 v2:172.21.15.167:6800/610796449 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6854001c50 con 0x7f6844078d40 2024-09-17T05:23:08.197 INFO:teuthology.orchestra.run.smithi098.stderr:instructed osd(s) 6 to deep-scrub 2024-09-17T05:23:08.199 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.198+0000 7f6869d24640 1 -- 172.21.15.98:0/2530464900 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f6844078d40 msgr2=0x7f684407b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:08.199 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.198+0000 7f6869d24640 1 --2- 172.21.15.98:0/2530464900 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f6844078d40 0x7f684407b200 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6854007fd0 tx=0x7f6854009040 comp rx=0 tx=0).stop 2024-09-17T05:23:08.199 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.198+0000 7f6869d24640 1 -- 172.21.15.98:0/2530464900 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f686406d000 msgr2=0x7f68640a9460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:08.200 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.198+0000 7f6869d24640 1 --2- 172.21.15.98:0/2530464900 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f686406d000 0x7f68640a9460 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f684c00c490 tx=0x7f684c00c950 comp rx=0 tx=0).stop 2024-09-17T05:23:08.200 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.198+0000 7f6869d24640 1 -- 172.21.15.98:0/2530464900 shutdown_connections 2024-09-17T05:23:08.200 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.198+0000 7f6869d24640 1 --2- 172.21.15.98:0/2530464900 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f6844078d40 0x7f684407b200 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:08.200 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.198+0000 7f6869d24640 1 --2- 172.21.15.98:0/2530464900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f686413efa0 0x7f68640b11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:08.200 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.198+0000 7f6869d24640 1 --2- 172.21.15.98:0/2530464900 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f686406d000 0x7f68640a9460 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:08.200 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.198+0000 7f6869d24640 1 --2- 172.21.15.98:0/2530464900 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f686406cb70 0x7f686413dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:08.200 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.198+0000 7f6869d24640 1 -- 172.21.15.98:0/2530464900 >> 172.21.15.98:0/2530464900 conn(0x7f68640b2230 msgr2=0x7f68640b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:08.200 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.198+0000 7f6869d24640 1 -- 172.21.15.98:0/2530464900 shutdown_connections 2024-09-17T05:23:08.200 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.198+0000 7f6869d24640 1 -- 172.21.15.98:0/2530464900 wait complete. 2024-09-17T05:23:08.210 INFO:tasks.ceph:Scrubbing osd.7 2024-09-17T05:23:08.210 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-17T05:23:08.316 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.315+0000 7fcf2d1d3640 1 -- 172.21.15.98:0/363030645 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf280cce30 msgr2=0x7fcf2815c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:08.316 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.315+0000 7fcf2d1d3640 1 --2- 172.21.15.98:0/363030645 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf280cce30 0x7fcf2815c210 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fcf20005fd0 tx=0x7fcf2002aa10 comp rx=0 tx=0).stop 2024-09-17T05:23:08.316 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.315+0000 7fcf2d1d3640 1 -- 172.21.15.98:0/363030645 shutdown_connections 2024-09-17T05:23:08.316 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.315+0000 7fcf2d1d3640 1 --2- 172.21.15.98:0/363030645 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf280cce30 0x7fcf2815c210 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:08.316 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.315+0000 7fcf2d1d3640 1 --2- 172.21.15.98:0/363030645 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcf28070a50 0x7fcf28160280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:08.316 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.315+0000 7fcf2d1d3640 1 -- 172.21.15.98:0/363030645 >> 172.21.15.98:0/363030645 conn(0x7fcf2806cb70 msgr2=0x7fcf2806cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:08.316 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.315+0000 7fcf2d1d3640 1 -- 172.21.15.98:0/363030645 shutdown_connections 2024-09-17T05:23:08.316 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.315+0000 7fcf2d1d3640 1 -- 172.21.15.98:0/363030645 wait complete. 2024-09-17T05:23:08.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.316+0000 7fcf2d1d3640 1 Processor -- start 2024-09-17T05:23:08.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.316+0000 7fcf2d1d3640 1 -- start start 2024-09-17T05:23:08.319 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.317+0000 7fcf2d1d3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf28070a50 0x7fcf28142690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:08.319 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.317+0000 7fcf2d1d3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf280cce30 0x7fcf2815e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:08.319 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.317+0000 7fcf2d1d3640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcf28156460 0x7fcf2815b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:08.319 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.317+0000 7fcf2d1d3640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fcf2815cb90 con 0x7fcf280cce30 2024-09-17T05:23:08.319 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.317+0000 7fcf2d1d3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fcf2815ca10 con 0x7fcf28070a50 2024-09-17T05:23:08.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.317+0000 7fcf2d1d3640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fcf2815cd10 con 0x7fcf28156460 2024-09-17T05:23:08.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.317+0000 7fcf1ffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf280cce30 0x7fcf2815e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:08.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.317+0000 7fcf1ffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf280cce30 0x7fcf2815e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45450/0 (socket says 172.21.15.98:45450) 2024-09-17T05:23:08.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.317+0000 7fcf1ffff640 1 -- 172.21.15.98:0/1988231648 learned_addr learned my addr 172.21.15.98:0/1988231648 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:23:08.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.317+0000 7fcf26d9d640 1 --2- 172.21.15.98:0/1988231648 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf28070a50 0x7fcf28142690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:08.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.317+0000 7fcf2759e640 1 --2- 172.21.15.98:0/1988231648 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcf28156460 0x7fcf2815b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:08.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.317+0000 7fcf1ffff640 1 -- 172.21.15.98:0/1988231648 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcf28156460 msgr2=0x7fcf2815b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:08.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.317+0000 7fcf1ffff640 1 --2- 172.21.15.98:0/1988231648 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcf28156460 0x7fcf2815b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:08.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.317+0000 7fcf1ffff640 1 -- 172.21.15.98:0/1988231648 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf28070a50 msgr2=0x7fcf28142690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:08.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.317+0000 7fcf1ffff640 1 --2- 172.21.15.98:0/1988231648 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf28070a50 0x7fcf28142690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:08.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.317+0000 7fcf1ffff640 1 -- 172.21.15.98:0/1988231648 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf2815ed50 con 0x7fcf280cce30 2024-09-17T05:23:08.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.317+0000 7fcf26d9d640 1 --2- 172.21.15.98:0/1988231648 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf28070a50 0x7fcf28142690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:23:08.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.317+0000 7fcf2759e640 1 --2- 172.21.15.98:0/1988231648 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcf28156460 0x7fcf2815b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:23:08.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.318+0000 7fcf1ffff640 1 --2- 172.21.15.98:0/1988231648 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf280cce30 0x7fcf2815e490 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fcf1000d980 tx=0x7fcf1000de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:08.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.318+0000 7fcf1f7fe640 1 -- 172.21.15.98:0/1988231648 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf10017070 con 0x7fcf280cce30 2024-09-17T05:23:08.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.318+0000 7fcf1f7fe640 1 -- 172.21.15.98:0/1988231648 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcf10009d20 con 0x7fcf280cce30 2024-09-17T05:23:08.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.318+0000 7fcf2d1d3640 1 -- 172.21.15.98:0/1988231648 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf2815f030 con 0x7fcf280cce30 2024-09-17T05:23:08.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.318+0000 7fcf1f7fe640 1 -- 172.21.15.98:0/1988231648 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf100106c0 con 0x7fcf280cce30 2024-09-17T05:23:08.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.318+0000 7fcf2d1d3640 1 -- 172.21.15.98:0/1988231648 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf28142bd0 con 0x7fcf280cce30 2024-09-17T05:23:08.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.318+0000 7fcf2d1d3640 1 -- 172.21.15.98:0/1988231648 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcf28142260 con 0x7fcf280cce30 2024-09-17T05:23:08.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.319+0000 7fcf1f7fe640 1 -- 172.21.15.98:0/1988231648 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 6) ==== 101594+0+0 (secure 0 0 0) 0x7fcf10010860 con 0x7fcf280cce30 2024-09-17T05:23:08.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.320+0000 7fcf1f7fe640 1 --2- 172.21.15.98:0/1988231648 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fcf08078d40 0x7fcf0807b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:08.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.320+0000 7fcf1f7fe640 1 -- 172.21.15.98:0/1988231648 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fcf1009b210 con 0x7fcf280cce30 2024-09-17T05:23:08.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.320+0000 7fcf1f7fe640 1 --2- 172.21.15.98:0/1988231648 >> [v2:172.21.15.167:6826/4169560909,v1:172.21.15.167:6827/4169560909] conn(0x7fcf0807ec00 0x7fcf08081020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:08.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.320+0000 7fcf1f7fe640 1 -- 172.21.15.98:0/1988231648 --> [v2:172.21.15.167:6826/4169560909,v1:172.21.15.167:6827/4169560909] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcf080816d0 con 0x7fcf0807ec00 2024-09-17T05:23:08.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.320+0000 7fcf1f7fe640 1 -- 172.21.15.98:0/1988231648 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fcf100a2050 con 0x7fcf280cce30 2024-09-17T05:23:08.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.320+0000 7fcf26d9d640 1 --2- 172.21.15.98:0/1988231648 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fcf08078d40 0x7fcf0807b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:08.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.320+0000 7fcf2759e640 1 --2- 172.21.15.98:0/1988231648 >> [v2:172.21.15.167:6826/4169560909,v1:172.21.15.167:6827/4169560909] conn(0x7fcf0807ec00 0x7fcf08081020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:08.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.320+0000 7fcf26d9d640 1 --2- 172.21.15.98:0/1988231648 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fcf08078d40 0x7fcf0807b200 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fcf28146370 tx=0x7fcf18009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:08.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.321+0000 7fcf2759e640 1 --2- 172.21.15.98:0/1988231648 >> [v2:172.21.15.167:6826/4169560909,v1:172.21.15.167:6827/4169560909] conn(0x7fcf0807ec00 0x7fcf08081020 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:08.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.321+0000 7fcf1f7fe640 1 -- 172.21.15.98:0/1988231648 <== osd.7 v2:172.21.15.167:6826/4169560909 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcf080816d0 con 0x7fcf0807ec00 2024-09-17T05:23:08.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.333+0000 7fcf2d1d3640 1 -- 172.21.15.98:0/1988231648 --> [v2:172.21.15.167:6826/4169560909,v1:172.21.15.167:6827/4169560909] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fcf2815d230 con 0x7fcf0807ec00 2024-09-17T05:23:08.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.334+0000 7fcf1f7fe640 1 -- 172.21.15.98:0/1988231648 <== osd.7 v2:172.21.15.167:6826/4169560909 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fcf2815d230 con 0x7fcf0807ec00 2024-09-17T05:23:08.335 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T05:23:08.335 INFO:teuthology.orchestra.run.smithi098.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T05:23:08.335 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T05:23:08.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.334+0000 7fcf2d1d3640 1 -- 172.21.15.98:0/1988231648 >> [v2:172.21.15.167:6826/4169560909,v1:172.21.15.167:6827/4169560909] conn(0x7fcf0807ec00 msgr2=0x7fcf08081020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:08.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.334+0000 7fcf2d1d3640 1 --2- 172.21.15.98:0/1988231648 >> [v2:172.21.15.167:6826/4169560909,v1:172.21.15.167:6827/4169560909] conn(0x7fcf0807ec00 0x7fcf08081020 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:08.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.334+0000 7fcf2d1d3640 1 -- 172.21.15.98:0/1988231648 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fcf08078d40 msgr2=0x7fcf0807b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:08.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.334+0000 7fcf2d1d3640 1 --2- 172.21.15.98:0/1988231648 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fcf08078d40 0x7fcf0807b200 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fcf28146370 tx=0x7fcf18009040 comp rx=0 tx=0).stop 2024-09-17T05:23:08.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.334+0000 7fcf2d1d3640 1 -- 172.21.15.98:0/1988231648 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf280cce30 msgr2=0x7fcf2815e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:08.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.334+0000 7fcf2d1d3640 1 --2- 172.21.15.98:0/1988231648 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf280cce30 0x7fcf2815e490 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fcf1000d980 tx=0x7fcf1000de40 comp rx=0 tx=0).stop 2024-09-17T05:23:08.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.334+0000 7fcf2759e640 1 -- 172.21.15.98:0/1988231648 reap_dead start 2024-09-17T05:23:08.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.335+0000 7fcf2d1d3640 1 -- 172.21.15.98:0/1988231648 shutdown_connections 2024-09-17T05:23:08.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.335+0000 7fcf2d1d3640 1 -- 172.21.15.98:0/1988231648 >> 172.21.15.98:0/1988231648 conn(0x7fcf2806cb70 msgr2=0x7fcf281541b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:08.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.335+0000 7fcf2d1d3640 1 -- 172.21.15.98:0/1988231648 shutdown_connections 2024-09-17T05:23:08.338 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.335+0000 7fcf2d1d3640 1 -- 172.21.15.98:0/1988231648 wait complete. 2024-09-17T05:23:08.345 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-17T05:23:08.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.448+0000 7f008e910640 1 -- 172.21.15.98:0/3083182520 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0070004800 msgr2=0x7f0070004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:08.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.448+0000 7f008e910640 1 --2- 172.21.15.98:0/3083182520 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0070004800 0x7f0070004c80 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f007c00c470 tx=0x7f0070005830 comp rx=0 tx=0).stop 2024-09-17T05:23:08.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.448+0000 7f008cead640 1 -- 172.21.15.98:0/3083182520 reap_dead start 2024-09-17T05:23:08.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.448+0000 7f008e910640 1 -- 172.21.15.98:0/3083182520 shutdown_connections 2024-09-17T05:23:08.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.448+0000 7f008e910640 1 -- 172.21.15.98:0/3083182520 >> 172.21.15.98:0/3083182520 conn(0x7f00880b1950 msgr2=0x7f00880b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:08.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.448+0000 7f008e910640 1 -- 172.21.15.98:0/3083182520 shutdown_connections 2024-09-17T05:23:08.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.448+0000 7f008e910640 1 -- 172.21.15.98:0/3083182520 wait complete. 2024-09-17T05:23:08.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.449+0000 7f008e910640 1 Processor -- start 2024-09-17T05:23:08.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.450+0000 7f008e910640 1 -- start start 2024-09-17T05:23:08.453 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.450+0000 7f008e910640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0070004800 0x7f00881f8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:08.453 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.450+0000 7f008e910640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00881f81f0 0x7f0088153e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:08.453 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.450+0000 7f008e910640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0088151e50 0x7f00881522d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:08.453 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.450+0000 7f008e910640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f00880746a0 con 0x7f0070004800 2024-09-17T05:23:08.453 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.450+0000 7f008e910640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f008815dd20 con 0x7f0088151e50 2024-09-17T05:23:08.453 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.450+0000 7f008e910640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f0088074820 con 0x7f00881f81f0 2024-09-17T05:23:08.453 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.450+0000 7f0087fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0070004800 0x7f00881f8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:08.453 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.450+0000 7f0087fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0070004800 0x7f00881f8b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45470/0 (socket says 172.21.15.98:45470) 2024-09-17T05:23:08.453 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.450+0000 7f0087fff640 1 -- 172.21.15.98:0/2408311051 learned_addr learned my addr 172.21.15.98:0/2408311051 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:23:08.453 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.450+0000 7f00877fe640 1 --2- 172.21.15.98:0/2408311051 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00881f81f0 0x7f0088153e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:08.453 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.451+0000 7f008cead640 1 --2- 172.21.15.98:0/2408311051 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0088151e50 0x7f00881522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:08.453 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.451+0000 7f0087fff640 1 -- 172.21.15.98:0/2408311051 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00881f81f0 msgr2=0x7f0088153e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:08.454 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.451+0000 7f0087fff640 1 --2- 172.21.15.98:0/2408311051 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00881f81f0 0x7f0088153e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:08.454 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.451+0000 7f0087fff640 1 -- 172.21.15.98:0/2408311051 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0088151e50 msgr2=0x7f00881522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:08.454 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.451+0000 7f0087fff640 1 --2- 172.21.15.98:0/2408311051 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0088151e50 0x7f00881522d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:08.454 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.451+0000 7f0087fff640 1 -- 172.21.15.98:0/2408311051 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00881f90b0 con 0x7f0070004800 2024-09-17T05:23:08.454 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.451+0000 7f008cead640 1 --2- 172.21.15.98:0/2408311051 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0088151e50 0x7f00881522d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:23:08.454 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.451+0000 7f00877fe640 1 --2- 172.21.15.98:0/2408311051 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00881f81f0 0x7f0088153e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:23:08.454 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.451+0000 7f0087fff640 1 --2- 172.21.15.98:0/2408311051 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0070004800 0x7f00881f8b70 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f007800ea40 tx=0x7f007800ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:08.454 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.451+0000 7f0084ff9640 1 -- 172.21.15.98:0/2408311051 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f007801d070 con 0x7f0070004800 2024-09-17T05:23:08.454 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.451+0000 7f0084ff9640 1 -- 172.21.15.98:0/2408311051 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f007800dc90 con 0x7f0070004800 2024-09-17T05:23:08.454 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.451+0000 7f008e910640 1 -- 172.21.15.98:0/2408311051 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00881547b0 con 0x7f0070004800 2024-09-17T05:23:08.454 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.451+0000 7f0084ff9640 1 -- 172.21.15.98:0/2408311051 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0078018670 con 0x7f0070004800 2024-09-17T05:23:08.454 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.451+0000 7f008e910640 1 -- 172.21.15.98:0/2408311051 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0088154d70 con 0x7f0070004800 2024-09-17T05:23:08.455 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.452+0000 7f008e910640 1 -- 172.21.15.98:0/2408311051 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00880b47d0 con 0x7f0070004800 2024-09-17T05:23:08.455 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.453+0000 7f0084ff9640 1 -- 172.21.15.98:0/2408311051 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 6) ==== 101594+0+0 (secure 0 0 0) 0x7f0078020070 con 0x7f0070004800 2024-09-17T05:23:08.455 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.453+0000 7f0084ff9640 1 --2- 172.21.15.98:0/2408311051 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f0074078d40 0x7f007407b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:08.455 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.453+0000 7f0084ff9640 1 -- 172.21.15.98:0/2408311051 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f007809b320 con 0x7f0070004800 2024-09-17T05:23:08.456 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.453+0000 7f00877fe640 1 --2- 172.21.15.98:0/2408311051 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f0074078d40 0x7f007407b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:08.456 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.454+0000 7f00877fe640 1 --2- 172.21.15.98:0/2408311051 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f0074078d40 0x7f007407b200 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f007c033000 tx=0x7f007c02d070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:08.458 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.458+0000 7f0084ff9640 1 -- 172.21.15.98:0/2408311051 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f00881f90b0 con 0x7f0070004800 2024-09-17T05:23:08.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.633+0000 7f008e910640 1 -- 172.21.15.98:0/2408311051 --> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f00880cd490 con 0x7f0074078d40 2024-09-17T05:23:08.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.634+0000 7f0084ff9640 1 -- 172.21.15.98:0/2408311051 <== mgr.4103 v2:172.21.15.167:6800/610796449 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f00880cd490 con 0x7f0074078d40 2024-09-17T05:23:08.635 INFO:teuthology.orchestra.run.smithi098.stderr:instructed osd(s) 7 to deep-scrub 2024-09-17T05:23:08.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.636+0000 7f008e910640 1 -- 172.21.15.98:0/2408311051 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f0074078d40 msgr2=0x7f007407b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:08.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.636+0000 7f008e910640 1 --2- 172.21.15.98:0/2408311051 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f0074078d40 0x7f007407b200 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f007c033000 tx=0x7f007c02d070 comp rx=0 tx=0).stop 2024-09-17T05:23:08.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.636+0000 7f008e910640 1 -- 172.21.15.98:0/2408311051 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0070004800 msgr2=0x7f00881f8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:08.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.636+0000 7f008e910640 1 --2- 172.21.15.98:0/2408311051 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0070004800 0x7f00881f8b70 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f007800ea40 tx=0x7f007800ef00 comp rx=0 tx=0).stop 2024-09-17T05:23:08.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.636+0000 7f008e910640 1 -- 172.21.15.98:0/2408311051 shutdown_connections 2024-09-17T05:23:08.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.636+0000 7f008e910640 1 --2- 172.21.15.98:0/2408311051 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f0074078d40 0x7f007407b200 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:08.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.636+0000 7f008e910640 1 --2- 172.21.15.98:0/2408311051 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0088151e50 0x7f00881522d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:08.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.636+0000 7f008e910640 1 --2- 172.21.15.98:0/2408311051 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00881f81f0 0x7f0088153e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:08.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.636+0000 7f008e910640 1 --2- 172.21.15.98:0/2408311051 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0070004800 0x7f00881f8b70 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:08.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.636+0000 7f008e910640 1 -- 172.21.15.98:0/2408311051 >> 172.21.15.98:0/2408311051 conn(0x7f00880b1950 msgr2=0x7f00881e6850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:08.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.636+0000 7f008e910640 1 -- 172.21.15.98:0/2408311051 shutdown_connections 2024-09-17T05:23:08.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.636+0000 7f008e910640 1 -- 172.21.15.98:0/2408311051 wait complete. 2024-09-17T05:23:08.649 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:23:08.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.749+0000 7f59b4b6c640 1 -- 172.21.15.98:0/1319296923 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f599c003c60 msgr2=0x7f599c004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:08.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.749+0000 7f59b4b6c640 1 --2- 172.21.15.98:0/1319296923 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f599c003c60 0x7f599c004060 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f59a0009b50 tx=0x7f599c005830 comp rx=0 tx=0).stop 2024-09-17T05:23:08.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.749+0000 7f59aed9d640 1 -- 172.21.15.98:0/1319296923 reap_dead start 2024-09-17T05:23:08.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.749+0000 7f59b4b6c640 1 -- 172.21.15.98:0/1319296923 shutdown_connections 2024-09-17T05:23:08.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.749+0000 7f59b4b6c640 1 -- 172.21.15.98:0/1319296923 >> 172.21.15.98:0/1319296923 conn(0x7f59b00b1950 msgr2=0x7f59b00b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:08.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.749+0000 7f59b4b6c640 1 -- 172.21.15.98:0/1319296923 shutdown_connections 2024-09-17T05:23:08.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.749+0000 7f59b4b6c640 1 -- 172.21.15.98:0/1319296923 wait complete. 2024-09-17T05:23:08.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.751+0000 7f59b4b6c640 1 Processor -- start 2024-09-17T05:23:08.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.751+0000 7f59b4b6c640 1 -- start start 2024-09-17T05:23:08.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.751+0000 7f59b4b6c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f599c003c60 0x7f59b015c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:08.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.751+0000 7f59b4b6c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59b0155900 0x7f59b0146660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:08.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.751+0000 7f59b4b6c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f59b0156e80 0x7f59b0157be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:08.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.751+0000 7f59b4b6c640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f59b006ef30 con 0x7f59b0156e80 2024-09-17T05:23:08.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.751+0000 7f59b4b6c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f59b006fa80 con 0x7f59b0155900 2024-09-17T05:23:08.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.751+0000 7f59b4b6c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f59b00b2440 con 0x7f599c003c60 2024-09-17T05:23:08.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.752+0000 7f59aed9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f59b0156e80 0x7f59b0157be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:08.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.752+0000 7f59aed9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f59b0156e80 0x7f59b0157be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45476/0 (socket says 172.21.15.98:45476) 2024-09-17T05:23:08.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.752+0000 7f59aed9d640 1 -- 172.21.15.98:0/847791390 learned_addr learned my addr 172.21.15.98:0/847791390 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:23:08.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.752+0000 7f59ae59c640 1 --2- 172.21.15.98:0/847791390 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f599c003c60 0x7f59b015c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:08.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.752+0000 7f59a5d9b640 1 --2- 172.21.15.98:0/847791390 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59b0155900 0x7f59b0146660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:08.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.752+0000 7f59aed9d640 1 -- 172.21.15.98:0/847791390 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f599c003c60 msgr2=0x7f59b015c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:08.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.752+0000 7f59aed9d640 1 --2- 172.21.15.98:0/847791390 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f599c003c60 0x7f59b015c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:08.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.752+0000 7f59aed9d640 1 -- 172.21.15.98:0/847791390 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59b0155900 msgr2=0x7f59b0146660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:08.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.752+0000 7f59aed9d640 1 --2- 172.21.15.98:0/847791390 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59b0155900 0x7f59b0146660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:08.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.752+0000 7f59aed9d640 1 -- 172.21.15.98:0/847791390 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59b0151d70 con 0x7f59b0156e80 2024-09-17T05:23:08.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.752+0000 7f59aed9d640 1 --2- 172.21.15.98:0/847791390 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f59b0156e80 0x7f59b0157be0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f59b00b5080 tx=0x7f59a8006420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:08.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.752+0000 7f59a77fe640 1 -- 172.21.15.98:0/847791390 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59a80105d0 con 0x7f59b0156e80 2024-09-17T05:23:08.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.752+0000 7f59a77fe640 1 -- 172.21.15.98:0/847791390 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f59a80108a0 con 0x7f59b0156e80 2024-09-17T05:23:08.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.752+0000 7f59a77fe640 1 -- 172.21.15.98:0/847791390 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59a8010d30 con 0x7f59b0156e80 2024-09-17T05:23:08.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.752+0000 7f59b4b6c640 1 -- 172.21.15.98:0/847791390 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59b0146ba0 con 0x7f59b0156e80 2024-09-17T05:23:08.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.752+0000 7f59b4b6c640 1 -- 172.21.15.98:0/847791390 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59b01560c0 con 0x7f59b0156e80 2024-09-17T05:23:08.756 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.753+0000 7f59b4b6c640 1 -- 172.21.15.98:0/847791390 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59b0074460 con 0x7f59b0156e80 2024-09-17T05:23:08.756 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.754+0000 7f59a77fe640 1 -- 172.21.15.98:0/847791390 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 6) ==== 101594+0+0 (secure 0 0 0) 0x7f59a8018020 con 0x7f59b0156e80 2024-09-17T05:23:08.756 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.754+0000 7f59a77fe640 1 --2- 172.21.15.98:0/847791390 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f5990078d40 0x7f599007b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:08.756 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.754+0000 7f59a77fe640 1 -- 172.21.15.98:0/847791390 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f59a809af20 con 0x7f59b0156e80 2024-09-17T05:23:08.756 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.755+0000 7f59ae59c640 1 --2- 172.21.15.98:0/847791390 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f5990078d40 0x7f599007b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:08.756 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.755+0000 7f59ae59c640 1 --2- 172.21.15.98:0/847791390 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f5990078d40 0x7f599007b200 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f59a0035000 tx=0x7f59a002d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:08.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.759+0000 7f59a77fe640 1 -- 172.21.15.98:0/847791390 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f59b0146ba0 con 0x7f59b0156e80 2024-09-17T05:23:08.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.929+0000 7f59b4b6c640 1 -- 172.21.15.98:0/847791390 --> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f59b015cc80 con 0x7f5990078d40 2024-09-17T05:23:08.931 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.930+0000 7f59a77fe640 1 -- 172.21.15.98:0/847791390 <== mgr.4103 v2:172.21.15.167:6800/610796449 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13385 (secure 0 0 0) 0x7f59a002b920 con 0x7f5990078d40 2024-09-17T05:23:08.931 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:23:08.932 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-17T05:23:08.933 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.932+0000 7f59b4b6c640 1 -- 172.21.15.98:0/847791390 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f5990078d40 msgr2=0x7f599007b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:08.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.932+0000 7f59b4b6c640 1 --2- 172.21.15.98:0/847791390 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f5990078d40 0x7f599007b200 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f59a0035000 tx=0x7f59a002d040 comp rx=0 tx=0).stop 2024-09-17T05:23:08.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.932+0000 7f59b4b6c640 1 -- 172.21.15.98:0/847791390 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f59b0156e80 msgr2=0x7f59b0157be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:08.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.932+0000 7f59b4b6c640 1 --2- 172.21.15.98:0/847791390 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f59b0156e80 0x7f59b0157be0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f59b00b5080 tx=0x7f59a8006420 comp rx=0 tx=0).stop 2024-09-17T05:23:08.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.932+0000 7f59b4b6c640 1 -- 172.21.15.98:0/847791390 shutdown_connections 2024-09-17T05:23:08.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.932+0000 7f59b4b6c640 1 --2- 172.21.15.98:0/847791390 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f5990078d40 0x7f599007b200 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:08.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.932+0000 7f59b4b6c640 1 --2- 172.21.15.98:0/847791390 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f59b0156e80 0x7f59b0157be0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:08.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.932+0000 7f59b4b6c640 1 --2- 172.21.15.98:0/847791390 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59b0155900 0x7f59b0146660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:08.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.932+0000 7f59b4b6c640 1 --2- 172.21.15.98:0/847791390 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f599c003c60 0x7f59b015c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:08.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.932+0000 7f59b4b6c640 1 -- 172.21.15.98:0/847791390 >> 172.21.15.98:0/847791390 conn(0x7f59b00b1950 msgr2=0x7f59b00ae600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:08.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.932+0000 7f59b4b6c640 1 -- 172.21.15.98:0/847791390 shutdown_connections 2024-09-17T05:23:08.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:08.933+0000 7f59b4b6c640 1 -- 172.21.15.98:0/847791390 wait complete. 2024-09-17T05:23:08.944 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":72,"stamp":"2024-09-17T05:23:08.263690+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":224672,"kb_used_data":4264,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750048,"statfs":{"total":773094113280,"available":772864049152,"internally_reserved":0,"allocated":4366336,"data_stored":2414512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-6,"num_write_kb":-3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001869"},"pg_stats":[{"pgid":"1.0","version":"16'72","reported_seq":137,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.382087+0000","last_change":"2024-09-17T05:21:44.086098+0000","last_active":"2024-09-17T05:22:58.382087+0000","last_peered":"2024-09-17T05:22:58.382087+0000","last_clean":"2024-09-17T05:22:58.382087+0000","last_became_active":"2024-09-17T05:21:44.083477+0000","last_became_peered":"2024-09-17T05:21:44.083477+0000","last_unstale":"2024-09-17T05:22:58.382087+0000","last_undegraded":"2024-09-17T05:22:58.382087+0000","last_fullsized":"2024-09-17T05:22:58.382087+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:42.925756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:42.925756+0000","last_clean_scrub_stamp":"2024-09-17T05:21:42.925756+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:11.410250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509461,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27424,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":397312,"data_stored":154222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509461,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27420,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":397312,"data_stored":154222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509461,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":991232,"data_stored":744590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542164,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":991232,"data_stored":744590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542164,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27420,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":397312,"data_stored":154222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542165,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27416,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":397312,"data_stored":154222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542165,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27420,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":397312,"data_stored":154222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31576,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":397312,"data_stored":154222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:23:08.948 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-17T05:21:42.925756+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=5, tm_min=21, tm_sec=42, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=5, tm_min=23, tm_sec=3, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T05:23:08.948 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-17T05:23:22.125 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:23:22.129 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:23:28.949 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:23:29.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.061+0000 7fb3e8391640 1 -- 172.21.15.98:0/4252901930 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3e00ccfd0 msgr2=0x7fb3e00730b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:29.063 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.061+0000 7fb3e8391640 1 --2- 172.21.15.98:0/4252901930 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3e00ccfd0 0x7fb3e00730b0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fb3d0009860 tx=0x7fb3d002a5f0 comp rx=0 tx=0).stop 2024-09-17T05:23:29.063 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.062+0000 7fb3e8391640 1 -- 172.21.15.98:0/4252901930 shutdown_connections 2024-09-17T05:23:29.063 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.062+0000 7fb3e8391640 1 --2- 172.21.15.98:0/4252901930 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3e00ccfd0 0x7fb3e00730b0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:29.063 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.062+0000 7fb3e8391640 1 -- 172.21.15.98:0/4252901930 >> 172.21.15.98:0/4252901930 conn(0x7fb3e00b1950 msgr2=0x7fb3e00b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:29.063 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.062+0000 7fb3e8391640 1 -- 172.21.15.98:0/4252901930 shutdown_connections 2024-09-17T05:23:29.063 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.062+0000 7fb3e8391640 1 -- 172.21.15.98:0/4252901930 wait complete. 2024-09-17T05:23:29.064 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.063+0000 7fb3e8391640 1 Processor -- start 2024-09-17T05:23:29.064 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.063+0000 7fb3e8391640 1 -- start start 2024-09-17T05:23:29.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.064+0000 7fb3e8391640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3e00ccfd0 0x7fb3e009ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:29.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.064+0000 7fb3e8391640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3e00cf300 0x7fb3e01f5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:29.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.064+0000 7fb3e8391640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3e01445d0 0x7fb3e01f6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:29.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.064+0000 7fb3e8391640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e00735f0 con 0x7fb3e00cf300 2024-09-17T05:23:29.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.064+0000 7fb3e8391640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e00b4f60 con 0x7fb3e01445d0 2024-09-17T05:23:29.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.064+0000 7fb3e8391640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fb3e0073770 con 0x7fb3e00ccfd0 2024-09-17T05:23:29.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.064+0000 7fb3e592c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3e00cf300 0x7fb3e01f5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:29.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.064+0000 7fb3e592c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3e00cf300 0x7fb3e01f5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33586/0 (socket says 172.21.15.98:33586) 2024-09-17T05:23:29.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.064+0000 7fb3e592c640 1 -- 172.21.15.98:0/3224687273 learned_addr learned my addr 172.21.15.98:0/3224687273 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:23:29.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.064+0000 7fb3e692e640 1 --2- 172.21.15.98:0/3224687273 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3e01445d0 0x7fb3e01f6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:29.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.064+0000 7fb3e612d640 1 --2- 172.21.15.98:0/3224687273 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3e00ccfd0 0x7fb3e009ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:29.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.064+0000 7fb3e592c640 1 -- 172.21.15.98:0/3224687273 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3e00ccfd0 msgr2=0x7fb3e009ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:29.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.064+0000 7fb3e592c640 1 --2- 172.21.15.98:0/3224687273 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3e00ccfd0 0x7fb3e009ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:29.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.064+0000 7fb3e592c640 1 -- 172.21.15.98:0/3224687273 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3e01445d0 msgr2=0x7fb3e01f6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:29.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.064+0000 7fb3e592c640 1 --2- 172.21.15.98:0/3224687273 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3e01445d0 0x7fb3e01f6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:29.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.064+0000 7fb3e592c640 1 -- 172.21.15.98:0/3224687273 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3e0159fd0 con 0x7fb3e00cf300 2024-09-17T05:23:29.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.064+0000 7fb3e592c640 1 --2- 172.21.15.98:0/3224687273 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3e00cf300 0x7fb3e01f5e10 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fb3d400c870 tx=0x7fb3d400cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:29.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.064+0000 7fb3deffd640 1 -- 172.21.15.98:0/3224687273 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3d4003b70 con 0x7fb3e00cf300 2024-09-17T05:23:29.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.064+0000 7fb3deffd640 1 -- 172.21.15.98:0/3224687273 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb3d4003d10 con 0x7fb3e00cf300 2024-09-17T05:23:29.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.064+0000 7fb3e8391640 1 -- 172.21.15.98:0/3224687273 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3e01f6960 con 0x7fb3e00cf300 2024-09-17T05:23:29.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.064+0000 7fb3deffd640 1 -- 172.21.15.98:0/3224687273 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3d400aab0 con 0x7fb3e00cf300 2024-09-17T05:23:29.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.064+0000 7fb3e8391640 1 -- 172.21.15.98:0/3224687273 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3e015a290 con 0x7fb3e00cf300 2024-09-17T05:23:29.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.065+0000 7fb3e8391640 1 -- 172.21.15.98:0/3224687273 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3e0073c20 con 0x7fb3e00cf300 2024-09-17T05:23:29.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.066+0000 7fb3deffd640 1 -- 172.21.15.98:0/3224687273 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 6) ==== 101594+0+0 (secure 0 0 0) 0x7fb3d400ac50 con 0x7fb3e00cf300 2024-09-17T05:23:29.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.067+0000 7fb3deffd640 1 --2- 172.21.15.98:0/3224687273 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fb3cc078d40 0x7fb3cc07b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:29.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.067+0000 7fb3deffd640 1 -- 172.21.15.98:0/3224687273 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fb3d409ad10 con 0x7fb3e00cf300 2024-09-17T05:23:29.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.067+0000 7fb3e612d640 1 --2- 172.21.15.98:0/3224687273 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fb3cc078d40 0x7fb3cc07b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:29.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.068+0000 7fb3e612d640 1 --2- 172.21.15.98:0/3224687273 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fb3cc078d40 0x7fb3cc07b200 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb3d8000f60 tx=0x7fb3d8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:29.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.071+0000 7fb3deffd640 1 -- 172.21.15.98:0/3224687273 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fb3d4063160 con 0x7fb3e00cf300 2024-09-17T05:23:29.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.242+0000 7fb3e8391640 1 -- 172.21.15.98:0/3224687273 --> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb3e0070a20 con 0x7fb3cc078d40 2024-09-17T05:23:29.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.243+0000 7fb3deffd640 1 -- 172.21.15.98:0/3224687273 <== mgr.4103 v2:172.21.15.167:6800/610796449 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13339 (secure 0 0 0) 0x7fb3e0070a20 con 0x7fb3cc078d40 2024-09-17T05:23:29.244 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:23:29.244 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-17T05:23:29.246 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.245+0000 7fb3e8391640 1 -- 172.21.15.98:0/3224687273 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fb3cc078d40 msgr2=0x7fb3cc07b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:29.246 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.245+0000 7fb3e8391640 1 --2- 172.21.15.98:0/3224687273 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fb3cc078d40 0x7fb3cc07b200 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb3d8000f60 tx=0x7fb3d8009040 comp rx=0 tx=0).stop 2024-09-17T05:23:29.246 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.245+0000 7fb3e8391640 1 -- 172.21.15.98:0/3224687273 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3e00cf300 msgr2=0x7fb3e01f5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:29.246 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.245+0000 7fb3e8391640 1 --2- 172.21.15.98:0/3224687273 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3e00cf300 0x7fb3e01f5e10 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fb3d400c870 tx=0x7fb3d400cd30 comp rx=0 tx=0).stop 2024-09-17T05:23:29.246 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.245+0000 7fb3e8391640 1 -- 172.21.15.98:0/3224687273 shutdown_connections 2024-09-17T05:23:29.246 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.245+0000 7fb3e8391640 1 --2- 172.21.15.98:0/3224687273 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fb3cc078d40 0x7fb3cc07b200 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:29.246 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.245+0000 7fb3e8391640 1 --2- 172.21.15.98:0/3224687273 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3e01445d0 0x7fb3e01f6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:29.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.245+0000 7fb3e8391640 1 --2- 172.21.15.98:0/3224687273 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3e00cf300 0x7fb3e01f5e10 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:29.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.245+0000 7fb3e8391640 1 --2- 172.21.15.98:0/3224687273 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3e00ccfd0 0x7fb3e009ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:29.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.245+0000 7fb3e8391640 1 -- 172.21.15.98:0/3224687273 >> 172.21.15.98:0/3224687273 conn(0x7fb3e00b1950 msgr2=0x7fb3e00d0570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:29.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.245+0000 7fb3e8391640 1 -- 172.21.15.98:0/3224687273 shutdown_connections 2024-09-17T05:23:29.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.245+0000 7fb3e8391640 1 -- 172.21.15.98:0/3224687273 wait complete. 2024-09-17T05:23:29.256 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2024-09-17T05:23:28.267986+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":224660,"kb_used_data":4264,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750060,"statfs":{"total":773094113280,"available":772864061440,"internally_reserved":0,"allocated":4366336,"data_stored":2414512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002584"},"pg_stats":[{"pgid":"1.0","version":"35'74","reported_seq":147,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-17T05:23:09.179227+0000","last_change":"2024-09-17T05:23:09.179227+0000","last_active":"2024-09-17T05:23:09.179227+0000","last_peered":"2024-09-17T05:23:09.179227+0000","last_clean":"2024-09-17T05:23:09.179227+0000","last_became_active":"2024-09-17T05:21:44.083477+0000","last_became_peered":"2024-09-17T05:21:44.083477+0000","last_unstale":"2024-09-17T05:23:09.179227+0000","last_undegraded":"2024-09-17T05:23:09.179227+0000","last_fullsized":"2024-09-17T05:23:09.179227+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'74","last_scrub_stamp":"2024-09-17T05:23:09.179124+0000","last_deep_scrub":"35'74","last_deep_scrub_stamp":"2024-09-17T05:23:09.179124+0000","last_clean_scrub_stamp":"2024-09-17T05:23:09.179124+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:38:27.199569+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27424,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":397312,"data_stored":154222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27420,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":397312,"data_stored":154222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509465,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":991232,"data_stored":744590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542168,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":991232,"data_stored":744590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542168,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27420,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":397312,"data_stored":154222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542169,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27416,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":397312,"data_stored":154222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542169,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27420,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":397312,"data_stored":154222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31576,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":397312,"data_stored":154222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:23:29.257 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-17T05:23:29.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.358+0000 7fd4ea352640 1 -- 172.21.15.98:0/1121374198 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4e40cd490 msgr2=0x7fd4e40732c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:29.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.358+0000 7fd4ea352640 1 --2- 172.21.15.98:0/1121374198 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4e40cd490 0x7fd4e40732c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8009830 tx=0x7fd4d802a510 comp rx=0 tx=0).stop 2024-09-17T05:23:29.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.358+0000 7fd4ea352640 1 -- 172.21.15.98:0/1121374198 shutdown_connections 2024-09-17T05:23:29.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.358+0000 7fd4ea352640 1 --2- 172.21.15.98:0/1121374198 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4e40cd490 0x7fd4e40732c0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:29.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.358+0000 7fd4ea352640 1 --2- 172.21.15.98:0/1121374198 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd4e41517a0 0x7fd4e40cdad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:29.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.358+0000 7fd4ea352640 1 -- 172.21.15.98:0/1121374198 >> 172.21.15.98:0/1121374198 conn(0x7fd4e40b1840 msgr2=0x7fd4e40b1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:29.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.358+0000 7fd4ea352640 1 -- 172.21.15.98:0/1121374198 shutdown_connections 2024-09-17T05:23:29.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.358+0000 7fd4ea352640 1 -- 172.21.15.98:0/1121374198 wait complete. 2024-09-17T05:23:29.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.359+0000 7fd4ea352640 1 Processor -- start 2024-09-17T05:23:29.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.359+0000 7fd4ea352640 1 -- start start 2024-09-17T05:23:29.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.360+0000 7fd4ea352640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4e4073800 0x7fd4e415c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:29.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.360+0000 7fd4ea352640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd4e40cd490 0x7fd4e41565c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:29.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.360+0000 7fd4ea352640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4e41517a0 0x7fd4e41f8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:29.368 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.360+0000 7fd4ea352640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e40cc650 con 0x7fd4e41517a0 2024-09-17T05:23:29.368 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.360+0000 7fd4ea352640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e4073fc0 con 0x7fd4e4073800 2024-09-17T05:23:29.368 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.360+0000 7fd4ea352640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fd4e40cc7d0 con 0x7fd4e40cd490 2024-09-17T05:23:29.368 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.360+0000 7fd4e88ef640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4e41517a0 0x7fd4e41f8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:29.368 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.360+0000 7fd4e88ef640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4e41517a0 0x7fd4e41f8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33604/0 (socket says 172.21.15.98:33604) 2024-09-17T05:23:29.368 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.360+0000 7fd4e88ef640 1 -- 172.21.15.98:0/817201469 learned_addr learned my addr 172.21.15.98:0/817201469 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:23:29.369 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.360+0000 7fd4e37fe640 1 --2- 172.21.15.98:0/817201469 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd4e40cd490 0x7fd4e41565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:29.369 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.360+0000 7fd4e3fff640 1 --2- 172.21.15.98:0/817201469 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4e4073800 0x7fd4e415c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:29.369 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.360+0000 7fd4e88ef640 1 -- 172.21.15.98:0/817201469 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd4e40cd490 msgr2=0x7fd4e41565c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:29.369 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.360+0000 7fd4e88ef640 1 --2- 172.21.15.98:0/817201469 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd4e40cd490 0x7fd4e41565c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:29.369 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.360+0000 7fd4e88ef640 1 -- 172.21.15.98:0/817201469 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4e4073800 msgr2=0x7fd4e415c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:29.369 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.360+0000 7fd4e88ef640 1 --2- 172.21.15.98:0/817201469 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4e4073800 0x7fd4e415c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:29.370 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.360+0000 7fd4e88ef640 1 -- 172.21.15.98:0/817201469 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4e415b540 con 0x7fd4e41517a0 2024-09-17T05:23:29.370 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.360+0000 7fd4e3fff640 1 --2- 172.21.15.98:0/817201469 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4e4073800 0x7fd4e415c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:23:29.370 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.360+0000 7fd4e88ef640 1 --2- 172.21.15.98:0/817201469 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4e41517a0 0x7fd4e41f8090 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc00c770 tx=0x7fd4dc00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:29.370 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.361+0000 7fd4e0ff9640 1 -- 172.21.15.98:0/817201469 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc003da0 con 0x7fd4e41517a0 2024-09-17T05:23:29.370 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.361+0000 7fd4e0ff9640 1 -- 172.21.15.98:0/817201469 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd4dc005070 con 0x7fd4e41517a0 2024-09-17T05:23:29.370 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.361+0000 7fd4ea352640 1 -- 172.21.15.98:0/817201469 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4e415b820 con 0x7fd4e41517a0 2024-09-17T05:23:29.370 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.361+0000 7fd4e0ff9640 1 -- 172.21.15.98:0/817201469 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc0054c0 con 0x7fd4e41517a0 2024-09-17T05:23:29.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.361+0000 7fd4ea352640 1 -- 172.21.15.98:0/817201469 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4e415bde0 con 0x7fd4e41517a0 2024-09-17T05:23:29.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.362+0000 7fd4ea352640 1 -- 172.21.15.98:0/817201469 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4e40ccc80 con 0x7fd4e41517a0 2024-09-17T05:23:29.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.362+0000 7fd4e0ff9640 1 -- 172.21.15.98:0/817201469 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 6) ==== 101594+0+0 (secure 0 0 0) 0x7fd4dc005660 con 0x7fd4e41517a0 2024-09-17T05:23:29.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.363+0000 7fd4e0ff9640 1 --2- 172.21.15.98:0/817201469 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fd4d0078d40 0x7fd4d007b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:29.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.363+0000 7fd4e0ff9640 1 -- 172.21.15.98:0/817201469 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fd4dc09acc0 con 0x7fd4e41517a0 2024-09-17T05:23:29.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.363+0000 7fd4e3fff640 1 --2- 172.21.15.98:0/817201469 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fd4d0078d40 0x7fd4d007b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:29.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.363+0000 7fd4e3fff640 1 --2- 172.21.15.98:0/817201469 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fd4d0078d40 0x7fd4d007b200 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd4d400ab20 tx=0x7fd4d4005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:29.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.367+0000 7fd4e0ff9640 1 -- 172.21.15.98:0/817201469 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fd4dc0630e0 con 0x7fd4e41517a0 2024-09-17T05:23:29.545 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.544+0000 7fd4ea352640 1 -- 172.21.15.98:0/817201469 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fd4e40cd190 con 0x7fd4e41517a0 2024-09-17T05:23:29.548 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.548+0000 7fd4e0ff9640 1 -- 172.21.15.98:0/817201469 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v30)=0 v30) ==== 123+0+0 (secure 0 0 0) 0x7fd4dc0629e0 con 0x7fd4e41517a0 2024-09-17T05:23:29.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.548+0000 7fd4e0ff9640 1 -- 172.21.15.98:0/817201469 <== mon.0 v2:172.21.15.98:3300/0 8 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7fd4dc0624f0 con 0x7fd4e41517a0 2024-09-17T05:23:29.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.550+0000 7fd4ea352640 1 -- 172.21.15.98:0/817201469 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fd4d0078d40 msgr2=0x7fd4d007b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:29.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.550+0000 7fd4ea352640 1 --2- 172.21.15.98:0/817201469 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fd4d0078d40 0x7fd4d007b200 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd4d400ab20 tx=0x7fd4d4005f90 comp rx=0 tx=0).stop 2024-09-17T05:23:29.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.550+0000 7fd4ea352640 1 -- 172.21.15.98:0/817201469 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4e41517a0 msgr2=0x7fd4e41f8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:29.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.550+0000 7fd4ea352640 1 --2- 172.21.15.98:0/817201469 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4e41517a0 0x7fd4e41f8090 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc00c770 tx=0x7fd4dc00cc30 comp rx=0 tx=0).stop 2024-09-17T05:23:29.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.550+0000 7fd4ea352640 1 -- 172.21.15.98:0/817201469 shutdown_connections 2024-09-17T05:23:29.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.550+0000 7fd4ea352640 1 --2- 172.21.15.98:0/817201469 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7fd4d0078d40 0x7fd4d007b200 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:29.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.550+0000 7fd4ea352640 1 --2- 172.21.15.98:0/817201469 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4e41517a0 0x7fd4e41f8090 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:29.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.550+0000 7fd4ea352640 1 --2- 172.21.15.98:0/817201469 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd4e40cd490 0x7fd4e41565c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:29.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.550+0000 7fd4ea352640 1 --2- 172.21.15.98:0/817201469 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4e4073800 0x7fd4e415c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:29.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.550+0000 7fd4ea352640 1 -- 172.21.15.98:0/817201469 >> 172.21.15.98:0/817201469 conn(0x7fd4e40b1840 msgr2=0x7fd4e4159bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:29.554 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.550+0000 7fd4ea352640 1 -- 172.21.15.98:0/817201469 shutdown_connections 2024-09-17T05:23:29.555 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.550+0000 7fd4ea352640 1 -- 172.21.15.98:0/817201469 wait complete. 2024-09-17T05:23:29.562 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T05:23:29.563 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:23:29.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.662+0000 7f0a3ada0640 1 -- 172.21.15.98:0/475922777 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a34074150 msgr2=0x7f0a34072ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:29.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.662+0000 7f0a3ada0640 1 --2- 172.21.15.98:0/475922777 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a34074150 0x7f0a34072ba0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f0a24009860 tx=0x7f0a2402a420 comp rx=0 tx=0).stop 2024-09-17T05:23:29.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.662+0000 7f0a3ada0640 1 -- 172.21.15.98:0/475922777 shutdown_connections 2024-09-17T05:23:29.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.662+0000 7f0a3ada0640 1 --2- 172.21.15.98:0/475922777 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a34074150 0x7f0a34072ba0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:29.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.663+0000 7f0a3ada0640 1 -- 172.21.15.98:0/475922777 >> 172.21.15.98:0/475922777 conn(0x7f0a340b1950 msgr2=0x7f0a340b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:29.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.663+0000 7f0a3ada0640 1 -- 172.21.15.98:0/475922777 shutdown_connections 2024-09-17T05:23:29.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.663+0000 7f0a3ada0640 1 -- 172.21.15.98:0/475922777 wait complete. 2024-09-17T05:23:29.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.664+0000 7f0a3ada0640 1 Processor -- start 2024-09-17T05:23:29.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.664+0000 7f0a3ada0640 1 -- start start 2024-09-17T05:23:29.668 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.665+0000 7f0a3ada0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a34074150 0x7f0a34156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:29.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.665+0000 7f0a3ada0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a340746a0 0x7f0a340cc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:29.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.665+0000 7f0a3ada0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a340b43f0 0x7f0a340ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:29.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.665+0000 7f0a3ada0640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0a34073b80 con 0x7f0a340746a0 2024-09-17T05:23:29.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.665+0000 7f0a3ada0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0a34073a00 con 0x7f0a34074150 2024-09-17T05:23:29.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.665+0000 7f0a3ada0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f0a34073d00 con 0x7f0a340b43f0 2024-09-17T05:23:29.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.665+0000 7f0a2bfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a340746a0 0x7f0a340cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:29.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.665+0000 7f0a2bfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a340746a0 0x7f0a340cc680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33620/0 (socket says 172.21.15.98:33620) 2024-09-17T05:23:29.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.665+0000 7f0a2bfff640 1 -- 172.21.15.98:0/1549211920 learned_addr learned my addr 172.21.15.98:0/1549211920 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-17T05:23:29.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.665+0000 7f0a38b3c640 1 --2- 172.21.15.98:0/1549211920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a34074150 0x7f0a34156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:29.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.665+0000 7f0a2bfff640 1 -- 172.21.15.98:0/1549211920 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a340b43f0 msgr2=0x7f0a340ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:29.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.665+0000 7f0a3933d640 1 --2- 172.21.15.98:0/1549211920 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a340b43f0 0x7f0a340ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:29.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.665+0000 7f0a2bfff640 1 --2- 172.21.15.98:0/1549211920 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a340b43f0 0x7f0a340ccbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:29.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.665+0000 7f0a2bfff640 1 -- 172.21.15.98:0/1549211920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a34074150 msgr2=0x7f0a34156b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:29.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.665+0000 7f0a2bfff640 1 --2- 172.21.15.98:0/1549211920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a34074150 0x7f0a34156b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:29.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.665+0000 7f0a2bfff640 1 -- 172.21.15.98:0/1549211920 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a341f83c0 con 0x7f0a340746a0 2024-09-17T05:23:29.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.665+0000 7f0a38b3c640 1 --2- 172.21.15.98:0/1549211920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a34074150 0x7f0a34156b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:23:29.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.665+0000 7f0a3933d640 1 --2- 172.21.15.98:0/1549211920 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a340b43f0 0x7f0a340ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:23:29.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.665+0000 7f0a2bfff640 1 --2- 172.21.15.98:0/1549211920 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a340746a0 0x7f0a340cc680 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f0a2402aa10 tx=0x7f0a24005430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:29.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.665+0000 7f0a297fa640 1 -- 172.21.15.98:0/1549211920 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a24004460 con 0x7f0a340746a0 2024-09-17T05:23:29.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.665+0000 7f0a297fa640 1 -- 172.21.15.98:0/1549211920 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f0a24004730 con 0x7f0a340746a0 2024-09-17T05:23:29.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.665+0000 7f0a3ada0640 1 -- 172.21.15.98:0/1549211920 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a341f86a0 con 0x7f0a340746a0 2024-09-17T05:23:29.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.665+0000 7f0a297fa640 1 -- 172.21.15.98:0/1549211920 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a24004ba0 con 0x7f0a340746a0 2024-09-17T05:23:29.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.665+0000 7f0a3ada0640 1 -- 172.21.15.98:0/1549211920 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a341f8c60 con 0x7f0a340746a0 2024-09-17T05:23:29.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.666+0000 7f0a3ada0640 1 -- 172.21.15.98:0/1549211920 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a340b47d0 con 0x7f0a340746a0 2024-09-17T05:23:29.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.667+0000 7f0a297fa640 1 -- 172.21.15.98:0/1549211920 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 6) ==== 101594+0+0 (secure 0 0 0) 0x7f0a24039040 con 0x7f0a340746a0 2024-09-17T05:23:29.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.668+0000 7f0a297fa640 1 --2- 172.21.15.98:0/1549211920 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f0a20078d40 0x7f0a2007b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:29.672 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.668+0000 7f0a297fa640 1 -- 172.21.15.98:0/1549211920 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f0a240bc310 con 0x7f0a340746a0 2024-09-17T05:23:29.672 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.668+0000 7f0a38b3c640 1 --2- 172.21.15.98:0/1549211920 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f0a20078d40 0x7f0a2007b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:29.672 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.668+0000 7f0a38b3c640 1 --2- 172.21.15.98:0/1549211920 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f0a20078d40 0x7f0a2007b200 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0a3000a830 tx=0x7f0a30008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:29.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.672+0000 7f0a297fa640 1 -- 172.21.15.98:0/1549211920 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f0a24040030 con 0x7f0a340746a0 2024-09-17T05:23:29.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.882+0000 7f0a3ada0640 1 -- 172.21.15.98:0/1549211920 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0a340aed20 con 0x7f0a340746a0 2024-09-17T05:23:29.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.883+0000 7f0a297fa640 1 -- 172.21.15.98:0/1549211920 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+3914 (secure 0 0 0) 0x7f0a240847e0 con 0x7f0a340746a0 2024-09-17T05:23:29.884 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T05:23:29.884 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":17,"btime":"2024-09-17T05:22:56:362526+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4745,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/4284711846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":4284711846},{"type":"v1","addr":"172.21.15.167:6837","nonce":4284711846}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":4771,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/387934311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":387934311},{"type":"v1","addr":"172.21.15.167:6836","nonce":387934311}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4878,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6834/2571517660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2571517660},{"type":"v1","addr":"172.21.15.98:6834","nonce":2571517660}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4881,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/1837285444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6833","nonce":1837285444},{"type":"v1","addr":"172.21.15.98:6835","nonce":1837285444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[]} 2024-09-17T05:23:29.884 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 17 2024-09-17T05:23:29.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.885+0000 7f0a3ada0640 1 -- 172.21.15.98:0/1549211920 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f0a20078d40 msgr2=0x7f0a2007b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:29.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.885+0000 7f0a3ada0640 1 --2- 172.21.15.98:0/1549211920 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f0a20078d40 0x7f0a2007b200 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0a3000a830 tx=0x7f0a30008040 comp rx=0 tx=0).stop 2024-09-17T05:23:29.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.885+0000 7f0a3ada0640 1 -- 172.21.15.98:0/1549211920 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a340746a0 msgr2=0x7f0a340cc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:29.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.885+0000 7f0a3ada0640 1 --2- 172.21.15.98:0/1549211920 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a340746a0 0x7f0a340cc680 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f0a2402aa10 tx=0x7f0a24005430 comp rx=0 tx=0).stop 2024-09-17T05:23:29.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.885+0000 7f0a3ada0640 1 -- 172.21.15.98:0/1549211920 shutdown_connections 2024-09-17T05:23:29.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.885+0000 7f0a3ada0640 1 --2- 172.21.15.98:0/1549211920 >> [v2:172.21.15.167:6800/610796449,v1:172.21.15.167:6801/610796449] conn(0x7f0a20078d40 0x7f0a2007b200 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:29.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.885+0000 7f0a3ada0640 1 --2- 172.21.15.98:0/1549211920 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a340b43f0 0x7f0a340ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:29.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.885+0000 7f0a3ada0640 1 --2- 172.21.15.98:0/1549211920 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a340746a0 0x7f0a340cc680 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:29.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.885+0000 7f0a3ada0640 1 --2- 172.21.15.98:0/1549211920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a34074150 0x7f0a34156b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:29.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.885+0000 7f0a3ada0640 1 -- 172.21.15.98:0/1549211920 >> 172.21.15.98:0/1549211920 conn(0x7f0a340b1950 msgr2=0x7f0a340af920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:29.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.885+0000 7f0a3ada0640 1 -- 172.21.15.98:0/1549211920 shutdown_connections 2024-09-17T05:23:29.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T05:23:29.885+0000 7f0a3ada0640 1 -- 172.21.15.98:0/1549211920 wait complete. 2024-09-17T05:23:29.897 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-17T05:23:29.897 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-17T05:23:29.897 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T05:23:29.897 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:23:29.906 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T05:23:29.906 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T05:23:29.906 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:23:29.958 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T05:23:29.958 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T05:23:29.959 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:23:29.970 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T05:23:29.971 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T05:23:29.971 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:23:30.023 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T05:23:30.023 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-17T05:23:30.023 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-17T05:23:30.023 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:23:30.053 INFO:tasks.ceph.osd.0:Stopped 2024-09-17T05:23:30.053 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-17T05:23:30.054 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:23:30.122 INFO:tasks.ceph.osd.1:Stopped 2024-09-17T05:23:30.122 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-17T05:23:30.122 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:23:30.186 INFO:tasks.ceph.osd.2:Stopped 2024-09-17T05:23:30.186 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-17T05:23:30.187 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:23:30.254 INFO:tasks.ceph.osd.3:Stopped 2024-09-17T05:23:30.255 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-17T05:23:30.255 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:23:30.289 INFO:tasks.ceph.osd.4:Stopped 2024-09-17T05:23:30.289 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-17T05:23:30.289 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:23:30.363 INFO:tasks.ceph.osd.5:Stopped 2024-09-17T05:23:30.363 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-17T05:23:30.363 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:23:30.429 INFO:tasks.ceph.osd.6:Stopped 2024-09-17T05:23:30.430 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-17T05:23:30.430 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:23:30.495 INFO:tasks.ceph.osd.7:Stopped 2024-09-17T05:23:30.496 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-17T05:23:30.497 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-17T05:23:30.497 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:23:30.523 INFO:tasks.ceph.mgr.y:Stopped 2024-09-17T05:23:30.523 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-17T05:23:30.523 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:23:30.568 INFO:tasks.ceph.mgr.x:Stopped 2024-09-17T05:23:30.568 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-17T05:23:30.568 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-17T05:23:30.568 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:23:30.580 INFO:tasks.ceph.mon.a:Stopped 2024-09-17T05:23:30.580 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-17T05:23:30.580 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:23:30.620 INFO:tasks.ceph.mon.b:Stopped 2024-09-17T05:23:30.620 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-17T05:23:30.621 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:23:30.672 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-09-17T05:23:30.672 INFO:tasks.ceph.mon.c:Stopped 2024-09-17T05:23:30.672 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-17T05:23:30.673 DEBUG:teuthology.orchestra.run.smithi098:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2024-09-17T05:23:30.707 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi098.front.sepia.ceph.com 2024-09-17T05:23:30.707 DEBUG:teuthology.orchestra.run.smithi098:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-17T05:23:30.827 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi098.front.sepia.ceph.com 2024-09-17T05:23:30.828 DEBUG:teuthology.orchestra.run.smithi098:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-17T05:23:30.899 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi098.front.sepia.ceph.com 2024-09-17T05:23:30.899 DEBUG:teuthology.orchestra.run.smithi098:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-17T05:23:30.949 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi098.front.sepia.ceph.com 2024-09-17T05:23:30.949 DEBUG:teuthology.orchestra.run.smithi098:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-17T05:23:30.992 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi167.front.sepia.ceph.com 2024-09-17T05:23:30.992 DEBUG:teuthology.orchestra.run.smithi167:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-17T05:23:31.129 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi167.front.sepia.ceph.com 2024-09-17T05:23:31.129 DEBUG:teuthology.orchestra.run.smithi167:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-17T05:23:31.194 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi167.front.sepia.ceph.com 2024-09-17T05:23:31.194 DEBUG:teuthology.orchestra.run.smithi167:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-17T05:23:31.251 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi167.front.sepia.ceph.com 2024-09-17T05:23:31.251 DEBUG:teuthology.orchestra.run.smithi167:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-17T05:23:31.309 INFO:tasks.ceph:Archiving mon data... 2024-09-17T05:23:31.310 DEBUG:teuthology.misc:Transferring archived files from smithi098:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/avan-2024-09-17_05:02:16-fs:volumes-wip-athakkar-testing-2024-09-16-2351-distro-default-smithi/7908691/data/mon.a.tgz 2024-09-17T05:23:31.311 DEBUG:teuthology.orchestra.run.smithi098:> mktemp 2024-09-17T05:23:31.327 INFO:teuthology.orchestra.run.smithi098.stdout:/tmp/tmp.MmtBMDqLxE 2024-09-17T05:23:31.327 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.MmtBMDqLxE 2024-09-17T05:23:31.459 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 0666 /tmp/tmp.MmtBMDqLxE 2024-09-17T05:23:31.543 DEBUG:teuthology.orchestra.remote:smithi098:/tmp/tmp.MmtBMDqLxE is 334KB 2024-09-17T05:23:31.641 DEBUG:teuthology.orchestra.run.smithi098:> rm -fr /tmp/tmp.MmtBMDqLxE 2024-09-17T05:23:31.657 DEBUG:teuthology.misc:Transferring archived files from smithi167:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/avan-2024-09-17_05:02:16-fs:volumes-wip-athakkar-testing-2024-09-16-2351-distro-default-smithi/7908691/data/mon.b.tgz 2024-09-17T05:23:31.657 DEBUG:teuthology.orchestra.run.smithi167:> mktemp 2024-09-17T05:23:31.675 INFO:teuthology.orchestra.run.smithi167.stdout:/tmp/tmp.nCh4z2bx01 2024-09-17T05:23:31.675 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.nCh4z2bx01 2024-09-17T05:23:31.830 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 0666 /tmp/tmp.nCh4z2bx01 2024-09-17T05:23:31.914 DEBUG:teuthology.orchestra.remote:smithi167:/tmp/tmp.nCh4z2bx01 is 458KB 2024-09-17T05:23:32.012 DEBUG:teuthology.orchestra.run.smithi167:> rm -fr /tmp/tmp.nCh4z2bx01 2024-09-17T05:23:32.027 DEBUG:teuthology.misc:Transferring archived files from smithi167:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/avan-2024-09-17_05:02:16-fs:volumes-wip-athakkar-testing-2024-09-16-2351-distro-default-smithi/7908691/data/mon.c.tgz 2024-09-17T05:23:32.027 DEBUG:teuthology.orchestra.run.smithi167:> mktemp 2024-09-17T05:23:32.082 INFO:teuthology.orchestra.run.smithi167.stdout:/tmp/tmp.Snuk2HrWEW 2024-09-17T05:23:32.082 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.Snuk2HrWEW 2024-09-17T05:23:32.225 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 0666 /tmp/tmp.Snuk2HrWEW 2024-09-17T05:23:32.308 DEBUG:teuthology.orchestra.remote:smithi167:/tmp/tmp.Snuk2HrWEW is 458KB 2024-09-17T05:23:32.406 DEBUG:teuthology.orchestra.run.smithi167:> rm -fr /tmp/tmp.Snuk2HrWEW 2024-09-17T05:23:32.423 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-17T05:23:32.423 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-17T05:23:32.426 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-17T05:23:32.510 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-17T05:23:32.543 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-17T05:23:32.543 INFO:tasks.ceph:Archiving crash dumps... 2024-09-17T05:23:32.545 DEBUG:teuthology.misc:Transferring archived files from smithi098:/var/lib/ceph/crash to /home/teuthworker/archive/avan-2024-09-17_05:02:16-fs:volumes-wip-athakkar-testing-2024-09-16-2351-distro-default-smithi/7908691/remote/smithi098/crash 2024-09-17T05:23:32.545 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-17T05:23:32.578 DEBUG:teuthology.misc:Transferring archived files from smithi167:/var/lib/ceph/crash to /home/teuthworker/archive/avan-2024-09-17_05:02:16-fs:volumes-wip-athakkar-testing-2024-09-16-2351-distro-default-smithi/7908691/remote/smithi167/crash 2024-09-17T05:23:32.579 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-17T05:23:32.607 INFO:tasks.ceph:Shutting down logrotate 2024-09-17T05:23:32.607 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:23:32.623 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:23:32.698 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-17T05:23:32.725 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-17T05:23:32.750 INFO:tasks.ceph:Compressing logs... 2024-09-17T05:23:32.750 DEBUG:teuthology.orchestra.run.smithi098:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T05:23:32.768 DEBUG:teuthology.orchestra.run.smithi167:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T05:23:32.840 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36380.log 2024-09-17T05:23:32.840 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-17T05:23:32.840 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.36380.log: /var/log/ceph/ceph-client.admin.36293.log 2024-09-17T05:23:32.840 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-17T05:23:32.840 INFO:teuthology.orchestra.run.smithi167.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.36380.log.gz 2024-09-17T05:23:32.840 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.admin.36293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36340.log 2024-09-17T05:23:32.840 INFO:teuthology.orchestra.run.smithi167.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.36293.log.gz 2024-09-17T05:23:32.840 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-17T05:23:32.840 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.admin.36340.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-17T05:23:32.841 INFO:teuthology.orchestra.run.smithi167.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36340.log.gz 2024-09-17T05:23:32.841 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.42788.log 2024-09-17T05:23:32.841 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42390.log 2024-09-17T05:23:32.841 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.3.42788.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.42788.log.gz 2024-09-17T05:23:32.841 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36540.log 2024-09-17T05:23:32.841 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36580.log 2024-09-17T05:23:32.841 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.1.42390.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42390.log.gz 2024-09-17T05:23:32.841 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.admin.36540.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-17T05:23:32.841 INFO:teuthology.orchestra.run.smithi167.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.36540.log.gz 2024-09-17T05:23:32.841 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.admin.36580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36500.log 2024-09-17T05:23:32.841 INFO:teuthology.orchestra.run.smithi167.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.36580.log.gz 2024-09-17T05:23:32.841 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-17T05:23:32.842 INFO:teuthology.orchestra.run.smithi167.stderr: 93.6%/var/log/ceph/ceph-client.admin.36500.log: -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-17T05:23:32.842 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-17T05:23:32.842 INFO:teuthology.orchestra.run.smithi167.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36500.log.gz 2024-09-17T05:23:32.842 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-17T05:23:32.842 INFO:teuthology.orchestra.run.smithi167.stderr:gzip/var/log/ceph/ceph-osd.5.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.36420.log 2024-09-17T05:23:32.842 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-17T05:23:32.842 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.admin.36420.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.36420.log.gz 2024-09-17T05:23:32.842 INFO:teuthology.orchestra.run.smithi167.stderr: 91.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-17T05:23:32.842 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-17T05:23:32.842 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36460.log 2024-09-17T05:23:32.842 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-mgr.x.log: 92.2% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-17T05:23:32.842 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43384.log 2024-09-17T05:23:32.842 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.admin.36460.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.36460.log.gz 2024-09-17T05:23:32.853 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-17T05:23:32.853 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.1.43384.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.43384.log.gz 2024-09-17T05:23:32.878 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-17T05:23:32.878 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46256.log 2024-09-17T05:23:32.878 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37398.log 2024-09-17T05:23:32.878 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.46256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50003.log 2024-09-17T05:23:32.878 INFO:teuthology.orchestra.run.smithi098.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46256.log.gz 2024-09-17T05:23:32.878 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.37398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46856.log 2024-09-17T05:23:32.878 INFO:teuthology.orchestra.run.smithi098.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.37398.log.gz 2024-09-17T05:23:32.879 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.50003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47448.log 2024-09-17T05:23:32.879 INFO:teuthology.orchestra.run.smithi098.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50003.log.gz 2024-09-17T05:23:32.879 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.46856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36415.log 2024-09-17T05:23:32.879 INFO:teuthology.orchestra.run.smithi098.stderr: 87.5%/var/log/ceph/ceph-client.admin.47448.log: -- replaced with /var/log/ceph/ceph-client.admin.46856.log.gz 2024-09-17T05:23:32.879 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36960.log 2024-09-17T05:23:32.879 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.36415.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.47448.log.gz 2024-09-17T05:23:32.879 INFO:teuthology.orchestra.run.smithi098.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36415.log.gz 2024-09-17T05:23:32.879 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44376.log 2024-09-17T05:23:32.879 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.36960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46813.log 2024-09-17T05:23:32.879 INFO:teuthology.orchestra.run.smithi098.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.36960.log.gz 2024-09-17T05:23:32.879 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.44376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47066.log 2024-09-17T05:23:32.879 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.46813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49434.log 2024-09-17T05:23:32.879 INFO:teuthology.orchestra.run.smithi098.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.44376.log.gz 2024-09-17T05:23:32.880 INFO:teuthology.orchestra.run.smithi098.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46813.log.gz 2024-09-17T05:23:32.880 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.47066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43368.log 2024-09-17T05:23:32.880 INFO:teuthology.orchestra.run.smithi098.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47066.log.gz 2024-09-17T05:23:32.880 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.49434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50565.log 2024-09-17T05:23:32.880 INFO:teuthology.orchestra.run.smithi098.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49434.log.gz 2024-09-17T05:23:32.880 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.43368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45885.log 2024-09-17T05:23:32.880 INFO:teuthology.orchestra.run.smithi098.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43368.log.gz 2024-09-17T05:23:32.880 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.50565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48159.log 2024-09-17T05:23:32.880 INFO:teuthology.orchestra.run.smithi098.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50565.log.gz 2024-09-17T05:23:32.880 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.45885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36884.log 2024-09-17T05:23:32.880 INFO:teuthology.orchestra.run.smithi098.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45885.log.gz 2024-09-17T05:23:32.880 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.48159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48201.log 2024-09-17T05:23:32.880 INFO:teuthology.orchestra.run.smithi098.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48159.log.gz 2024-09-17T05:23:32.880 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.36884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46940.log 2024-09-17T05:23:32.881 INFO:teuthology.orchestra.run.smithi098.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.36884.log.gz 2024-09-17T05:23:32.881 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.48201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50465.log 2024-09-17T05:23:32.881 INFO:teuthology.orchestra.run.smithi098.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48201.log.gz 2024-09-17T05:23:32.881 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.46940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.45304.log 2024-09-17T05:23:32.881 INFO:teuthology.orchestra.run.smithi098.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46940.log.gz 2024-09-17T05:23:32.881 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.50465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42906.log 2024-09-17T05:23:32.881 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.2.45304.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.50465.log.gz 2024-09-17T05:23:32.881 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.46298.log -- replaced with /var/log/ceph/ceph-client.2.45304.log.gz 2024-09-17T05:23:32.881 INFO:teuthology.orchestra.run.smithi098.stderr: 2024-09-17T05:23:32.881 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.42906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43884.log 2024-09-17T05:23:32.881 INFO:teuthology.orchestra.run.smithi098.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42906.log.gz 2024-09-17T05:23:32.882 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.46298.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-17T05:23:32.882 INFO:teuthology.orchestra.run.smithi098.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46298.log.gz 2024-09-17T05:23:32.882 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.43884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43878.log 2024-09-17T05:23:32.882 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-osd.1.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43884.log.gz 2024-09-17T05:23:32.882 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47850.log 2024-09-17T05:23:32.882 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.43878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45648.log 2024-09-17T05:23:32.882 INFO:teuthology.orchestra.run.smithi098.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43878.log.gz 2024-09-17T05:23:32.882 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.47850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47110.log 2024-09-17T05:23:32.882 INFO:teuthology.orchestra.run.smithi098.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47850.log.gz 2024-09-17T05:23:32.882 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.45648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48972.log 2024-09-17T05:23:32.882 INFO:teuthology.orchestra.run.smithi098.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45648.log.gz 2024-09-17T05:23:32.882 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36591.log 2024-09-17T05:23:32.883 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.47110.log: /var/log/ceph/ceph-client.admin.48972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48327.log 2024-09-17T05:23:32.883 INFO:teuthology.orchestra.run.smithi098.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47110.log.gz 2024-09-17T05:23:32.883 INFO:teuthology.orchestra.run.smithi098.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48972.log.gz 2024-09-17T05:23:32.883 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.36591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36893.log 2024-09-17T05:23:32.883 INFO:teuthology.orchestra.run.smithi098.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.36591.log.gz 2024-09-17T05:23:32.883 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43871.log 2024-09-17T05:23:32.883 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.48327.log: /var/log/ceph/ceph-client.admin.36893.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.48327.log.gz 2024-09-17T05:23:32.883 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30370.log 2024-09-17T05:23:32.883 INFO:teuthology.orchestra.run.smithi098.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.36893.log.gz 2024-09-17T05:23:32.883 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.43871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43242.log 2024-09-17T05:23:32.883 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph.tmp-client.admin.30370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45438.log 2024-09-17T05:23:32.884 INFO:teuthology.orchestra.run.smithi098.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.43871.log.gz 2024-09-17T05:23:32.884 INFO:teuthology.orchestra.run.smithi098.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30370.log.gz 2024-09-17T05:23:32.884 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.43242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47280.log 2024-09-17T05:23:32.884 INFO:teuthology.orchestra.run.smithi098.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43242.log.gz 2024-09-17T05:23:32.884 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.45438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36776.log 2024-09-17T05:23:32.884 INFO:teuthology.orchestra.run.smithi098.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45438.log.gz 2024-09-17T05:23:32.884 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48411.log 2024-09-17T05:23:32.884 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.47280.log: /var/log/ceph/ceph-client.admin.36776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47616.log 2024-09-17T05:23:32.885 INFO:teuthology.orchestra.run.smithi098.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47280.log.gz 2024-09-17T05:23:32.885 INFO:teuthology.orchestra.run.smithi098.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.36776.log.gz 2024-09-17T05:23:32.885 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.48411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43549.log 2024-09-17T05:23:32.885 INFO:teuthology.orchestra.run.smithi098.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.48411.log.gz 2024-09-17T05:23:32.885 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47024.log 2024-09-17T05:23:32.885 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.47616.log: /var/log/ceph/ceph-client.admin.43549.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.47616.log.gz 2024-09-17T05:23:32.885 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47238.log 2024-09-17T05:23:32.885 INFO:teuthology.orchestra.run.smithi098.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43549.log.gz 2024-09-17T05:23:32.885 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48117.log 2024-09-17T05:23:32.885 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.47024.log: /var/log/ceph/ceph-client.admin.47238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50129.log 2024-09-17T05:23:32.885 INFO:teuthology.orchestra.run.smithi098.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.47024.log.gz 2024-09-17T05:23:32.885 INFO:teuthology.orchestra.run.smithi098.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.47238.log.gz 2024-09-17T05:23:32.886 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.48117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49709.log 2024-09-17T05:23:32.886 INFO:teuthology.orchestra.run.smithi098.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48117.log.gz 2024-09-17T05:23:32.886 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.50129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47574.log 2024-09-17T05:23:32.886 INFO:teuthology.orchestra.run.smithi098.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50129.log.gz 2024-09-17T05:23:32.886 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.49709.log: /var/log/ceph/ceph-client.admin.42548.log 2024-09-17T05:23:32.886 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.47574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50339.log 2024-09-17T05:23:32.886 INFO:teuthology.orchestra.run.smithi098.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.49709.log.gz 2024-09-17T05:23:32.886 INFO:teuthology.orchestra.run.smithi098.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47574.log.gz 2024-09-17T05:23:32.886 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.42548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42590.log 2024-09-17T05:23:32.886 INFO:teuthology.orchestra.run.smithi098.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42548.log.gz 2024-09-17T05:23:32.886 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49266.log 2024-09-17T05:23:32.886 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.50339.log: /var/log/ceph/ceph-client.admin.42590.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.50339.log.gz 2024-09-17T05:23:32.886 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49056.log 2024-09-17T05:23:32.886 INFO:teuthology.orchestra.run.smithi098.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.42590.log.gz 2024-09-17T05:23:32.887 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.49266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43284.log 2024-09-17T05:23:32.887 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.49056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43547.log 2024-09-17T05:23:32.887 INFO:teuthology.orchestra.run.smithi098.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49266.log.gz 2024-09-17T05:23:32.887 INFO:teuthology.orchestra.run.smithi098.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49056.log.gz 2024-09-17T05:23:32.887 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.43284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44082.log 2024-09-17T05:23:32.887 INFO:teuthology.orchestra.run.smithi098.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43284.log.gz 2024-09-17T05:23:32.887 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36507.log 2024-09-17T05:23:32.887 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.43547.log: /var/log/ceph/ceph-client.admin.44082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49835.log 2024-09-17T05:23:32.887 INFO:teuthology.orchestra.run.smithi098.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43547.log.gz 2024-09-17T05:23:32.887 INFO:teuthology.orchestra.run.smithi098.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44082.log.gz 2024-09-17T05:23:32.887 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.36507.log: 76.3% -- replaced with /var/log/ceph/ceph-client.admin.36507.log.gz 2024-09-17T05:23:32.887 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45564.log 2024-09-17T05:23:32.887 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.49835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36535.log 2024-09-17T05:23:32.888 INFO:teuthology.orchestra.run.smithi098.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49835.log.gz 2024-09-17T05:23:32.888 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.45564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43881.log 2024-09-17T05:23:32.888 INFO:teuthology.orchestra.run.smithi098.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45564.log.gz 2024-09-17T05:23:32.888 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47406.log 2024-09-17T05:23:32.888 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.36535.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36535.log.gz 2024-09-17T05:23:32.888 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.43881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44124.log 2024-09-17T05:23:32.888 INFO:teuthology.orchestra.run.smithi098.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43881.log.gz 2024-09-17T05:23:32.888 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.47406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47700.log 2024-09-17T05:23:32.888 INFO:teuthology.orchestra.run.smithi098.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47406.log.gz 2024-09-17T05:23:32.888 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.44124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47490.log 2024-09-17T05:23:32.888 INFO:teuthology.orchestra.run.smithi098.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44124.log.gz 2024-09-17T05:23:32.888 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-17T05:23:32.888 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.47700.log: /var/log/ceph/ceph-client.admin.47490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36941.log 2024-09-17T05:23:32.889 INFO:teuthology.orchestra.run.smithi098.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.47700.log.gz 2024-09-17T05:23:32.889 INFO:teuthology.orchestra.run.smithi098.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.47490.log.gz 2024-09-17T05:23:32.889 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49919.log 2024-09-17T05:23:32.889 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50255.log 2024-09-17T05:23:32.889 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.36941.log: /var/log/ceph/ceph-client.admin.49919.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.36941.log.gz 2024-09-17T05:23:32.889 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43875.log 2024-09-17T05:23:32.889 INFO:teuthology.orchestra.run.smithi098.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.49919.log.gz 2024-09-17T05:23:32.889 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.50255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48888.log 2024-09-17T05:23:32.889 INFO:teuthology.orchestra.run.smithi098.stderr: 89.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-17T05:23:32.889 INFO:teuthology.orchestra.run.smithi098.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.50255.log.gz 2024-09-17T05:23:32.889 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.43875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49014.log 2024-09-17T05:23:32.889 INFO:teuthology.orchestra.run.smithi098.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.43875.log.gz 2024-09-17T05:23:32.889 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.48888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45606.log 2024-09-17T05:23:32.889 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44514.log 2024-09-17T05:23:32.890 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.49014.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48888.log.gz 2024-09-17T05:23:32.890 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.45606.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.49014.log.gz 2024-09-17T05:23:32.890 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43158.log 2024-09-17T05:23:32.890 INFO:teuthology.orchestra.run.smithi098.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.45606.log.gz 2024-09-17T05:23:32.890 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49182.log 2024-09-17T05:23:32.890 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.44514.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44514.log.gz 2024-09-17T05:23:32.890 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.43158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44292.log 2024-09-17T05:23:32.890 INFO:teuthology.orchestra.run.smithi098.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43158.log.gz 2024-09-17T05:23:32.890 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.49182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46898.log 2024-09-17T05:23:32.890 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.44292.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.49182.log.gz 2024-09-17T05:23:32.890 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43200.log 2024-09-17T05:23:32.890 INFO:teuthology.orchestra.run.smithi098.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44292.log.gz 2024-09-17T05:23:32.890 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.46898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45480.log 2024-09-17T05:23:32.890 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.43200.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46898.log.gz 2024-09-17T05:23:32.891 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47364.log 2024-09-17T05:23:32.891 INFO:teuthology.orchestra.run.smithi098.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43200.log.gz 2024-09-17T05:23:32.891 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.45480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48710.log 2024-09-17T05:23:32.891 INFO:teuthology.orchestra.run.smithi098.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45480.log.gz 2024-09-17T05:23:32.891 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.47364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47784.log 2024-09-17T05:23:32.891 INFO:teuthology.orchestra.run.smithi098.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47364.log.gz 2024-09-17T05:23:32.891 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.48710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36479.log 2024-09-17T05:23:32.891 INFO:teuthology.orchestra.run.smithi098.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48710.log.gz 2024-09-17T05:23:32.891 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46130.log 2024-09-17T05:23:32.891 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.47784.log: /var/log/ceph/ceph-client.admin.36479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36704.log 2024-09-17T05:23:32.891 INFO:teuthology.orchestra.run.smithi098.stderr: 75.3% -- replaced with /var/log/ceph/ceph-client.admin.36479.log.gz 2024-09-17T05:23:32.891 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.46130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45000.log 2024-09-17T05:23:32.891 INFO:teuthology.orchestra.run.smithi098.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.47784.log.gz 2024-09-17T05:23:32.892 INFO:teuthology.orchestra.run.smithi098.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46130.log.gz 2024-09-17T05:23:32.892 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.36704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36948.log 2024-09-17T05:23:32.892 INFO:teuthology.orchestra.run.smithi098.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.36704.log.gz 2024-09-17T05:23:32.892 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.45000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50171.log 2024-09-17T05:23:32.892 INFO:teuthology.orchestra.run.smithi098.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45000.log.gz 2024-09-17T05:23:32.892 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.36948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43540.log 2024-09-17T05:23:32.892 INFO:teuthology.orchestra.run.smithi098.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.36948.log.gz 2024-09-17T05:23:32.892 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.50171.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-17T05:23:32.892 INFO:teuthology.orchestra.run.smithi098.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.50171.log.gz 2024-09-17T05:23:32.892 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.43540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42990.log 2024-09-17T05:23:32.892 INFO:teuthology.orchestra.run.smithi098.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.43540.log.gz 2024-09-17T05:23:32.892 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48930.log 2024-09-17T05:23:32.892 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.42990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49667.log 2024-09-17T05:23:32.892 INFO:teuthology.orchestra.run.smithi098.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.42990.log.gz 2024-09-17T05:23:32.893 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.48930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36952.log 2024-09-17T05:23:32.893 INFO:teuthology.orchestra.run.smithi098.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-17T05:23:32.893 INFO:teuthology.orchestra.run.smithi098.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48930.log.gz 2024-09-17T05:23:32.893 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.49667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46172.log 2024-09-17T05:23:32.893 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.36952.log: gzip 87.2% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.49667.log.gz -- 2024-09-17T05:23:32.893 INFO:teuthology.orchestra.run.smithi098.stderr: /var/log/ceph/ceph-client.admin.49308.log 2024-09-17T05:23:32.893 INFO:teuthology.orchestra.run.smithi098.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.36952.log.gz 2024-09-17T05:23:32.893 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.46172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47322.log 2024-09-17T05:23:32.893 INFO:teuthology.orchestra.run.smithi098.stderr: 87.5%/var/log/ceph/ceph-client.admin.49308.log: -- replaced with /var/log/ceph/ceph-client.admin.46172.log.gz 2024-09-17T05:23:32.893 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46729.log 2024-09-17T05:23:32.893 INFO:teuthology.orchestra.run.smithi098.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49308.log.gz 2024-09-17T05:23:32.893 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.47322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43882.log 2024-09-17T05:23:32.893 INFO:teuthology.orchestra.run.smithi098.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47322.log.gz 2024-09-17T05:23:32.894 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.46729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37490.log 2024-09-17T05:23:32.894 INFO:teuthology.orchestra.run.smithi098.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46729.log.gz 2024-09-17T05:23:32.894 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47154.log 2024-09-17T05:23:32.894 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.43882.log: /var/log/ceph/ceph-client.admin.37490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50045.log 2024-09-17T05:23:32.894 INFO:teuthology.orchestra.run.smithi098.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43882.log.gz 2024-09-17T05:23:32.894 INFO:teuthology.orchestra.run.smithi098.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.37490.log.gz 2024-09-17T05:23:32.894 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.47154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43116.log 2024-09-17T05:23:32.894 INFO:teuthology.orchestra.run.smithi098.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47154.log.gz 2024-09-17T05:23:32.894 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43544.log 2024-09-17T05:23:32.894 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.50045.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50045.log.gz 2024-09-17T05:23:32.894 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.43116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36973.log 2024-09-17T05:23:32.894 INFO:teuthology.orchestra.run.smithi098.stderr: 87.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.43116.log.gz 2024-09-17T05:23:32.894 INFO:teuthology.orchestra.run.smithi098.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44208.log 2024-09-17T05:23:32.894 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.43544.log: /var/log/ceph/ceph-client.admin.36973.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.43544.log.gz 2024-09-17T05:23:32.895 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49224.log 2024-09-17T05:23:32.895 INFO:teuthology.orchestra.run.smithi098.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.36973.log.gz 2024-09-17T05:23:32.895 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44250.log 2024-09-17T05:23:32.895 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.44208.log: /var/log/ceph/ceph-client.admin.49224.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-17T05:23:32.895 INFO:teuthology.orchestra.run.smithi098.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44208.log.gz 2024-09-17T05:23:32.895 INFO:teuthology.orchestra.run.smithi098.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49224.log.gz 2024-09-17T05:23:32.895 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.44250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50423.log 2024-09-17T05:23:32.895 INFO:teuthology.orchestra.run.smithi098.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44250.log.gz 2024-09-17T05:23:32.895 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45963.log 2024-09-17T05:23:32.895 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46053.log 2024-09-17T05:23:32.895 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.50423.log: /var/log/ceph/ceph-client.admin.45963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46442.log 87.2% 2024-09-17T05:23:32.895 INFO:teuthology.orchestra.run.smithi098.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50423.log.gz 2024-09-17T05:23:32.895 INFO:teuthology.orchestra.run.smithi098.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45963.log.gz 2024-09-17T05:23:32.896 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.46053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46214.log 2024-09-17T05:23:32.896 INFO:teuthology.orchestra.run.smithi098.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46053.log.gz 2024-09-17T05:23:32.896 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36760.log 2024-09-17T05:23:32.896 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.46442.log: /var/log/ceph/ceph-client.admin.46214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43074.log 87.3% 2024-09-17T05:23:32.896 INFO:teuthology.orchestra.run.smithi098.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46442.log.gz 2024-09-17T05:23:32.896 INFO:teuthology.orchestra.run.smithi098.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46214.log.gz 2024-09-17T05:23:32.896 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.36760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42864.log 2024-09-17T05:23:32.896 INFO:teuthology.orchestra.run.smithi098.stderr: 85.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.36760.log.gz -5 2024-09-17T05:23:32.896 INFO:teuthology.orchestra.run.smithi098.stderr: --verbose -- /var/log/ceph/ceph-client.admin.43545.log 2024-09-17T05:23:32.896 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.43074.log: /var/log/ceph/ceph-client.admin.42864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48846.log 2024-09-17T05:23:32.896 INFO:teuthology.orchestra.run.smithi098.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43074.log.gz 2024-09-17T05:23:32.896 INFO:teuthology.orchestra.run.smithi098.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.42864.log.gz 2024-09-17T05:23:32.896 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.43545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48537.log 2024-09-17T05:23:32.897 INFO:teuthology.orchestra.run.smithi098.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43545.log.gz 2024-09-17T05:23:32.897 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.48846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49961.log 2024-09-17T05:23:32.897 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.48537.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48846.log.gz 2024-09-17T05:23:32.897 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-17T05:23:32.897 INFO:teuthology.orchestra.run.smithi098.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.48537.log.gz 2024-09-17T05:23:32.897 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.49961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45690.log 2024-09-17T05:23:32.897 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-osd.2.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49961.log.gz 2024-09-17T05:23:32.897 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46526.log 2024-09-17T05:23:32.897 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.45690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45522.log 2024-09-17T05:23:32.897 INFO:teuthology.orchestra.run.smithi098.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45690.log.gz 2024-09-17T05:23:32.897 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.46526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36675.log 2024-09-17T05:23:32.897 INFO:teuthology.orchestra.run.smithi098.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.46526.log.gz 2024-09-17T05:23:32.897 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.45522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36917.log 2024-09-17T05:23:32.898 INFO:teuthology.orchestra.run.smithi098.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45522.log.gz 2024-09-17T05:23:32.898 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.36675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49625.log 2024-09-17T05:23:32.898 INFO:teuthology.orchestra.run.smithi098.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.36675.log.gz 2024-09-17T05:23:32.898 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.36917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42652.log 2024-09-17T05:23:32.898 INFO:teuthology.orchestra.run.smithi098.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.36917.log.gz 2024-09-17T05:23:32.898 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.49625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48453.log 2024-09-17T05:23:32.898 INFO:teuthology.orchestra.run.smithi098.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.49625.log.gz 2024-09-17T05:23:32.898 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.42652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49877.log 2024-09-17T05:23:32.898 INFO:teuthology.orchestra.run.smithi098.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42652.log.gz 2024-09-17T05:23:32.898 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.48453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47742.log 2024-09-17T05:23:32.898 INFO:teuthology.orchestra.run.smithi098.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.48453.log.gz 2024-09-17T05:23:32.898 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.49877.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-17T05:23:32.898 INFO:teuthology.orchestra.run.smithi098.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.49877.log.gz 2024-09-17T05:23:32.899 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.47742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49140.log 2024-09-17T05:23:32.899 INFO:teuthology.orchestra.run.smithi098.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47742.log.gz 2024-09-17T05:23:32.899 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49392.log 2024-09-17T05:23:32.899 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.49140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48369.log 2024-09-17T05:23:32.899 INFO:teuthology.orchestra.run.smithi098.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49140.log.gz 2024-09-17T05:23:32.899 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.49392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46400.log 2024-09-17T05:23:32.899 INFO:teuthology.orchestra.run.smithi098.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49392.log.gz 2024-09-17T05:23:32.899 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.48369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43886.log 2024-09-17T05:23:32.899 INFO:teuthology.orchestra.run.smithi098.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.48369.log.gz 2024-09-17T05:23:32.899 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47532.log 2024-09-17T05:23:32.899 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.46400.log: /var/log/ceph/ceph-client.admin.43886.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-17T05:23:32.899 INFO:teuthology.orchestra.run.smithi098.stderr: 87.8% 86.8% -- replaced with /var/log/ceph/ceph-client.admin.46400.log.gz 2024-09-17T05:23:32.899 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.47532.log: -- replaced with /var/log/ceph/ceph-client.admin.43886.log.gz 2024-09-17T05:23:32.899 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42506.log 2024-09-17T05:23:32.900 INFO:teuthology.orchestra.run.smithi098.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.47532.log.gz 2024-09-17T05:23:32.900 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose/var/log/ceph/ceph.log: -- /var/log/ceph/ceph-client.admin.50213.log 2024-09-17T05:23:32.900 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.42506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42328.log 2024-09-17T05:23:32.900 INFO:teuthology.orchestra.run.smithi098.stderr: 92.2% 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42506.log.gz 2024-09-17T05:23:32.900 INFO:teuthology.orchestra.run.smithi098.stderr: -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-17T05:23:32.900 INFO:teuthology.orchestra.run.smithi098.stderr: 84.9% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-17T05:23:32.900 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.50213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44166.log 2024-09-17T05:23:32.900 INFO:teuthology.orchestra.run.smithi098.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50213.log.gz 2024-09-17T05:23:32.900 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.42328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46484.log 2024-09-17T05:23:32.900 INFO:teuthology.orchestra.run.smithi098.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42328.log.gz 2024-09-17T05:23:32.900 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.44166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46771.log 2024-09-17T05:23:32.900 INFO:teuthology.orchestra.run.smithi098.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44166.log.gz 2024-09-17T05:23:32.900 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.46484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46648.log 2024-09-17T05:23:32.901 INFO:teuthology.orchestra.run.smithi098.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46484.log.gz 2024-09-17T05:23:32.901 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.46771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50297.log 2024-09-17T05:23:32.901 INFO:teuthology.orchestra.run.smithi098.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46771.log.gz 2024-09-17T05:23:32.901 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.46648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37197.log 2024-09-17T05:23:32.901 INFO:teuthology.orchestra.run.smithi098.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46648.log.gz 2024-09-17T05:23:32.901 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.50297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48495.log 2024-09-17T05:23:32.901 INFO:teuthology.orchestra.run.smithi098.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50297.log.gz 2024-09-17T05:23:32.901 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.37197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47658.log 86.8% -- replaced with /var/log/ceph/ceph-client.admin.37197.log.gz 2024-09-17T05:23:32.901 INFO:teuthology.orchestra.run.smithi098.stderr: 2024-09-17T05:23:32.901 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.48495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43032.log 2024-09-17T05:23:32.901 INFO:teuthology.orchestra.run.smithi098.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.48495.log.gz 2024-09-17T05:23:32.901 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.47658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36563.log 2024-09-17T05:23:32.901 INFO:teuthology.orchestra.run.smithi098.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47658.log.gz 2024-09-17T05:23:32.902 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.43032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43539.log 2024-09-17T05:23:32.902 INFO:teuthology.orchestra.run.smithi098.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.43032.log.gz 2024-09-17T05:23:32.902 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.36563.log: gzip -5 --verbose -- 77.2% -- replaced with /var/log/ceph/ceph-client.admin.36563.log.gz 2024-09-17T05:23:32.902 INFO:teuthology.orchestra.run.smithi098.stderr: /var/log/ceph/ceph-client.admin.43326.log 2024-09-17T05:23:32.902 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.43539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44864.log 2024-09-17T05:23:32.902 INFO:teuthology.orchestra.run.smithi098.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43539.log.gz 2024-09-17T05:23:32.902 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.43326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50381.log 2024-09-17T05:23:32.902 INFO:teuthology.orchestra.run.smithi098.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43326.log.gz 2024-09-17T05:23:32.902 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.0.44864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50607.log 2024-09-17T05:23:32.902 INFO:teuthology.orchestra.run.smithi098.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.44864.log.gz 2024-09-17T05:23:32.902 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.50381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46982.log 2024-09-17T05:23:32.902 INFO:teuthology.orchestra.run.smithi098.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50381.log.gz 2024-09-17T05:23:32.902 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.50607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45732.log 2024-09-17T05:23:32.902 INFO:teuthology.orchestra.run.smithi098.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50607.log.gz 2024-09-17T05:23:32.903 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.46982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42177.log 2024-09-17T05:23:32.903 INFO:teuthology.orchestra.run.smithi098.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46982.log.gz 2024-09-17T05:23:32.903 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.45732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43885.log 2024-09-17T05:23:32.903 INFO:teuthology.orchestra.run.smithi098.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45732.log.gz 2024-09-17T05:23:32.903 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.42177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43548.log 2024-09-17T05:23:32.903 INFO:teuthology.orchestra.run.smithi098.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42177.log.gz 2024-09-17T05:23:32.903 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.43885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48579.log 2024-09-17T05:23:32.903 INFO:teuthology.orchestra.run.smithi098.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43885.log.gz 2024-09-17T05:23:32.903 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.43548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42696.log 2024-09-17T05:23:32.903 INFO:teuthology.orchestra.run.smithi098.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43548.log.gz 2024-09-17T05:23:32.903 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.48579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43550.log 2024-09-17T05:23:32.903 INFO:teuthology.orchestra.run.smithi098.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.48579.log.gz 2024-09-17T05:23:32.904 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.42696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42738.log 2024-09-17T05:23:32.904 INFO:teuthology.orchestra.run.smithi098.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42696.log.gz 2024-09-17T05:23:32.904 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.43550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45774.log 87.2% 2024-09-17T05:23:32.904 INFO:teuthology.orchestra.run.smithi098.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43550.log.gz 2024-09-17T05:23:32.904 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.42738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48243.log 2024-09-17T05:23:32.904 INFO:teuthology.orchestra.run.smithi098.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42738.log.gz 2024-09-17T05:23:32.904 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.45774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50087.log 2024-09-17T05:23:32.904 INFO:teuthology.orchestra.run.smithi098.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45774.log.gz 2024-09-17T05:23:32.904 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50525.log 2024-09-17T05:23:32.904 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.48243.log: /var/log/ceph/ceph-client.admin.50087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49350.log 2024-09-17T05:23:32.904 INFO:teuthology.orchestra.run.smithi098.stderr: 87.2%/var/log/ceph/ceph-client.admin.50525.log: -- replaced with /var/log/ceph/ceph-client.admin.50087.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42780.log 2024-09-17T05:23:32.904 INFO:teuthology.orchestra.run.smithi098.stderr: 2024-09-17T05:23:32.904 INFO:teuthology.orchestra.run.smithi098.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48243.log.gz 2024-09-17T05:23:32.904 INFO:teuthology.orchestra.run.smithi098.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.50525.log.gz 2024-09-17T05:23:32.905 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.49350.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49350.log.gz 2024-09-17T05:23:32.905 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49098.log 2024-09-17T05:23:32.905 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.42780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48038.log 2024-09-17T05:23:32.905 INFO:teuthology.orchestra.run.smithi098.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42780.log.gz 2024-09-17T05:23:32.905 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.49098.log: gzip -5 --verbose -- 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49098.log.gz 2024-09-17T05:23:32.905 INFO:teuthology.orchestra.run.smithi098.stderr: /var/log/ceph/ceph-client.admin.48285.log 2024-09-17T05:23:32.905 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.0.48038.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48038.log.gz 2024-09-17T05:23:32.905 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49751.log 2024-09-17T05:23:32.905 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.48285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42424.log 2024-09-17T05:23:32.905 INFO:teuthology.orchestra.run.smithi098.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.48285.log.gz 2024-09-17T05:23:32.905 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.49751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44334.log 2024-09-17T05:23:32.905 INFO:teuthology.orchestra.run.smithi098.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49751.log.gz 2024-09-17T05:23:32.905 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.42424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47196.log 2024-09-17T05:23:32.906 INFO:teuthology.orchestra.run.smithi098.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42424.log.gz 2024-09-17T05:23:32.906 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.44334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46568.log 2024-09-17T05:23:32.906 INFO:teuthology.orchestra.run.smithi098.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44334.log.gz 2024-09-17T05:23:32.906 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.47196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46340.log 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47196.log.gz 2024-09-17T05:23:32.906 INFO:teuthology.orchestra.run.smithi098.stderr: 2024-09-17T05:23:32.906 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.46568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48788.log 2024-09-17T05:23:32.906 INFO:teuthology.orchestra.run.smithi098.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46568.log.gz 2024-09-17T05:23:32.906 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.46340.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-17T05:23:32.906 INFO:teuthology.orchestra.run.smithi098.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46340.log.gz 2024-09-17T05:23:32.906 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.48788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49793.log 2024-09-17T05:23:32.906 INFO:teuthology.orchestra.run.smithi098.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48788.log.gz 2024-09-17T05:23:32.906 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-17T05:23:32.906 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.49793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42948.log 2024-09-17T05:23:32.907 INFO:teuthology.orchestra.run.smithi098.stderr: 87.2%/var/log/ceph/ceph-mds.c.log: -- replaced with /var/log/ceph/ceph-client.admin.49793.log.gz 2024-09-17T05:23:32.907 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42822.log 2024-09-17T05:23:32.907 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.42948.log: /var/log/ceph/ceph-client.admin.42822.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.42948.log.gz 2024-09-17T05:23:32.907 INFO:teuthology.orchestra.run.smithi098.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-17T05:23:32.907 INFO:teuthology.orchestra.run.smithi098.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42822.log.gz 2024-09-17T05:23:32.908 INFO:teuthology.orchestra.run.smithi098.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-17T05:23:32.908 INFO:teuthology.orchestra.run.smithi098.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-17T05:23:32.908 INFO:teuthology.orchestra.run.smithi098.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-17T05:23:32.908 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-mon.b.log: 92.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-17T05:23:32.909 INFO:teuthology.orchestra.run.smithi167.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-17T05:23:32.937 INFO:teuthology.orchestra.run.smithi167.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-17T05:23:32.939 INFO:teuthology.orchestra.run.smithi167.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-17T05:23:32.939 INFO:teuthology.orchestra.run.smithi167.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-17T05:23:32.958 INFO:teuthology.orchestra.run.smithi167.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-17T05:23:32.972 INFO:teuthology.orchestra.run.smithi167.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-17T05:23:32.975 INFO:teuthology.orchestra.run.smithi098.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-17T05:23:32.996 INFO:teuthology.orchestra.run.smithi098.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-17T05:23:32.998 INFO:teuthology.orchestra.run.smithi098.stderr: 2024-09-17T05:23:32.998 INFO:teuthology.orchestra.run.smithi098.stderr:real 0m0.217s 2024-09-17T05:23:32.999 INFO:teuthology.orchestra.run.smithi098.stderr:user 0m0.604s 2024-09-17T05:23:32.999 INFO:teuthology.orchestra.run.smithi098.stderr:sys 0m0.157s 2024-09-17T05:23:33.000 INFO:teuthology.orchestra.run.smithi167.stderr: 93.6% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-17T05:23:33.002 INFO:teuthology.orchestra.run.smithi167.stderr: 2024-09-17T05:23:33.002 INFO:teuthology.orchestra.run.smithi167.stderr:real 0m0.190s 2024-09-17T05:23:33.002 INFO:teuthology.orchestra.run.smithi167.stderr:user 0m0.920s 2024-09-17T05:23:33.002 INFO:teuthology.orchestra.run.smithi167.stderr:sys 0m0.057s 2024-09-17T05:23:33.002 INFO:tasks.ceph:Archiving logs... 2024-09-17T05:23:33.002 DEBUG:teuthology.misc:Transferring archived files from smithi098:/var/log/ceph to /home/teuthworker/archive/avan-2024-09-17_05:02:16-fs:volumes-wip-athakkar-testing-2024-09-16-2351-distro-default-smithi/7908691/remote/smithi098/log 2024-09-17T05:23:33.003 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T05:23:33.300 DEBUG:teuthology.misc:Transferring archived files from smithi167:/var/log/ceph to /home/teuthworker/archive/avan-2024-09-17_05:02:16-fs:volumes-wip-athakkar-testing-2024-09-16-2351-distro-default-smithi/7908691/remote/smithi167/log 2024-09-17T05:23:33.301 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T05:23:33.450 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-17T05:23:33.467 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-17T05:23:33.467 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T05:23:33.470 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T05:23:33.550 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-17T05:23:33.559 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-17T05:23:33.560 DEBUG:teuthology.orchestra.run.smithi098:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T05:23:33.562 DEBUG:teuthology.orchestra.run.smithi167:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T05:23:33.574 INFO:teuthology.orchestra.run.smithi098.stderr:bash: line 1: ntpq: command not found 2024-09-17T05:23:33.576 INFO:teuthology.orchestra.run.smithi167.stderr:bash: line 1: ntpq: command not found 2024-09-17T05:23:33.579 INFO:teuthology.orchestra.run.smithi098.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T05:23:33.579 INFO:teuthology.orchestra.run.smithi098.stdout:=============================================================================== 2024-09-17T05:23:33.579 INFO:teuthology.orchestra.run.smithi098.stdout:^* hv01.front.sepia.ceph.com 3 6 177 61 +1164us[+1178us] +/- 39ms 2024-09-17T05:23:33.579 INFO:teuthology.orchestra.run.smithi098.stdout:^+ hv02.front.sepia.ceph.com 3 6 177 62 +235us[ +249us] +/- 61ms 2024-09-17T05:23:33.579 INFO:teuthology.orchestra.run.smithi098.stdout:^+ hv03.front.sepia.ceph.com 3 6 177 61 -2289us[-2289us] +/- 65ms 2024-09-17T05:23:33.579 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T05:23:33.580 INFO:teuthology.orchestra.run.smithi167.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T05:23:33.580 INFO:teuthology.orchestra.run.smithi167.stdout:=============================================================================== 2024-09-17T05:23:33.580 INFO:teuthology.orchestra.run.smithi167.stdout:^* hv01.front.sepia.ceph.com 3 6 177 61 +1148us[+1148us] +/- 39ms 2024-09-17T05:23:33.580 INFO:teuthology.orchestra.run.smithi167.stdout:^+ hv02.front.sepia.ceph.com 3 6 177 61 +201us[ +200us] +/- 61ms 2024-09-17T05:23:33.580 INFO:teuthology.orchestra.run.smithi167.stdout:^+ hv03.front.sepia.ceph.com 3 6 177 62 -2283us[-2283us] +/- 65ms 2024-09-17T05:23:33.581 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T05:23:33.582 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-17T05:23:33.677 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-17T05:23:33.678 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-17T05:23:33.732 DEBUG:teuthology.orchestra.run.smithi098:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-17T05:23:33.798 DEBUG:teuthology.orchestra.run.smithi167:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-17T05:23:33.861 DEBUG:teuthology.orchestra.run.smithi098:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T05:23:33.889 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:23:33.890 DEBUG:teuthology.orchestra.run.smithi167:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T05:23:33.918 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:23:33.919 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-17T05:23:33.982 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-17T05:23:34.066 INFO:teuthology.task.internal:Duration was 486.021991 seconds 2024-09-17T05:23:34.067 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-17T05:23:34.095 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-17T05:23:34.096 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T05:23:34.099 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T05:23:34.137 INFO:teuthology.orchestra.run.smithi098.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T05:23:34.138 INFO:teuthology.orchestra.run.smithi167.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T05:23:34.654 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-17T05:23:34.655 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi098.front.sepia.ceph.com 2024-09-17T05:23:34.655 DEBUG:teuthology.orchestra.run.smithi098:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T05:23:34.715 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi167.front.sepia.ceph.com 2024-09-17T05:23:34.715 DEBUG:teuthology.orchestra.run.smithi167:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T05:23:34.739 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-17T05:23:34.740 DEBUG:teuthology.orchestra.run.smithi098:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T05:23:34.758 DEBUG:teuthology.orchestra.run.smithi167:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T05:23:34.806 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-17T05:23:34.807 DEBUG:teuthology.orchestra.run.smithi098:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T05:23:34.825 DEBUG:teuthology.orchestra.run.smithi167:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T05:23:34.949 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-17T05:23:34.960 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-17T05:23:34.960 DEBUG:teuthology.orchestra.run.smithi098:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T05:23:34.985 DEBUG:teuthology.orchestra.run.smithi167:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T05:23:35.010 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-17T05:23:35.020 DEBUG:teuthology.orchestra.run.smithi098:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T05:23:35.028 DEBUG:teuthology.orchestra.run.smithi167:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T05:23:35.049 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern = core 2024-09-17T05:23:35.073 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern = core 2024-09-17T05:23:35.087 DEBUG:teuthology.orchestra.run.smithi098:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T05:23:35.116 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:23:35.117 DEBUG:teuthology.orchestra.run.smithi167:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T05:23:35.146 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:23:35.146 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-17T05:23:35.156 INFO:teuthology.task.internal:Transferring archived files... 2024-09-17T05:23:35.157 DEBUG:teuthology.misc:Transferring archived files from smithi098:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/avan-2024-09-17_05:02:16-fs:volumes-wip-athakkar-testing-2024-09-16-2351-distro-default-smithi/7908691/remote/smithi098 2024-09-17T05:23:35.157 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T05:23:35.191 DEBUG:teuthology.misc:Transferring archived files from smithi167:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/avan-2024-09-17_05:02:16-fs:volumes-wip-athakkar-testing-2024-09-16-2351-distro-default-smithi/7908691/remote/smithi167 2024-09-17T05:23:35.191 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T05:23:35.225 INFO:teuthology.task.internal:Removing archive directory... 2024-09-17T05:23:35.225 DEBUG:teuthology.orchestra.run.smithi098:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T05:23:35.228 DEBUG:teuthology.orchestra.run.smithi167:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T05:23:35.276 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-17T05:23:35.288 INFO:teuthology.task.internal:Not uploading archives. 2024-09-17T05:23:35.289 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-17T05:23:35.317 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-17T05:23:35.317 DEBUG:teuthology.orchestra.run.smithi098:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T05:23:35.320 DEBUG:teuthology.orchestra.run.smithi167:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T05:23:35.332 INFO:teuthology.orchestra.run.smithi098.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 05:23 /home/ubuntu/cephtest 2024-09-17T05:23:35.335 INFO:teuthology.orchestra.run.smithi167.stdout: 266054 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 05:23 /home/ubuntu/cephtest 2024-09-17T05:23:35.336 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-17T05:23:35.346 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-17T05:23:35.415 INFO:teuthology.run:Summary data: description: fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/finisher_per_module}} duration: 486.02199149131775 flavor: default owner: scheduled_avan@teuthology success: true 2024-09-17T05:23:35.416 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T05:23:35.530 INFO:teuthology.run:pass